From 5526d497c9f7805b7b68e6c763afe48c9b56a5ca Mon Sep 17 00:00:00 2001 From: Martin Czygan Date: Thu, 17 Dec 2020 16:28:29 +0100 Subject: update notes --- notes/2020_11_testruns.md | 14 ++++++++++++++ 1 file changed, 14 insertions(+) (limited to 'notes') diff --git a/notes/2020_11_testruns.md b/notes/2020_11_testruns.md index 9e700c9..1d8c742 100644 --- a/notes/2020_11_testruns.md +++ b/notes/2020_11_testruns.md @@ -2,6 +2,20 @@ ## 12/2020 +A verification test run with GNU parallel: + +``` +$ zstdcat -T0 cluster_tsandcrawler.json.zst | wc -l +124321361 + +$ time zstdcat -T0 cluster_tsandcrawler.json.zst | \ + parallel --pipe python -m fuzzycat verify | \ + zstd -c9 > out +... +real 194m33.272s +user 2479m56.510s +sys 462m14.991s +``` ### More versions -- cgit v1.2.3