diff options
| author | Martin Czygan <martin.czygan@gmail.com> | 2020-12-17 16:28:29 +0100 |
|---|---|---|
| committer | Martin Czygan <martin.czygan@gmail.com> | 2020-12-17 16:28:29 +0100 |
| commit | 5526d497c9f7805b7b68e6c763afe48c9b56a5ca (patch) | |
| tree | 6714350eeba3592a669465ae1a44b7d703676161 /notes | |
| parent | 6ac98f9f6b2487c930e686110b46183eb6f417dc (diff) | |
| download | fuzzycat-5526d497c9f7805b7b68e6c763afe48c9b56a5ca.tar.gz fuzzycat-5526d497c9f7805b7b68e6c763afe48c9b56a5ca.zip | |
update notes
Diffstat (limited to 'notes')
| -rw-r--r-- | notes/2020_11_testruns.md | 14 |
1 files changed, 14 insertions, 0 deletions
diff --git a/notes/2020_11_testruns.md b/notes/2020_11_testruns.md index 9e700c9..1d8c742 100644 --- a/notes/2020_11_testruns.md +++ b/notes/2020_11_testruns.md @@ -2,6 +2,20 @@ ## 12/2020 +A verification test run with GNU parallel: + +``` +$ zstdcat -T0 cluster_tsandcrawler.json.zst | wc -l +124321361 + +$ time zstdcat -T0 cluster_tsandcrawler.json.zst | \ + parallel --pipe python -m fuzzycat verify | \ + zstd -c9 > out +... +real 194m33.272s +user 2479m56.510s +sys 462m14.991s +``` ### More versions |