diff options
Diffstat (limited to 'python')
| -rw-r--r-- | python/README_import.md | 5 |
1 files changed, 5 insertions, 0 deletions
diff --git a/python/README_import.md b/python/README_import.md index 38c8406f..d481b7ae 100644 --- a/python/README_import.md +++ b/python/README_import.md @@ -112,3 +112,8 @@ From compressed: sys 19m3.576s Really sped up once not contending with Crossref import, so don't run these two at the same time. + +## Matched + + zcat /srv/datasets/2018-08-27-2352.17-matchcrossref.insertable.json.gz | pv -l | time parallel -j12 --round-robin --pipe ./fatcat_import.py import-matched - + |