diff options
| author | Bryan Newbold <bnewbold@archive.org> | 2019-02-01 15:13:32 -0800 |
|---|---|---|
| committer | Bryan Newbold <bnewbold@archive.org> | 2019-02-01 15:13:32 -0800 |
| commit | 52967e05d2c8febdaa0426634fa987eaf5f58577 (patch) | |
| tree | da12fd9c2f1ea3d517246a60dbc1467eb0ad748f /notes/petabox_ia_metadata.txt | |
| parent | 8901138485d1da4eb9a2512268faaa27fdf567c5 (diff) | |
| download | sandcrawler-52967e05d2c8febdaa0426634fa987eaf5f58577.tar.gz sandcrawler-52967e05d2c8febdaa0426634fa987eaf5f58577.zip | |
give sort way more RAM by default
Diffstat (limited to 'notes/petabox_ia_metadata.txt')
| -rw-r--r-- | notes/petabox_ia_metadata.txt | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/notes/petabox_ia_metadata.txt b/notes/petabox_ia_metadata.txt index df3bdc1..3a99805 100644 --- a/notes/petabox_ia_metadata.txt +++ b/notes/petabox_ia_metadata.txt @@ -14,7 +14,7 @@ Commands: ia-mine metamgr-journals-loose.20181218.items > journals.20181218.json export LC_ALL=C - cat journals-ia.20181218.json | jq 'select(.files) | .files[] | select(.format == "Text PDF") | .sha1' -r | sort -u > journals-ia.20181218.pdf-sha1.tsv + cat journals-ia.20181218.json | jq 'select(.files) | .files[] | select(.format == "Text PDF") | .sha1' -r | sort -S 4G -u > journals-ia.20181218.pdf-sha1.tsv Size/results: |