diff options
author | Bryan Newbold <bnewbold@robocracy.org> | 2019-02-01 15:10:34 -0800 |
---|---|---|
committer | Bryan Newbold <bnewbold@robocracy.org> | 2019-02-01 15:10:36 -0800 |
commit | 7463049b621f7729b48c5e06429767118c1b8506 (patch) | |
tree | 0d094a15fcc6948a2e82914b4c1801c50d569e64 /rust | |
parent | fc6b8e0f96f0a0e69f4992525ba801d8f6639854 (diff) | |
download | fatcat-7463049b621f7729b48c5e06429767118c1b8506.tar.gz fatcat-7463049b621f7729b48c5e06429767118c1b8506.zip |
update dump and sort commands
Pipeline sorts are *so* starved and slow ; they only get a few MByte of
RAM by default!
Diffstat (limited to 'rust')
-rw-r--r-- | rust/README.export.md | 10 |
1 files changed, 5 insertions, 5 deletions
diff --git a/rust/README.export.md b/rust/README.export.md index f9965a6f..f02c7f45 100644 --- a/rust/README.export.md +++ b/rust/README.export.md @@ -1,5 +1,5 @@ -First create ident files, following `../extra/sql_dumps/`. +First create ident files, following `../extra/sql_dumps/README.md`. Then, to dump locally to stdout: @@ -7,8 +7,8 @@ Then, to dump locally to stdout: Or, in production: - cat /tmp/fatcat_ident_releases.tsv | ./target/release/fatcat-export release --expand files,filesets,webcaptures,container -j8 | pv -l | gzip > /srv/fatcat/snapshots/release_export_expanded.json.gz - cat /tmp/fatcat_ident_releases.tsv | ./target/release/fatcat-export release -j8 | pv -l | gzip > /srv/fatcat/snapshots/release_export.json.gz - cat /tmp/fatcat_ident_containers.tsv | ./target/release/fatcat-export container -j8 | pv -l | gzip > /srv/fatcat/snapshots/container_export.json.gz - cat /tmp/fatcat_ident_files.tsv | ./target/release/fatcat-export file -j8 | pv -l | gzip > /srv/fatcat/snapshots/file_export.json.gz + cat /tmp/fatcat_ident_releases.tsv | ./target/release/fatcat-export release --expand files,filesets,webcaptures,container -j8 | gzip > /srv/fatcat/snapshots/release_export_expanded.json.gz + cat /tmp/fatcat_ident_releases.tsv | ./target/release/fatcat-export release -j8 | gzip > /srv/fatcat/snapshots/release_export.json.gz + cat /tmp/fatcat_ident_containers.tsv | ./target/release/fatcat-export container -j8 | gzip > /srv/fatcat/snapshots/container_export.json.gz + cat /tmp/fatcat_ident_files.tsv | ./target/release/fatcat-export file -j8 | gzip > /srv/fatcat/snapshots/file_export.json.gz |