diff options
| author | Bryan Newbold <bnewbold@robocracy.org> | 2018-09-22 19:08:18 -0700 |
|---|---|---|
| committer | Bryan Newbold <bnewbold@robocracy.org> | 2018-09-22 19:08:18 -0700 |
| commit | 91eb3a7a9e7fdb1b344462d5bfb3e826320dc431 (patch) | |
| tree | aa56b19199df44e91eb4193711a9d39d5ef7dc73 /notes/import_timing_20180910.txt | |
| parent | b12158b396bd849f40ff6713ad7836f3293f4029 (diff) | |
| download | fatcat-91eb3a7a9e7fdb1b344462d5bfb3e826320dc431.tar.gz fatcat-91eb3a7a9e7fdb1b344462d5bfb3e826320dc431.zip | |
commit old notes and other files
Diffstat (limited to 'notes/import_timing_20180910.txt')
| -rw-r--r-- | notes/import_timing_20180910.txt | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/notes/import_timing_20180910.txt b/notes/import_timing_20180910.txt index c9f18548..43c76e43 100644 --- a/notes/import_timing_20180910.txt +++ b/notes/import_timing_20180910.txt @@ -122,6 +122,7 @@ Dumps! => 101k 0:00:34 [2.99k/s] => estimate 6.5 hours + # NOTE AFTER THE FACT: had "contaner" typo in the below, so wasn't expanding containers cat ../extra/sql_dumps/fatcat_ident_releases.tsv | time ./target/release/fatcat-export release --expand files,contaner -j8 -q | pv -l | gzip > fatcat_release_dump_expanded.json.gz => TPS: 29605 (!) => 183k 0:00:35 [ 5.8k/s] (how is this faster than the above? other disk stuff finished?) |