summaryrefslogtreecommitdiffstats
path: root/notes/import_timing_20180910.txt
diff options
context:
space:
mode:
authorBryan Newbold <bnewbold@robocracy.org>2018-09-22 19:08:18 -0700
committerBryan Newbold <bnewbold@robocracy.org>2018-09-22 19:08:18 -0700
commit91eb3a7a9e7fdb1b344462d5bfb3e826320dc431 (patch)
treeaa56b19199df44e91eb4193711a9d39d5ef7dc73 /notes/import_timing_20180910.txt
parentb12158b396bd849f40ff6713ad7836f3293f4029 (diff)
downloadfatcat-91eb3a7a9e7fdb1b344462d5bfb3e826320dc431.tar.gz
fatcat-91eb3a7a9e7fdb1b344462d5bfb3e826320dc431.zip
commit old notes and other files
Diffstat (limited to 'notes/import_timing_20180910.txt')
-rw-r--r--notes/import_timing_20180910.txt1
1 files changed, 1 insertions, 0 deletions
diff --git a/notes/import_timing_20180910.txt b/notes/import_timing_20180910.txt
index c9f18548..43c76e43 100644
--- a/notes/import_timing_20180910.txt
+++ b/notes/import_timing_20180910.txt
@@ -122,6 +122,7 @@ Dumps!
=> 101k 0:00:34 [2.99k/s]
=> estimate 6.5 hours
+ # NOTE AFTER THE FACT: had "contaner" typo in the below, so wasn't expanding containers
cat ../extra/sql_dumps/fatcat_ident_releases.tsv | time ./target/release/fatcat-export release --expand files,contaner -j8 -q | pv -l | gzip > fatcat_release_dump_expanded.json.gz
=> TPS: 29605 (!)
=> 183k 0:00:35 [ 5.8k/s] (how is this faster than the above? other disk stuff finished?)