diff options
| author | Bryan Newbold <bnewbold@robocracy.org> | 2019-10-08 16:47:03 -0700 |
|---|---|---|
| committer | Bryan Newbold <bnewbold@robocracy.org> | 2019-10-08 16:47:03 -0700 |
| commit | 5808b06162263dee7e7d86d7369d19f299ddf4a9 (patch) | |
| tree | 0cefb9167ad9425cb221435da4ba50791380d5f0 /notes/bulk_edits/2019-09-03_chocula.md | |
| parent | 451815af3f0581c654cb38a2aabaef800789d037 (diff) | |
| download | fatcat-5808b06162263dee7e7d86d7369d19f299ddf4a9.tar.gz fatcat-5808b06162263dee7e7d86d7369d19f299ddf4a9.zip | |
move corpus changes to 'notes/bulk_edits'
Diffstat (limited to 'notes/bulk_edits/2019-09-03_chocula.md')
| -rw-r--r-- | notes/bulk_edits/2019-09-03_chocula.md | 23 |
1 files changed, 23 insertions, 0 deletions
diff --git a/notes/bulk_edits/2019-09-03_chocula.md b/notes/bulk_edits/2019-09-03_chocula.md new file mode 100644 index 00000000..03311c8c --- /dev/null +++ b/notes/bulk_edits/2019-09-03_chocula.md @@ -0,0 +1,23 @@ + +Ran on my laptop, from master branch (`00e4ec6865782e4453d4dcec24ee205bf7c13ecf`). + +In QA: + + time ./fatcat_import.py --host-url https://api.qa.fatcat.wiki/v0 chocula ~/code/chocula/export_fatcat.json + [...] + Counter({'total': 139032, 'exists': 76952, 'exists-skip-update': 65528, 'update': 46157, 'insert': 13605, 'exists-by-issnl': 8879, 'exists-not-found': 2538, 'skip': 2318, 'skip-unknown-new-issnl': 2318, 'exists-inactive': 7}) + real 32m30.009s + user 4m44.176s + sys 0m12.544s + +In prod: + + time ./fatcat_import.py --host-url https://api.fatcat.wiki/v0 chocula ~/code/chocula/export_fatcat.2019-09-03.json + + Counter({'total': 139032, 'update': 66802, 'exists': 47586, 'exists-skip-update': 47428, 'insert': 22326, 'skip-unknown-new-issnl': 2318, 'skip': 2318, 'exists-by-issnl': 158}) + + real 34m16.930s + user 5m5.116s + sys 0m13.560s + +The container auto-updater is currently broken, so needed to manually dump/load into elastic. |