diff options
| author | Bryan Newbold <bnewbold@robocracy.org> | 2021-11-29 14:34:02 -0800 |
|---|---|---|
| committer | Bryan Newbold <bnewbold@robocracy.org> | 2021-11-29 14:34:02 -0800 |
| commit | c32154f2875a7fb9aac727013e1475cdd811e180 (patch) | |
| tree | f0e061498a101fa824995fb6ec9f91e7e44257e1 /notes/bulk_edits/2020-08-05_chocula.md | |
| parent | c5ea2dba358624f4c14da0a1a988ae14d0edfd59 (diff) | |
| download | fatcat-c32154f2875a7fb9aac727013e1475cdd811e180.tar.gz fatcat-c32154f2875a7fb9aac727013e1475cdd811e180.zip | |
move notes/bulk_edits/ to extra/bulk_edits/
Diffstat (limited to 'notes/bulk_edits/2020-08-05_chocula.md')
| -rw-r--r-- | notes/bulk_edits/2020-08-05_chocula.md | 17 |
1 files changed, 0 insertions, 17 deletions
diff --git a/notes/bulk_edits/2020-08-05_chocula.md b/notes/bulk_edits/2020-08-05_chocula.md deleted file mode 100644 index 78d2c9c3..00000000 --- a/notes/bulk_edits/2020-08-05_chocula.md +++ /dev/null @@ -1,17 +0,0 @@ - -Using `journal-metadata-bot` and `chocula_fatcat_export.2020-07-31.json` export. - -Start small: - - head -n100 /srv/fatcat/datasets/chocula_fatcat_export.2020-07-31.json | ./fatcat_import.py chocula --do-updates - - => Counter({'total': 100, 'update': 67, 'exists': 25, 'exists-skip-update': 24, 'insert': 8, 'exists-by-issnl': 1, 'skip': 0}) - -Full batch: - - time cat /srv/fatcat/datasets/chocula_fatcat_export.2020-07-31.json | ./fatcat_import.py chocula --do-updates - - - Counter({'total': 164950, 'update': 112074, 'exists': 37243, 'exists-skip-update': 35862, 'insert': 15633, 'exists-by-issnl': 1381, 'skip': 0}) - - real 16m9.779s - user 6m26.324s - sys 0m16.088s |