summaryrefslogtreecommitdiffstats
path: root/notes/bulk_edits/2019-09-03_chocula.md
blob: 03311c8cb6db0421535770e1fc53754f82a947cc (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23

Ran on my laptop, from master branch (`00e4ec6865782e4453d4dcec24ee205bf7c13ecf`).

In QA:

    time ./fatcat_import.py --host-url https://api.qa.fatcat.wiki/v0 chocula ~/code/chocula/export_fatcat.json
    [...]
    Counter({'total': 139032, 'exists': 76952, 'exists-skip-update': 65528, 'update': 46157, 'insert': 13605, 'exists-by-issnl': 8879, 'exists-not-found': 2538, 'skip': 2318, 'skip-unknown-new-issnl': 2318, 'exists-inactive': 7})
    real    32m30.009s
    user    4m44.176s
    sys     0m12.544s

In prod:

    time ./fatcat_import.py --host-url https://api.fatcat.wiki/v0 chocula ~/code/chocula/export_fatcat.2019-09-03.json

    Counter({'total': 139032, 'update': 66802, 'exists': 47586, 'exists-skip-update': 47428, 'insert': 22326, 'skip-unknown-new-issnl': 2318, 'skip': 2318, 'exists-by-issnl': 158})

    real    34m16.930s
    user    5m5.116s
    sys     0m13.560s

The container auto-updater is currently broken, so needed to manually dump/load into elastic.