Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | ingest tool: clear_scroll allowed in es-public-proxy for some time | Bryan Newbold | 2022-01-21 | 1 | -8/+0 |
| | |||||
* | Merge branch 'bnewbold-file-es' into 'master' | bnewbold | 2022-01-21 | 4 | -4/+66 |
|\ | | | | | | | | | File entity elasticsearch index worker See merge request webgroup/fatcat!136 | ||||
| * | entity worker: expand creators in release entities | Bryan Newbold | 2021-12-15 | 1 | -1/+1 |
| | | |||||
| * | small default config typo fixes for elasticsearch workers | Bryan Newbold | 2021-12-15 | 1 | -2/+2 |
| | | |||||
| * | file elasticsearch index worker | Bryan Newbold | 2021-12-15 | 3 | -1/+63 |
| | | |||||
* | | elasticsearch: bump timeout to 40 seconds (from default of 10) | Bryan Newbold | 2022-01-10 | 1 | -1/+1 |
| | | |||||
* | | make fmt | Bryan Newbold | 2021-12-15 | 2 | -5/+6 |
| | | |||||
* | | Merge branch 'martin-sentry-sdk' into 'master' | bnewbold | 2021-12-16 | 10 | -344/+396 |
|\ \ | | | | | | | | | | | | | move from raven to sentry_sdk See merge request webgroup/fatcat!135 | ||||
| * | | move from raven to sentry_sdk | Martin Czygan | 2021-12-14 | 10 | -344/+396 |
| |/ | | | | | | | | | | | | | | | | | related docs: * https://docs.sentry.io/platforms/python/guides/flask/migration/ * https://docs.sentry.io/platforms/python/guides/asgi/configuration/integrations/flask/ > `fetch_git_sha` is gone, see: https://forum.sentry.io/t/fetch-git-sha-equivalent-in-the-unified-python-sdk/5521 | ||||
* / | crossref importer: skip affiliations lacking 'name' | Bryan Newbold | 2021-12-15 | 1 | -0/+3 |
|/ | | | | Relatedly, we should start handling ROR affiliations in contribs soon. | ||||
* | mergers: fix typo in env var name | Bryan Newbold | 2021-12-07 | 3 | -3/+3 |
| | |||||
* | ES container schema: add 'sim_pubid' and `ia_sim_collection` fields | Bryan Newbold | 2021-12-03 | 1 | -0/+2 |
| | |||||
* | ES transform: remove prototype microfilm links | Bryan Newbold | 2021-12-03 | 1 | -20/+0 |
| | | | | This ended up being a feature in scholar.archive.org, not fatcat. | ||||
* | chocula importer: handle not-upper-case ISSNs | Bryan Newbold | 2021-11-30 | 1 | -2/+6 |
| | |||||
* | chocula importer: handle broken ISSNs in extra metadata | Bryan Newbold | 2021-11-30 | 1 | -2/+7 |
| | |||||
* | chocula importer: tweak counting, conditions for doing updates | Bryan Newbold | 2021-11-30 | 1 | -15/+7 |
| | |||||
* | chocula importer: move issne/issnp 'extra' to top-level fields if doing updates | Bryan Newbold | 2021-11-30 | 1 | -0/+6 |
| | |||||
* | chocula: don't do name cleanups in importer | Bryan Newbold | 2021-11-30 | 1 | -8/+2 |
| | | | | This kind of cleanup should be done in 'chocula' instead. | ||||
* | container merger: fix bug with filtering by release count | Bryan Newbold | 2021-11-30 | 1 | -13/+15 |
| | | | | | Also apply the "human edit" and "release count" checks only to the dupe (to-be-redirected) idents. | ||||
* | release merger: same editgroup_id fixes as for file and container mergers | Bryan Newbold | 2021-11-24 | 1 | -1/+5 |
| | |||||
* | container merger: fixes from QA testing | Bryan Newbold | 2021-11-24 | 1 | -8/+13 |
| | |||||
* | mergers: don't try to accept empty editgroups in dry-run-mode | Bryan Newbold | 2021-11-24 | 1 | -2/+4 |
| | |||||
* | ES release transform: handle redirected containers better | Bryan Newbold | 2021-11-24 | 1 | -1/+1 |
| | | | | | Despite the inline comment, we were not actually grabbing the "redirected" ident correctly, meaning some counts would not be accurate. | ||||
* | container merger: defer allocation of editgroup_id; and dummy code path | Bryan Newbold | 2021-11-24 | 1 | -1/+5 |
| | |||||
* | initial implementation of container merger | Bryan Newbold | 2021-11-24 | 2 | -0/+353 |
| | |||||
* | file merger: allocate editgroup id later in 'merge' process | Bryan Newbold | 2021-11-24 | 1 | -1/+5 |
| | | | | | The motivation is to avoid creating empty editgroups in dry-run mode, and when all entities are "skipped" | ||||
* | Merge branch 'bnewbold-mergers' into 'master' | bnewbold | 2021-11-25 | 5 | -0/+800 |
|\ | | | | | | | | | entity mergers framework See merge request webgroup/fatcat!133 | ||||
| * | mergers common: remove inaccurate comment | Bryan Newbold | 2021-11-24 | 1 | -2/+0 |
| | | | | | | | | Caught in review, thanks miku | ||||
| * | file merger: add content_scope to list of merged fields | Bryan Newbold | 2021-11-24 | 1 | -1/+1 |
| | | |||||
| * | release merger: some progress, but also disable (not complete) | Bryan Newbold | 2021-11-23 | 1 | -12/+72 |
| | | |||||
| * | file merges: fixes from testing in QA | Bryan Newbold | 2021-11-23 | 1 | -14/+23 |
| | | |||||
| * | mergers: small tweaks | Bryan Newbold | 2021-11-23 | 2 | -3/+3 |
| | | |||||
| * | mergers: remove entity mergers from __init__ (to work around warning) | Bryan Newbold | 2021-11-23 | 1 | -2/+0 |
| | | |||||
| * | initial file merger, with tests | Bryan Newbold | 2021-11-23 | 2 | -0/+388 |
| | | |||||
| * | mergers: fmt, lint, refactors | Bryan Newbold | 2021-11-23 | 3 | -96/+200 |
| | | | | | | | | | | These old merger code is from an old branch and needed significant cleanup | ||||
| * | remove top-level fatcat_merge.py; going to call module __main__ going forward | Bryan Newbold | 2021-11-23 | 1 | -112/+0 |
| | | |||||
| * | first iteration of mergers | Bryan Newbold | 2021-11-23 | 4 | -0/+355 |
| | | |||||
* | | codespell fixes to various other docs | Bryan Newbold | 2021-11-24 | 1 | -1/+1 |
| | | |||||
* | | codespell fixes in python code (comments) | Bryan Newbold | 2021-11-24 | 4 | -6/+6 |
| | | |||||
* | | codespell fixes in web interface templates | Bryan Newbold | 2021-11-24 | 14 | -19/+19 |
|/ | |||||
* | Merge branch 'bnewbold-content-scope' | Bryan Newbold | 2021-11-22 | 5 | -1/+8 |
|\ | |||||
| * | bump python client to 0.5.0 | Bryan Newbold | 2021-11-17 | 1 | -1/+1 |
| | | |||||
| * | content_scope: include in file ES schema and transform | Bryan Newbold | 2021-11-17 | 1 | -0/+1 |
| | | |||||
| * | minimal python test coverage of content_scope fields | Bryan Newbold | 2021-11-17 | 3 | -0/+6 |
| | | |||||
| * | python code: update python_openapi_client in lockfile | Bryan Newbold | 2021-11-17 | 1 | -1/+1 |
| | | |||||
* | | typo: don't expand containers for release revs (TOML) | Bryan Newbold | 2021-11-19 | 1 | -1/+1 |
| | | |||||
* | | web editgroup diff: don't enrich in TOML diff; fix overlapping break | Bryan Newbold | 2021-11-19 | 2 | -5/+8 |
| | | |||||
* | | web generic entity helpers: make enrichment optional | Bryan Newbold | 2021-11-19 | 1 | -18/+49 |
| | | |||||
* | | polish editgroup diff view | Bryan Newbold | 2021-11-18 | 4 | -92/+83 |
| | | | | | | | | Still not as great as it could be, but useful in this state. | ||||
* | | initial implementation of editgroup 'diff' for review | Bryan Newbold | 2021-11-17 | 4 | -6/+183 |
| | |