aboutsummaryrefslogtreecommitdiffstats
path: root/python/fatcat_tools
Commit message (Expand)AuthorAgeFilesLines
* python: partial importer utilization of new schema changesBryan Newbold2021-10-133-6/+18
* python: implement ES schema changesBryan Newbold2021-10-131-4/+17
* Merge branch 'bnewbold-ingest-tweaks' into 'master'bnewbold2021-10-023-39/+106
|\
| * kafka import: optional 'force-flush' mode for some importersBryan Newbold2021-10-011-0/+13
| * new SPN web (html) importerBryan Newbold2021-10-012-27/+81
| * ingest importer behavior tweaksBryan Newbold2021-10-011-8/+8
| * importer common: more verbose logging (with counts)Bryan Newbold2021-10-011-4/+4
* | datacite: skip empty abstractsMartin Czygan2021-10-011-1/+4
|/
* pubmed: workaround a networking issueMartin Czygan2021-09-091-24/+21
* pubmed: add option to ftp download with lftpMartin Czygan2021-09-081-2/+31
* pubmed harvester: add basic retry logicMartin Czygan2021-08-201-8/+21
* refs: default to *not* consolidating worksBryan Newbold2021-08-061-1/+1
* refs: lint fixesBryan Newbold2021-07-271-0/+1
* refs: support for wikipedia outbound refs, and display in tablesBryan Newbold2021-07-271-2/+2
* refs: generalize web endpoints; JSON content negotiation; openlibrary inbound...Bryan Newbold2021-07-232-22/+57
* refs: small refactors/tweaksBryan Newbold2021-07-231-11/+17
* remove unused imports (lint)Bryan Newbold2021-07-232-3/+2
* pylint: skip pydantic import check (dynamic/extensions)Bryan Newbold2021-07-231-8/+2
* refs: refactor web paths; enrich refs as generic; remove old refs linkBryan Newbold2021-07-231-50/+35
* refs fetch: add some hacks; sort hitsBryan Newbold2021-07-231-6/+16
* fixes for newer ref indexBryan Newbold2021-07-231-1/+1
* references: refactor to point to access_options transform; comment out CSL fi...Bryan Newbold2021-07-231-57/+8
* partial access options transform for releasesBryan Newbold2021-07-231-0/+58
* initial inbound/outbound reference query helpersBryan Newbold2021-07-231-0/+450
* pubmed: update docsMartin Czygan2021-07-171-2/+3
* pubmed: do not fail when accessing missing fileMartin Czygan2021-07-171-2/+8
* pubmed: reconnect on errorMartin Czygan2021-07-161-4/+30
* more consistent and defensive lower-casing of DOIsBryan Newbold2021-06-233-3/+8
* datacite: more careful title string access; fixes sentry #88350Martin Czygan2021-06-111-1/+1
* clean_doi() should lower-case returned DOIBryan Newbold2021-06-071-1/+4
* ingest: swap ingest and file checks, to result in clearer stats/counts of ski...Bryan Newbold2021-06-031-2/+2
* ingest: don't accept mag and s2 URLsBryan Newbold2021-06-031-4/+4
* changelog worker: fix file/fileset typo, caught by lintBryan Newbold2021-05-251-1/+1
* small python lint fixes (no behavior change)Bryan Newbold2021-05-253-4/+2
* ingest: add per-container ingest type overridesBryan Newbold2021-05-211-1/+17
* arabesque importer: ensure full 14-digit timestampsBryan Newbold2021-05-211-1/+3
* transforms: fix 'display_ame' typoBryan Newbold2021-04-191-2/+2
* prefer contrib.creator.display_name over contrib.raw_nameBryan Newbold2021-04-122-4/+7
* es worker: ensure kafka messages get clearedBryan Newbold2021-04-121-0/+2
* es indexing: more 'wip' fixesBryan Newbold2021-04-121-1/+5
* ES indexing: skip 'wip' entities with a warningBryan Newbold2021-04-121-11/+16
* container ES index worker: support for querying statusBryan Newbold2021-04-061-5/+32
* ES schema updates: doc_index_ts as a str, not datetimeBryan Newbold2021-04-061-4/+4
* container search schema: preservation stats, new fieldsBryan Newbold2021-04-061-2/+18
* release ES: add discipline fieldBryan Newbold2021-04-061-0/+2
* ES schemas: add doc_index_ts to all mappingsBryan Newbold2021-04-061-0/+4
* indexing: don't use document namesBryan Newbold2021-04-061-14/+4
* datacite: a missing surname should be None, not the empty stringMartin Czygan2021-04-021-2/+1
* elasticsearch: simple new dblp and doaj fieldsBryan Newbold2021-01-201-0/+4
* web ingest: terminal URL mismatch as skip, not assertBryan Newbold2020-12-301-1/+3
generated by cgit v1.2.3 (git 2.39.1) at 2024-11-22 03:11:07 +0000