summaryrefslogtreecommitdiffstats
path: root/python/fatcat_tools/importers
Commit message (Expand)AuthorAgeFilesLines
* add some more domain/rel URL mappingsBryan Newbold2020-02-221-0/+9
* Merge branch 'bnewbold-shadow-import'Bryan Newbold2020-02-192-0/+196
|\
| * remove arabesque short wayback URL hackBryan Newbold2020-02-141-6/+0
| * improve shadow import file url cleanup pathBryan Newbold2020-02-131-2/+12
| * shadow import fixes from QA testingBryan Newbold2020-02-131-0/+6
| * shadow import: more filtering of file_meta fieldsBryan Newbold2020-02-131-0/+10
| * basic shadow importerBryan Newbold2020-02-132-0/+176
* | ingest import: fix edit_extra pathBryan Newbold2020-02-181-1/+1
* | ingest importer: edit_extra is a top-level keyBryan Newbold2020-02-181-1/+1
* | ingest import: allow short version of corpus namesBryan Newbold2020-02-181-0/+3
* | ingest importer: pass through link relBryan Newbold2020-02-181-1/+6
|/
* check ingest_request_source existance for SPN as well as ingestBryan Newbold2020-02-061-0/+3
* additional trusted link sourcesBryan Newbold2020-02-061-0/+3
* add mag and s2 as trusted link sourcesBryan Newbold2020-02-061-1/+1
* ingest worker: handle missing ingest_request_sourceBryan Newbold2020-02-061-0/+3
* datacite: prevent noneMartin Czygan2020-01-311-1/+1
* datacite: name shall not be NoneMartin Czygan2020-01-311-1/+1
* datacite: add exception for https://www.micropublication.org/Martin Czygan2020-01-311-0/+5
* datacite: do not skip records w/o dateMartin Czygan2020-01-311-2/+1
* datacite: improve docstringMartin Czygan2020-01-311-4/+4
* datacite: improve date handling and minor tweakMartin Czygan2020-01-301-19/+42
* fix KafkaError worker reporting for partition errorsBryan Newbold2020-01-291-1/+1
* fix trivial typo in file importerBryan Newbold2020-01-201-1/+1
* ingest: improve tests, support old ingest resultsBryan Newbold2020-01-151-3/+12
* update ingest worker for schema tweaksBryan Newbold2020-01-151-8/+15
* ingest: allow more sources to auto-importBryan Newbold2020-01-151-1/+2
* datacite: skip records without a doiMartin Czygan2020-01-131-0/+4
* datacite: add entry to license slug mapMartin Czygan2020-01-091-0/+1
* datacite: ignore known unknown values in resourceType*Martin Czygan2020-01-091-2/+2
* datacite: abstracts may be strings or list of stringsMartin Czygan2020-01-091-2/+15
* datacite: improve license_slug handlingMartin Czygan2020-01-091-60/+101
* datacite: add 'Unknown' to blacklistMartin Czygan2020-01-091-1/+5
* datacite: get rid of schemaVersionMartin Czygan2020-01-091-3/+0
* Merge branch 'martin-datacite-import'Martin Czygan2020-01-082-0/+1024
|\
| * datacite: pass in doi into factored out methodMartin Czygan2020-01-081-2/+3
| * datacite: factor out contributor handlingMartin Czygan2020-01-081-80/+103
| * datacite: catch type mismatch in language detectionMartin Czygan2020-01-081-3/+2
| * datacite: name extra.month, extra.release_monthMartin Czygan2020-01-081-1/+3
| * datacite: mark additional files as stubMartin Czygan2020-01-081-0/+4
| * datacite: CCDC are entries, mostlyMartin Czygan2020-01-081-0/+4
| * datacite: use more specific release_type, if possibleMartin Czygan2020-01-081-0/+6
| * datacite: ignore certain namesMartin Czygan2020-01-081-0/+6
| * datacite: over 3% records have the same title: stubMartin Czygan2020-01-081-0/+7
| * datacite: fill a few more release_type gapsMartin Czygan2020-01-081-17/+18
| * datacite: adding datacite-specific extra metadataMartin Czygan2020-01-071-0/+28
| * datacite: apply pylint suggestionsMartin Czygan2020-01-071-8/+10
| * datacite: fix typosMartin Czygan2020-01-071-1/+1
| * datacite: set release_stage to published by defaultMartin Czygan2020-01-061-4/+5
| * datacite: month field should be top-levelMartin Czygan2020-01-061-2/+2
| * datacite: include month in extraMartin Czygan2020-01-061-0/+2
generated by cgit v1.2.3 (git 2.39.1) at 2024-11-27 16:24:26 +0000