summaryrefslogtreecommitdiffstats
path: root/python
Commit message (Expand)AuthorAgeFilesLines
...
| * | first implementation of ES file schemaBryan Newbold2020-01-293-3/+69
* | | Merge branch 'bnewbold-more-ingest' into 'master'bnewbold2020-02-251-1/+37
|\ \ \
| * | | entity worker: ingest more releasesBryan Newbold2020-02-221-1/+37
* | | | add some more domain/rel URL mappingsBryan Newbold2020-02-221-0/+9
|/ / /
* | | Merge branch 'bnewbold-shadow-import'Bryan Newbold2020-02-197-2/+289
|\ \ \
| * | | remove arabesque short wayback URL hackBryan Newbold2020-02-141-6/+0
| * | | clarify shadow filter codeBryan Newbold2020-02-131-1/+1
| * | | filter out shadows-only files in webfaceBryan Newbold2020-02-132-2/+7
| * | | improve shadow import file url cleanup pathBryan Newbold2020-02-131-2/+12
| * | | shadow import fixes from QA testingBryan Newbold2020-02-132-1/+7
| * | | shadow import: more filtering of file_meta fieldsBryan Newbold2020-02-133-18/+28
| * | | basic shadow importerBryan Newbold2020-02-135-0/+262
* | | | always crawl researchgate DOIsBryan Newbold2020-02-181-0/+2
* | | | ingest import: fix edit_extra pathBryan Newbold2020-02-181-1/+1
* | | | ingest importer: edit_extra is a top-level keyBryan Newbold2020-02-181-1/+1
* | | | ingest import: allow short version of corpus namesBryan Newbold2020-02-181-0/+3
* | | | ingest importer: pass through link relBryan Newbold2020-02-181-1/+6
| |_|/ |/| |
* | | fatcat_ingest: as 'fatcat-ingest', not 'fatcat-ingest-container'Bryan Newbold2020-02-141-1/+1
* | | harvest: log state on startup and use stderr for diagnosticsMartin Czygan2020-02-143-17/+22
|/ /
* | add acceptlist override for biorxiv/medrxivBryan Newbold2020-02-101-2/+12
* | check ingest_request_source existance for SPN as well as ingestBryan Newbold2020-02-061-0/+3
* | additional trusted link sourcesBryan Newbold2020-02-061-0/+3
* | add mag and s2 as trusted link sourcesBryan Newbold2020-02-061-1/+1
* | ingest worker: handle missing ingest_request_sourceBryan Newbold2020-02-061-0/+3
* | switch '!= None' to 'is not None'Bryan Newbold2020-02-041-3/+3
* | allow-non-oa is a top-level flag, not sub-commandBryan Newbold2020-02-041-3/+0
* | default to PMC ingest URLs over DOIBryan Newbold2020-02-041-4/+4
* | ingest: add 'extid' and 'query' modes; filters; refactorBryan Newbold2020-02-041-38/+147
* | datacite: prevent noneMartin Czygan2020-01-311-1/+1
* | datacite: name shall not be NoneMartin Czygan2020-01-311-1/+1
* | datacite: add exception for https://www.micropublication.org/Martin Czygan2020-01-312-1/+7
* | datacite: do not skip records w/o dateMartin Czygan2020-01-311-2/+1
* | datacite: improve docstringMartin Czygan2020-01-311-4/+4
* | datacite: improve date handling and minor tweakMartin Czygan2020-01-304-21/+153
|/
* fix KafkaError worker reporting for partition errorsBryan Newbold2020-01-293-3/+3
* additional DOI prefix filtersBryan Newbold2020-01-281-0/+8
* increase kafka-pixy timeout to 25 secondsBryan Newbold2020-01-281-1/+1
* apply ingest request filtering in entity workerBryan Newbold2020-01-281-3/+34
* remove 'oa_only' feature from ingest transformBryan Newbold2020-01-282-15/+1
* refactor fatcat_import kafka group namesBryan Newbold2020-01-211-13/+54
* fix trivial typo in file importerBryan Newbold2020-01-201-1/+1
* normal: DOI corner-case from pubmed importBryan Newbold2020-01-191-0/+9
* Merge branch 'martin-fix-container-search' into 'master'Martin Czygan2020-01-182-6/+6
|\
| * pagination: use correct endpoint in navigationMartin Czygan2020-01-182-6/+6
* | fix trivial one-character typo in fatcat_import.pyBryan Newbold2020-01-171-1/+1
* | actually control pubmed updates with a flagBryan Newbold2020-01-171-0/+4
* | do not normalize "en dash" in DOIMartin Czygan2020-01-172-3/+6
|/
* ingest: improve tests, support old ingest resultsBryan Newbold2020-01-154-4/+30
* update ingest worker for schema tweaksBryan Newbold2020-01-151-8/+15
* ingest: allow more sources to auto-importBryan Newbold2020-01-151-1/+2
generated by cgit v1.2.3 (git 2.39.1) at 2024-11-25 04:55:32 +0000