summaryrefslogtreecommitdiffstats
Commit message (Expand)AuthorAgeFilesLines
* common: use smaller batch size since XML parsing may be slowMartin Czygan2020-03-101-1/+1
* pubmed: log to stderrMartin Czygan2020-03-101-1/+1
* pubmed: move mapping generation out of fetch_dateMartin Czygan2020-03-102-7/+10
* harvest: fix imports from HarvestPubmedWorker cleanupMartin Czygan2020-03-102-4/+4
* pubmed: citations is a bit more preciseMartin Czygan2020-03-091-1/+1
* pubmed: we sync from FTPMartin Czygan2020-03-091-1/+1
* oaipmh: HarvestPubmedWorker obsoleted by PubmedFTPWorkerMartin Czygan2020-03-091-34/+0
* fatcat_import: address potential hanging, if stdin is emptyMartin Czygan2020-03-091-0/+2
* more pubmed adjustmentsMartin Czygan2020-02-226-71/+197
* pubmed ftp: fix urlMartin Czygan2020-02-191-4/+6
* pubmed ftp harvest and KafkaBs4XmlPusherMartin Czygan2020-02-196-21/+307
* fatcat_ingest: as 'fatcat-ingest', not 'fatcat-ingest-container'Bryan Newbold2020-02-141-1/+1
* Merge branch 'martin-harvest-print' into 'master'bnewbold2020-02-143-17/+22
|\
| * harvest: log state on startup and use stderr for diagnosticsMartin Czygan2020-02-143-17/+22
|/
* add acceptlist override for biorxiv/medrxivBryan Newbold2020-02-101-2/+12
* check ingest_request_source existance for SPN as well as ingestBryan Newbold2020-02-061-0/+3
* additional trusted link sourcesBryan Newbold2020-02-061-0/+3
* add mag and s2 as trusted link sourcesBryan Newbold2020-02-061-1/+1
* ingest worker: handle missing ingest_request_sourceBryan Newbold2020-02-061-0/+3
* switch '!= None' to 'is not None'Bryan Newbold2020-02-041-3/+3
* allow-non-oa is a top-level flag, not sub-commandBryan Newbold2020-02-041-3/+0
* default to PMC ingest URLs over DOIBryan Newbold2020-02-041-4/+4
* ingest: add 'extid' and 'query' modes; filters; refactorBryan Newbold2020-02-041-38/+147
* Merge branch 'martin-datacite-strptime-none' into 'master'Martin Czygan2020-01-311-1/+1
|\
| * datacite: prevent noneMartin Czygan2020-01-311-1/+1
|/
* Merge branch 'martin-datacite-micropub' into 'master'Martin Czygan2020-01-314-25/+162
|\
| * datacite: name shall not be NoneMartin Czygan2020-01-311-1/+1
| * datacite: add exception for https://www.micropublication.org/Martin Czygan2020-01-312-1/+7
| * datacite: do not skip records w/o dateMartin Czygan2020-01-311-2/+1
| * datacite: improve docstringMartin Czygan2020-01-311-4/+4
| * datacite: improve date handling and minor tweakMartin Czygan2020-01-304-21/+153
|/
* fix KafkaError worker reporting for partition errorsBryan Newbold2020-01-293-3/+3
* additional DOI prefix filtersBryan Newbold2020-01-281-0/+8
* increase kafka-pixy timeout to 25 secondsBryan Newbold2020-01-281-1/+1
* apply ingest request filtering in entity workerBryan Newbold2020-01-281-3/+34
* remove 'oa_only' feature from ingest transformBryan Newbold2020-01-282-15/+1
* more TODO/proposal cleanupBryan Newbold2020-01-224-10/+34
* more details on potential _edit table disk savingsBryan Newbold2020-01-221-3/+23
* proposal of ideas for reducing database sizeBryan Newbold2020-01-211-0/+154
* cleanup some of old TODO list into proposalsBryan Newbold2020-01-214-44/+269
* refactor fatcat_import kafka group namesBryan Newbold2020-01-211-13/+54
* fix trivial typo in file importerBryan Newbold2020-01-201-1/+1
* stats: remove internal PG table sizes from old dumpsBryan Newbold2020-01-192-292/+0
* update stats and table sizesBryan Newbold2020-01-194-0/+96
* Merge branch 'martin-openapi-typo-exmaple' into 'master'bnewbold2020-01-191-1/+1
|\
| * fix a typo in openapi definitionMartin Czygan2020-01-181-1/+1
* | Merge branch 'martin-guide-typos-sentance' into 'master'bnewbold2020-01-191-2/+2
|\ \
| * | fix two typos in editing guideMartin Czygan2020-01-181-2/+2
| |/
* | basic notes in bulk edit changelogBryan Newbold2020-01-191-0/+7
* | bulk edit notes for datacite (QA)Bryan Newbold2020-01-191-0/+152