summaryrefslogtreecommitdiffstats
path: root/python/fatcat_harvest.py
Commit message (Collapse)AuthorAgeFilesLines
* harvest: fix imports from HarvestPubmedWorker cleanupMartin Czygan2020-03-101-2/+2
|
* pubmed ftp harvest and KafkaBs4XmlPusherMartin Czygan2020-02-191-4/+11
| | | | | | | * add PubmedFTPWorker * utils are currently stored alongside pubmed (e.g. ftpretr, xmlstream) but may live elsewhere, as they are more generic * add KafkaBs4XmlPusher
* improve argparse usageBryan Newbold2019-12-111-8/+10
| | | | | | | | | | | | | | Use --fatcat-api-url instead of (ambiguous) --host-url for commands that aren't deployed/running via systemd. TODO: update the other --host-url usage, and either roll-out change consistently or support the old arg as an alias during cut-over Use argparse.ArgumentDefaultsHelpFormatter (thanks Martin!) Add help messages for all sub-commands, both as documentation and as a way to get argparse to print available commands in a more readable format.
* make default kafka env 'dev', not 'qa'Bryan Newbold2019-09-201-2/+2
|
* bunch of lint/whitespace cleanupsBryan Newbold2019-02-221-1/+1
|
* start refactoring API object passingBryan Newbold2019-01-081-0/+5
|
* fix OAI-PMH name/finished messageBryan Newbold2018-11-211-6/+6
|
* continous is a flag, not argBryan Newbold2018-11-211-1/+1
|
* correct kafka topic namesBryan Newbold2018-11-201-12/+12
|
* initial OAI-PMH harvestersBryan Newbold2018-11-191-3/+54
|
* better DOI registrar harvestersBryan Newbold2018-11-191-2/+5
|
* refactoring harvestersBryan Newbold2018-11-151-0/+66