summaryrefslogtreecommitdiffstats
path: root/python/fatcat_harvest.py
Commit message (Collapse)AuthorAgeFilesLines
* move from raven to sentry_sdkMartin Czygan2021-12-141-2/+2
| | | | | | | | | related docs: * https://docs.sentry.io/platforms/python/guides/flask/migration/ * https://docs.sentry.io/platforms/python/guides/asgi/configuration/integrations/flask/ > `fetch_git_sha` is gone, see: https://forum.sentry.io/t/fetch-git-sha-equivalent-in-the-unified-python-sdk/5521
* typing: first batch of python bulk type annotationsBryan Newbold2021-11-031-8/+8
| | | | | | While these changes are more delicate than simple lint changes, this specific batch of edits and annotations was *relatively* simple, and resulted in few code changes other than function signature additions.
* fmt (black): *.pyBryan Newbold2021-11-021-38/+56
|
* python: isort everythingBryan Newbold2021-11-021-4/+11
|
* example of starting to use format stringsBryan Newbold2020-04-171-12/+12
|
* Merge pull request #53 from EdwardBetts/spellingbnewbold2020-03-271-1/+1
|\ | | | | Correct spelling mistakes
| * Correct spelling mistakesEdward Betts2020-03-271-1/+1
| |
* | cleanup unused code in fatcat_harvest.pyBryan Newbold2020-03-231-7/+0
| |
* | harvest: fix imports from HarvestPubmedWorker cleanupMartin Czygan2020-03-101-2/+2
| |
* | pubmed ftp harvest and KafkaBs4XmlPusherMartin Czygan2020-02-191-4/+11
|/ | | | | | | * add PubmedFTPWorker * utils are currently stored alongside pubmed (e.g. ftpretr, xmlstream) but may live elsewhere, as they are more generic * add KafkaBs4XmlPusher
* improve argparse usageBryan Newbold2019-12-111-8/+10
| | | | | | | | | | | | | | Use --fatcat-api-url instead of (ambiguous) --host-url for commands that aren't deployed/running via systemd. TODO: update the other --host-url usage, and either roll-out change consistently or support the old arg as an alias during cut-over Use argparse.ArgumentDefaultsHelpFormatter (thanks Martin!) Add help messages for all sub-commands, both as documentation and as a way to get argparse to print available commands in a more readable format.
* make default kafka env 'dev', not 'qa'Bryan Newbold2019-09-201-2/+2
|
* bunch of lint/whitespace cleanupsBryan Newbold2019-02-221-1/+1
|
* start refactoring API object passingBryan Newbold2019-01-081-0/+5
|
* fix OAI-PMH name/finished messageBryan Newbold2018-11-211-6/+6
|
* continous is a flag, not argBryan Newbold2018-11-211-1/+1
|
* correct kafka topic namesBryan Newbold2018-11-201-12/+12
|
* initial OAI-PMH harvestersBryan Newbold2018-11-191-3/+54
|
* better DOI registrar harvestersBryan Newbold2018-11-191-2/+5
|
* refactoring harvestersBryan Newbold2018-11-151-0/+66