Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | first draft harvesters using confluent-kafka | Bryan Newbold | 2019-09-20 | 3 | -48/+104 |
| | |||||
* | increase default harvest window to 14 days | Bryan Newbold | 2019-04-01 | 1 | -2/+2 |
| | |||||
* | HACK: force pylint to ignore urllib3 Retry import | Bryan Newbold | 2019-03-15 | 1 | -1/+3 |
| | | | | | | As the code comment mentions, not sure why pylint throws this error. requests and urllib3 are recent, and this code runs fine in tests and QA, and pylint is running (in CI) within pipenv. | ||||
* | MEDLINE/Pubmed note | Bryan Newbold | 2019-03-15 | 1 | -2/+6 |
| | | | | Also, arXivRaw, not arXiv (though see WIP on more-importers branch) | ||||
* | fix harvester session.get() params | Bryan Newbold | 2019-03-06 | 1 | -5/+8 |
| | |||||
* | retry/backoff for Crossref harvester | Bryan Newbold | 2019-03-06 | 2 | -2/+24 |
| | |||||
* | bunch of lint/whitespace cleanups | Bryan Newbold | 2019-02-22 | 3 | -9/+6 |
| | |||||
* | check request status codes idiomatically | Bryan Newbold | 2018-12-29 | 1 | -2/+2 |
| | |||||
* | clean up harvester comments/docs | Bryan Newbold | 2018-11-21 | 3 | -50/+31 |
| | |||||
* | use isoformat() to format dates | Bryan Newbold | 2018-11-21 | 2 | -4/+4 |
| | | | | This shouldn't change behavior; it's just more consistent. | ||||
* | fix loop_sleep typo | Bryan Newbold | 2018-11-21 | 2 | -2/+2 |
| | |||||
* | fix datacite DOI extraction | Bryan Newbold | 2018-11-21 | 1 | -1/+1 |
| | |||||
* | fix OAI-PMH name/finished message | Bryan Newbold | 2018-11-21 | 1 | -1/+6 |
| | |||||
* | fix oai-pmh issue again | Bryan Newbold | 2018-11-21 | 1 | -13/+14 |
| | |||||
* | oaipmh: handle NoRecordsMatch | Bryan Newbold | 2018-11-21 | 1 | -5/+8 |
| | |||||
* | initial OAI-PMH harvesters | Bryan Newbold | 2018-11-19 | 3 | -5/+167 |
| | |||||
* | better DOI registrar harvesters | Bryan Newbold | 2018-11-19 | 3 | -48/+145 |
| | |||||
* | bunch of pylint cleanup | Bryan Newbold | 2018-11-15 | 1 | -7/+12 |
| | |||||
* | refactoring harvesters | Bryan Newbold | 2018-11-15 | 5 | -196/+210 |
| | |||||
* | initial work on metadata harvest bots | Bryan Newbold | 2018-11-14 | 4 | -0/+197 |