index
:
fatcat
bnewbold-doaj-article-harvest
bnewbold-elastic-extras
bnewbold-openapi-client-generator-v601
bnewbold-pythonclient-types
bnewbold-redoc
bnewbold-rust-gen-v5
bnewbold-sitemap
bnewbold-ubuntu-jammy
cockroach
confluent-kafka
master
preview
x-attic-auth-other-macaroon-lib
x-attic-camp
x-attic-changelog-export
x-attic-chocula
x-attic-cockroach
x-attic-golang
x-attic-more-importers
x-attic-preview
x-attic-python-rust-hacks
[no description]
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
path:
root
/
python
/
fatcat_tools
/
harvest
Commit message (
Expand
)
Author
Age
Files
Lines
*
Correct spelling mistakes
Edward Betts
2020-03-27
1
-2
/
+2
*
harvest: log state on startup and use stderr for diagnostics
Martin Czygan
2020-02-14
3
-17
/
+22
*
datacite: extend range search query
Martin Czygan
2019-12-27
1
-1
/
+1
*
avoid usage of short links
Martin Czygan
2019-12-27
1
-2
/
+2
*
Datacite API v2 throws 400, we cannot recover from, currently.
Martin Czygan
2019-12-27
1
-0
/
+4
*
datacite: update documentation, add links to issues
Martin Czygan
2019-12-27
1
-10
/
+5
*
datacite: use v2 of the API (flaky)
Martin Czygan
2019-12-27
1
-5
/
+28
*
refactor kafka producer in crossref harvester
Bryan Newbold
2019-12-06
1
-21
/
+26
*
crossref is_update isn't what I thought
Bryan Newbold
2019-12-03
1
-6
/
+2
*
review/fix all confluent-kafka produce code
Bryan Newbold
2019-09-20
3
-14
/
+49
*
small fixes to confluent-kafka importers/workers
Bryan Newbold
2019-09-20
2
-2
/
+2
*
small kafka tweaks for robustness
Bryan Newbold
2019-09-20
1
-0
/
+2
*
bump max message size to ~20 MBytes
Bryan Newbold
2019-09-20
2
-0
/
+2
*
fixes to confluent-kafka harvesters
Bryan Newbold
2019-09-20
3
-20
/
+21
*
first draft harvesters using confluent-kafka
Bryan Newbold
2019-09-20
3
-48
/
+104
*
increase default harvest window to 14 days
Bryan Newbold
2019-04-01
1
-2
/
+2
*
HACK: force pylint to ignore urllib3 Retry import
Bryan Newbold
2019-03-15
1
-1
/
+3
*
MEDLINE/Pubmed note
Bryan Newbold
2019-03-15
1
-2
/
+6
*
fix harvester session.get() params
Bryan Newbold
2019-03-06
1
-5
/
+8
*
retry/backoff for Crossref harvester
Bryan Newbold
2019-03-06
2
-2
/
+24
*
bunch of lint/whitespace cleanups
Bryan Newbold
2019-02-22
3
-9
/
+6
*
check request status codes idiomatically
Bryan Newbold
2018-12-29
1
-2
/
+2
*
clean up harvester comments/docs
Bryan Newbold
2018-11-21
3
-50
/
+31
*
use isoformat() to format dates
Bryan Newbold
2018-11-21
2
-4
/
+4
*
fix loop_sleep typo
Bryan Newbold
2018-11-21
2
-2
/
+2
*
fix datacite DOI extraction
Bryan Newbold
2018-11-21
1
-1
/
+1
*
fix OAI-PMH name/finished message
Bryan Newbold
2018-11-21
1
-1
/
+6
*
fix oai-pmh issue again
Bryan Newbold
2018-11-21
1
-13
/
+14
*
oaipmh: handle NoRecordsMatch
Bryan Newbold
2018-11-21
1
-5
/
+8
*
initial OAI-PMH harvesters
Bryan Newbold
2018-11-19
3
-5
/
+167
*
better DOI registrar harvesters
Bryan Newbold
2018-11-19
3
-48
/
+145
*
bunch of pylint cleanup
Bryan Newbold
2018-11-15
1
-7
/
+12
*
refactoring harvesters
Bryan Newbold
2018-11-15
5
-196
/
+210
*
initial work on metadata harvest bots
Bryan Newbold
2018-11-14
4
-0
/
+197