index
:
fatcat
bnewbold-doaj-article-harvest
bnewbold-elastic-extras
bnewbold-openapi-client-generator-v601
bnewbold-pythonclient-types
bnewbold-redoc
bnewbold-rust-gen-v5
bnewbold-sitemap
bnewbold-ubuntu-jammy
cockroach
confluent-kafka
master
preview
x-attic-auth-other-macaroon-lib
x-attic-camp
x-attic-changelog-export
x-attic-chocula
x-attic-cockroach
x-attic-golang
x-attic-more-importers
x-attic-preview
x-attic-python-rust-hacks
[no description]
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
path:
root
/
python
/
fatcat_tools
/
workers
/
changelog.py
Commit message (
Expand
)
Author
Age
Files
Lines
*
fmt (black): fatcat_tools/
Bryan Newbold
2021-11-02
1
-118
/
+138
*
python: isort everything
Bryan Newbold
2021-11-02
1
-1
/
+2
*
changelog worker: fix file/fileset typo, caught by lint
Bryan Newbold
2021-05-25
1
-1
/
+1
*
entity update worker: treat fileset and webcapture updates like file updates
Bryan Newbold
2020-12-16
1
-3
/
+25
*
entity updates: don't ingest JSTOR DOI prefixes
Bryan Newbold
2020-10-23
1
-0
/
+2
*
entity updater: new work update feed (ident and changelog metadata only)
Bryan Newbold
2020-10-16
1
-2
/
+24
*
ingest: default to crawl protocols.io DOIs
Bryan Newbold
2020-09-10
1
-0
/
+2
*
entity updater: handle doi=None case better
Bryan Newbold
2020-08-14
1
-1
/
+1
*
entity updater: es['publisher_type'] not always set
Bryan Newbold
2020-08-14
1
-1
/
+1
*
entity update: change big5 ingest behavior
Bryan Newbold
2020-08-11
1
-9
/
+15
*
entity update: default to ingest non-OA works
Bryan Newbold
2020-08-11
1
-9
/
+10
*
entity update: skip ingest of figshare+zenodo 'group' DOIs
Bryan Newbold
2020-08-11
1
-0
/
+15
*
update crawl blocklist for SPNv2 requests which mostly fail
Bryan Newbold
2020-08-10
1
-2
/
+10
*
lint (flake8) tool python files
Bryan Newbold
2020-07-01
1
-1
/
+0
*
changelog: limit types
Martin Czygan
2020-04-16
1
-5
/
+1
*
changelog: extend release_types considered documents
Martin Czygan
2020-04-16
1
-10
/
+19
*
ingest: more DOI patterns to treat as OA
Bryan Newbold
2020-03-28
1
-0
/
+26
*
ingest: always try some lancet journals
Bryan Newbold
2020-03-19
1
-0
/
+3
*
entity worker: ingest more releases
Bryan Newbold
2020-02-22
1
-1
/
+37
*
always crawl researchgate DOIs
Bryan Newbold
2020-02-18
1
-0
/
+2
*
add acceptlist override for biorxiv/medrxiv
Bryan Newbold
2020-02-10
1
-2
/
+12
*
fix KafkaError worker reporting for partition errors
Bryan Newbold
2020-01-29
1
-1
/
+1
*
additional DOI prefix filters
Bryan Newbold
2020-01-28
1
-0
/
+8
*
apply ingest request filtering in entity worker
Bryan Newbold
2020-01-28
1
-3
/
+34
*
update ingest request schema
Bryan Newbold
2019-12-13
1
-1
/
+1
*
project -> ingest_request_source
Bryan Newbold
2019-11-15
1
-1
/
+1
*
add ingest request feature to entity_updates worker
Bryan Newbold
2019-11-15
1
-4
/
+20
*
review/fix all confluent-kafka produce code
Bryan Newbold
2019-09-20
1
-4
/
+12
*
small fixes to confluent-kafka importers/workers
Bryan Newbold
2019-09-20
1
-4
/
+10
*
convert pipeline workers from pykafka to confluent-kafka
Bryan Newbold
2019-09-20
1
-67
/
+116
*
fix typo in typo
Bryan Newbold
2019-06-24
1
-1
/
+1
*
fix typo in changelog worker
Bryan Newbold
2019-06-24
1
-1
/
+1
*
more links on new homepage
Bryan Newbold
2019-06-19
1
-1
/
+1
*
fix and workaround container entities in release topic
Bryan Newbold
2019-05-30
1
-2
/
+2
*
file and container update kafka topics
Bryan Newbold
2019-05-30
1
-54
/
+69
*
update elastic for releases when files added
Bryan Newbold
2019-05-30
1
-1
/
+36
*
10 MByte default Kafka produce (workers)
Bryan Newbold
2019-03-06
1
-2
/
+6
*
bunch of lint/whitespace cleanups
Bryan Newbold
2019-02-22
1
-2
/
+1
*
include filesets and webcaptures in exports
Bryan Newbold
2019-01-18
1
-1
/
+1
*
workers do API-passing (not URI-passing)
Bryan Newbold
2019-01-08
1
-4
/
+4
*
not as strong a todo (timestamps)
Bryan Newbold
2018-11-19
1
-1
/
+1
*
bunch of pylint cleanup
Bryan Newbold
2018-11-15
1
-1
/
+1
*
large refactor of python names/paths
Bryan Newbold
2018-11-15
1
-3
/
+4
*
fix worker code
Bryan Newbold
2018-11-14
1
-2
/
+3
*
most_recent_message as reusable function
Bryan Newbold
2018-11-14
1
-26
/
+1
*
switch to auto consumer offset updates
Bryan Newbold
2018-11-13
1
-1
/
+6
*
shuffle around fatcat_tools layout
Bryan Newbold
2018-11-13
1
-0
/
+122