summaryrefslogtreecommitdiffstats
path: root/python/fatcat_tools/workers/changelog.py
Commit message (Collapse)AuthorAgeFilesLines
* review/fix all confluent-kafka produce codeBryan Newbold2019-09-201-4/+12
|
* small fixes to confluent-kafka importers/workersBryan Newbold2019-09-201-4/+10
| | | | | | | | - decrease default changelog pipeline to 5.0sec - fix missing KafkaException harvester imports - more confluent-kafka tweaks - updates to kafka consumer configs - bump elastic updates consumergroup (again)
* convert pipeline workers from pykafka to confluent-kafkaBryan Newbold2019-09-201-67/+116
|
* fix typo in typoBryan Newbold2019-06-241-1/+1
|
* fix typo in changelog workerBryan Newbold2019-06-241-1/+1
|
* more links on new homepageBryan Newbold2019-06-191-1/+1
| | | | | matching produce sizes. may want to tweak this config in the future for throughput.
* fix and workaround container entities in release topicBryan Newbold2019-05-301-2/+2
|
* file and container update kafka topicsBryan Newbold2019-05-301-54/+69
|
* update elastic for releases when files addedBryan Newbold2019-05-301-1/+36
| | | | A bunch of remaining TODOs here
* 10 MByte default Kafka produce (workers)Bryan Newbold2019-03-061-2/+6
|
* bunch of lint/whitespace cleanupsBryan Newbold2019-02-221-2/+1
|
* include filesets and webcaptures in exportsBryan Newbold2019-01-181-1/+1
|
* workers do API-passing (not URI-passing)Bryan Newbold2019-01-081-4/+4
|
* not as strong a todo (timestamps)Bryan Newbold2018-11-191-1/+1
|
* bunch of pylint cleanupBryan Newbold2018-11-151-1/+1
|
* large refactor of python names/pathsBryan Newbold2018-11-151-3/+4
| | | | | | | - Add __init__.py files for fatcat_tools submodules, and use them in imports - Add a bunch of comments to files. - rename a number of classes and functions to be less verbose
* fix worker codeBryan Newbold2018-11-141-2/+3
|
* most_recent_message as reusable functionBryan Newbold2018-11-141-26/+1
|
* switch to auto consumer offset updatesBryan Newbold2018-11-131-1/+6
| | | | | | This is the classic/correct way to do consumer group updates for higher throughput, when "at least once" semantics are acceptible (as they are here; double processing should be safe/fine).
* shuffle around fatcat_tools layoutBryan Newbold2018-11-131-0/+122