Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | review/fix all confluent-kafka produce code | Bryan Newbold | 2019-09-20 | 1 | -4/+12 |
| | |||||
* | small fixes to confluent-kafka importers/workers | Bryan Newbold | 2019-09-20 | 1 | -4/+10 |
| | | | | | | | | - decrease default changelog pipeline to 5.0sec - fix missing KafkaException harvester imports - more confluent-kafka tweaks - updates to kafka consumer configs - bump elastic updates consumergroup (again) | ||||
* | convert pipeline workers from pykafka to confluent-kafka | Bryan Newbold | 2019-09-20 | 1 | -67/+116 |
| | |||||
* | fix typo in typo | Bryan Newbold | 2019-06-24 | 1 | -1/+1 |
| | |||||
* | fix typo in changelog worker | Bryan Newbold | 2019-06-24 | 1 | -1/+1 |
| | |||||
* | more links on new homepage | Bryan Newbold | 2019-06-19 | 1 | -1/+1 |
| | | | | | matching produce sizes. may want to tweak this config in the future for throughput. | ||||
* | fix and workaround container entities in release topic | Bryan Newbold | 2019-05-30 | 1 | -2/+2 |
| | |||||
* | file and container update kafka topics | Bryan Newbold | 2019-05-30 | 1 | -54/+69 |
| | |||||
* | update elastic for releases when files added | Bryan Newbold | 2019-05-30 | 1 | -1/+36 |
| | | | | A bunch of remaining TODOs here | ||||
* | 10 MByte default Kafka produce (workers) | Bryan Newbold | 2019-03-06 | 1 | -2/+6 |
| | |||||
* | bunch of lint/whitespace cleanups | Bryan Newbold | 2019-02-22 | 1 | -2/+1 |
| | |||||
* | include filesets and webcaptures in exports | Bryan Newbold | 2019-01-18 | 1 | -1/+1 |
| | |||||
* | workers do API-passing (not URI-passing) | Bryan Newbold | 2019-01-08 | 1 | -4/+4 |
| | |||||
* | not as strong a todo (timestamps) | Bryan Newbold | 2018-11-19 | 1 | -1/+1 |
| | |||||
* | bunch of pylint cleanup | Bryan Newbold | 2018-11-15 | 1 | -1/+1 |
| | |||||
* | large refactor of python names/paths | Bryan Newbold | 2018-11-15 | 1 | -3/+4 |
| | | | | | | | - Add __init__.py files for fatcat_tools submodules, and use them in imports - Add a bunch of comments to files. - rename a number of classes and functions to be less verbose | ||||
* | fix worker code | Bryan Newbold | 2018-11-14 | 1 | -2/+3 |
| | |||||
* | most_recent_message as reusable function | Bryan Newbold | 2018-11-14 | 1 | -26/+1 |
| | |||||
* | switch to auto consumer offset updates | Bryan Newbold | 2018-11-13 | 1 | -1/+6 |
| | | | | | | This is the classic/correct way to do consumer group updates for higher throughput, when "at least once" semantics are acceptible (as they are here; double processing should be safe/fine). | ||||
* | shuffle around fatcat_tools layout | Bryan Newbold | 2018-11-13 | 1 | -0/+122 |