| Commit message (Collapse) | Author | Age | Files | Lines | |
|---|---|---|---|---|---|
| * | new 'daily' and 'priority' ingest request topics | Bryan Newbold | 2021-09-30 | 1 | -2/+8 |
| | | | | | | | | | | The old ingest request queue was always getting lopsided, suspect because it was scaled up (additional partitions) at some point in the past, hoping new topics will fix this. New '-priority' queue is like '-bulk', but for smaller-volume SPN-like requests. Eg, interactive mode. | ||||
| * | kafka: delete unused work-updates topic | Bryan Newbold | 2021-09-13 | 1 | -4/+0 |
| | | |||||
| * | kafka re-balancing tweaks | Bryan Newbold | 2021-09-03 | 1 | -1/+2 |
| | | |||||
| * | kafka docs for rolling back a consumer group | Bryan Newbold | 2020-11-20 | 1 | -0/+9 |
| | | |||||
| * | Merge branch 'bnewbold-html-ingest' | Bryan Newbold | 2020-11-06 | 1 | -0/+16 |
| |\ | |||||
| | * | kafka: new XML+HTML topics | Bryan Newbold | 2020-11-04 | 1 | -0/+15 |
| | | | |||||
| * | | kafka topics for fatcat -> scholar pipeline | Bryan Newbold | 2020-10-27 | 1 | -0/+19 |
| |/ | |||||
| * | PDF extraction kafka topics | Bryan Newbold | 2020-06-25 | 1 | -0/+24 |
| | | |||||
| * | kafka: more reblance notes | Bryan Newbold | 2020-04-24 | 1 | -1/+14 |
| | | |||||
| * | kafka: how to rebalance parititions between brokers | Bryan Newbold | 2020-04-24 | 1 | -0/+29 |
| | | |||||
| * | topics: add pubmed ftp topic | Martin Czygan | 2020-03-12 | 1 | -1/+9 |
| | | | | | PubmedFTPWorker replaced OAI recently. This documents the new topic. | ||||
| * | pdftrio proposal and start on schema+kafka | Bryan Newbold | 2020-02-12 | 1 | -0/+8 |
| | | |||||
| * | kafka config: actually we do want large bulk ingest request topic | Bryan Newbold | 2020-01-15 | 1 | -1/+1 |
| | | |||||
| * | add new bulk ingest request topic | Bryan Newbold | 2020-01-14 | 1 | -1/+6 |
| | | |||||
| * | kafka topics: compress api-datacite | Bryan Newbold | 2019-12-24 | 1 | -1/+1 |
| | | |||||
| * | new kafka topics for file ingest | Bryan Newbold | 2019-11-13 | 1 | -0/+15 |
| | | | | | Created these for 'qa' and 'prod' | ||||
| * | update kafka topic listings | Bryan Newbold | 2019-10-03 | 1 | -21/+35 |
| | | |||||
| * | more kafka topics | Bryan Newbold | 2019-07-07 | 1 | -0/+9 |
| | | |||||
| * | new release schema kafka topic | Bryan Newbold | 2019-05-24 | 1 | -2/+3 |
| | | |||||
| * | more fatcat update topics | Bryan Newbold | 2019-04-12 | 1 | -0/+3 |
| | | |||||
| * | use ipv4 localhost with kafkacat | Bryan Newbold | 2018-12-19 | 1 | -1/+1 |
| | | |||||
| * | update notes | Bryan Newbold | 2018-12-10 | 2 | -0/+45 |
| | | |||||
| * | more kafka/grobid notes | Bryan Newbold | 2018-11-21 | 1 | -0/+12 |
| | | |||||
| * | rename grobided to grobid-output | Bryan Newbold | 2018-11-21 | 2 | -3/+7 |
| | | |||||
| * | initial work on kafka_grobid worker | Bryan Newbold | 2018-11-20 | 1 | -0/+18 |
| | | |||||
| * | kafka notes | Bryan Newbold | 2018-11-20 | 2 | -0/+110 |
 |
index : sandcrawler | |
| [no description] |
| aboutsummaryrefslogtreecommitdiffstats |