sandcrawler - [no description]

	Commit message (Collapse)	Author	Age	Files	Lines
*	new 'daily' and 'priority' ingest request topics	Bryan Newbold	2021-09-30	1	-2/+8
\| \| \| \| \| \| \| \| \|	The old ingest request queue was always getting lopsided, suspect because it was scaled up (additional partitions) at some point in the past, hoping new topics will fix this. New '-priority' queue is like '-bulk', but for smaller-volume SPN-like requests. Eg, interactive mode.
*	kafka: delete unused work-updates topic	Bryan Newbold	2021-09-13	1	-4/+0
\|
*	Merge branch 'bnewbold-html-ingest'	Bryan Newbold	2020-11-06	1	-0/+16
\|\
\| *	kafka: new XML+HTML topics	Bryan Newbold	2020-11-04	1	-0/+15
\| \|
* \|	kafka topics for fatcat -> scholar pipeline	Bryan Newbold	2020-10-27	1	-0/+19
\|/
*	PDF extraction kafka topics	Bryan Newbold	2020-06-25	1	-0/+24
\|
*	topics: add pubmed ftp topic	Martin Czygan	2020-03-12	1	-1/+9
\| \| \| \|	PubmedFTPWorker replaced OAI recently. This documents the new topic.
*	pdftrio proposal and start on schema+kafka	Bryan Newbold	2020-02-12	1	-0/+8
\|
*	kafka config: actually we do want large bulk ingest request topic	Bryan Newbold	2020-01-15	1	-1/+1
\|
*	add new bulk ingest request topic	Bryan Newbold	2020-01-14	1	-1/+6
\|
*	kafka topics: compress api-datacite	Bryan Newbold	2019-12-24	1	-1/+1
\|
*	new kafka topics for file ingest	Bryan Newbold	2019-11-13	1	-0/+15
\| \| \| \|	Created these for 'qa' and 'prod'
*	update kafka topic listings	Bryan Newbold	2019-10-03	1	-21/+35
\|
*	more kafka topics	Bryan Newbold	2019-07-07	1	-0/+9
\|
*	new release schema kafka topic	Bryan Newbold	2019-05-24	1	-2/+3
\|
*	more fatcat update topics	Bryan Newbold	2019-04-12	1	-0/+3
\|
*	rename grobided to grobid-output	Bryan Newbold	2018-11-21	1	-2/+6
\|
*	kafka notes	Bryan Newbold	2018-11-20	1	-0/+86