sandcrawler - [no description]

	Commit message (Collapse)	Author	Age	Files	Lines
*	persist grobid: actually, status_code is required	Bryan Newbold	2020-01-21	1	-2/+9
\| \| \| \| \| \| \|	Instead of working around when missing, force it to exist but skip in database insert section. Disk mode still needs to check if blank.
*	persist: work around GROBID timeouts with no status_code	Bryan Newbold	2020-01-21	1	-2/+2
\|
*	persist worker: implement updated ingest result semantics	Bryan Newbold	2020-01-15	1	-11/+16
\|
*	ingest persist skips 'existing' ingest results	Bryan Newbold	2020-01-14	1	-0/+3
\|
*	handle grobid2json errors in calling code instead	Bryan Newbold	2020-01-02	1	-1/+7
\|
*	db: move duplicate row filtering into DB insert helpers	Bryan Newbold	2020-01-02	1	-15/+1
\|
*	remove unused filter in grobid worker	Bryan Newbold	2020-01-02	1	-1/+0
\|
*	fix dict typo	Bryan Newbold	2020-01-02	1	-1/+1
\|
*	improvements to grobid persist worker	Bryan Newbold	2020-01-02	1	-13/+16
\|
*	filter ingest results to not have key conflicts within batch	Bryan Newbold	2020-01-02	1	-1/+16
\| \| \| \| \|	This handles a corner case with ON CONFLICT ... DO UPDATE where you can't do multiple such updates in the same batch transaction.
*	db: fancy insert/update separation using postgres xmax	Bryan Newbold	2020-01-02	1	-9/+15
\|
*	add PersistGrobidDiskWorker	Bryan Newbold	2020-01-02	1	-0/+33
\| \| \| \|	To help with making dumps directly from Kafka (eg, for partner delivery)
*	flush out minio helper, add to grobid persist	Bryan Newbold	2020-01-02	1	-9/+29
\|
*	implement counts properly for persist workers	Bryan Newbold	2020-01-02	1	-15/+19
\|
*	start work on persist workers and tool	Bryan Newbold	2020-01-02	1	-0/+223