| Commit message (Collapse) | Author | Age | Files | Lines | |
|---|---|---|---|---|---|
| * | ingest persist skips 'existing' ingest results | Bryan Newbold | 2020-01-14 | 1 | -0/+3 |
| | | |||||
| * | handle grobid2json errors in calling code instead | Bryan Newbold | 2020-01-02 | 1 | -1/+7 |
| | | |||||
| * | db: move duplicate row filtering into DB insert helpers | Bryan Newbold | 2020-01-02 | 1 | -15/+1 |
| | | |||||
| * | remove unused filter in grobid worker | Bryan Newbold | 2020-01-02 | 1 | -1/+0 |
| | | |||||
| * | fix dict typo | Bryan Newbold | 2020-01-02 | 1 | -1/+1 |
| | | |||||
| * | improvements to grobid persist worker | Bryan Newbold | 2020-01-02 | 1 | -13/+16 |
| | | |||||
| * | filter ingest results to not have key conflicts within batch | Bryan Newbold | 2020-01-02 | 1 | -1/+16 |
| | | | | | | This handles a corner case with ON CONFLICT ... DO UPDATE where you can't do multiple such updates in the same batch transaction. | ||||
| * | db: fancy insert/update separation using postgres xmax | Bryan Newbold | 2020-01-02 | 1 | -9/+15 |
| | | |||||
| * | add PersistGrobidDiskWorker | Bryan Newbold | 2020-01-02 | 1 | -0/+33 |
| | | | | | To help with making dumps directly from Kafka (eg, for partner delivery) | ||||
| * | flush out minio helper, add to grobid persist | Bryan Newbold | 2020-01-02 | 1 | -9/+29 |
| | | |||||
| * | implement counts properly for persist workers | Bryan Newbold | 2020-01-02 | 1 | -15/+19 |
| | | |||||
| * | start work on persist workers and tool | Bryan Newbold | 2020-01-02 | 1 | -0/+223 |
 |
index : sandcrawler | |
| [no description] |
| aboutsummaryrefslogtreecommitdiffstats |