Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | schema: add 'crossref' to bundle schema, and add from_json() helper | Bryan Newbold | 2021-06-02 | 1 | -13/+2 |
| | | | | | from_json() refactor was an earlier TODO, to reduce duplication when updating fields on this class | ||||
* | increase indexing timeout to 50sec (60sec for kafka) | Bryan Newbold | 2021-02-15 | 1 | -2/+2 |
| | |||||
* | enable sentry exceptions for workers and pipelines | Bryan Newbold | 2021-01-30 | 1 | -1/+10 |
| | | | | It is otherwise difficult to debug multi-million record pipelines. | ||||
* | refactor ES configuration setting names | Bryan Newbold | 2021-01-25 | 1 | -2/+2 |
| | |||||
* | worker: switch to ES helper for bulk indexing | Bryan Newbold | 2021-01-18 | 1 | -8/+10 |
| | | | | | This seems to resolve the problems with index workers failing after a couple hundred docs. | ||||
* | worker: check for error responses from ES | Bryan Newbold | 2021-01-05 | 1 | -1/+4 |
| | |||||
* | basic HTML transform/index support | Bryan Newbold | 2020-11-18 | 1 | -0/+1 |
| | |||||
* | initial fetch and index workers | Bryan Newbold | 2020-10-16 | 1 | -0/+238 |