aboutsummaryrefslogtreecommitdiffstats
path: root/python/fatcat_ingest.py
Commit message (Expand)AuthorAgeFilesLines
* ingest: longer ES timeoutBryan Newbold2022-02-251-1/+1
* update sentry SDK configurationBryan Newbold2022-02-251-3/+1
* ingest tool: clear_scroll allowed in es-public-proxy for some timeBryan Newbold2022-01-211-8/+0
* move from raven to sentry_sdkMartin Czygan2021-12-141-2/+2
* typing: first batch of python bulk type annotationsBryan Newbold2021-11-031-6/+6
* fmt (black): *.pyBryan Newbold2021-11-021-95/+115
* python: isort everythingBryan Newbold2021-11-021-6/+6
* default ingest request topic now '-daily'; configurable for ingest_tool.pyBryan Newbold2021-09-301-1/+6
* ingest: don't 'track_total_hits' for ES 7.x count()Bryan Newbold2021-05-311-1/+1
* fatcat_ingest: fix recent lint failureBryan Newbold2021-04-091-1/+1
* search: more ES 7.x changes (track total counts)Bryan Newbold2021-04-091-0/+1
* ingest tool: support for setting ingest typeBryan Newbold2020-11-061-0/+4
* ingest: configurable ES indexv0.3.2Bryan Newbold2020-04-081-1/+4
* Merge pull request #53 from EdwardBetts/spellingbnewbold2020-03-271-1/+1
|\
| * Correct spelling mistakesEdward Betts2020-03-271-1/+1
* | add --force-crawl flag to ingest toolBryan Newbold2020-03-021-0/+5
|/
* fatcat_ingest: as 'fatcat-ingest', not 'fatcat-ingest-container'Bryan Newbold2020-02-141-1/+1
* switch '!= None' to 'is not None'Bryan Newbold2020-02-041-3/+3
* allow-non-oa is a top-level flag, not sub-commandBryan Newbold2020-02-041-3/+0
* ingest: add 'extid' and 'query' modes; filters; refactorBryan Newbold2020-02-041-38/+147
* remove 'oa_only' feature from ingest transformBryan Newbold2020-01-281-1/+0
* add missing sentry/raven tagsBryan Newbold2020-01-101-2/+7
* container_issnl, not issnl, for ES release queryBryan Newbold2019-12-121-1/+1
* improve argparse usageBryan Newbold2019-12-111-6/+4
* simplify ES scroll deletion using param()Bryan Newbold2019-12-111-29/+29
* add ingest-container command (new CLI tool)Bryan Newbold2019-12-101-0/+136