summaryrefslogtreecommitdiffstats
path: root/python/fatcat_tools/workers
Commit message (Expand)AuthorAgeFilesLines
* update crawl blocklist for SPNv2 requests which mostly failBryan Newbold2020-08-101-2/+10
* lint (flake8) tool python filesBryan Newbold2020-07-013-12/+0
* more changelog ES fixesBryan Newbold2020-04-171-4/+6
* ES changelog worker: fixes for ident; fetch update from API if neededBryan Newbold2020-04-171-2/+9
* Merge branch 'martin-changelog-to-es' into 'master'bnewbold2020-04-172-2/+23
|\
| * derive changelog worker from release workerMartin Czygan2020-04-172-2/+23
* | changelog: limit typesMartin Czygan2020-04-161-5/+1
* | changelog: extend release_types considered documentsMartin Czygan2020-04-161-10/+19
|/
* ingest: more DOI patterns to treat as OABryan Newbold2020-03-281-0/+26
* ingest: always try some lancet journalsBryan Newbold2020-03-191-0/+3
* entity worker: ingest more releasesBryan Newbold2020-02-221-1/+37
* always crawl researchgate DOIsBryan Newbold2020-02-181-0/+2
* add acceptlist override for biorxiv/medrxivBryan Newbold2020-02-101-2/+12
* fix KafkaError worker reporting for partition errorsBryan Newbold2020-01-292-2/+2
* additional DOI prefix filtersBryan Newbold2020-01-281-0/+8
* apply ingest request filtering in entity workerBryan Newbold2020-01-281-3/+34
* update ingest request schemaBryan Newbold2019-12-131-1/+1
* project -> ingest_request_sourceBryan Newbold2019-11-151-1/+1
* add ingest request feature to entity_updates workerBryan Newbold2019-11-151-4/+20
* review/fix all confluent-kafka produce codeBryan Newbold2019-09-202-12/+26
* small fixes to confluent-kafka importers/workersBryan Newbold2019-09-203-12/+41
* convert pipeline workers from pykafka to confluent-kafkaBryan Newbold2019-09-203-125/+230
* refactor all python source for client lib nameBryan Newbold2019-09-052-3/+3
* start new ES container worker kafka groupBryan Newbold2019-07-311-0/+2
* fix typo in typoBryan Newbold2019-06-241-1/+1
* fix typo in changelog workerBryan Newbold2019-06-241-1/+1
* more links on new homepageBryan Newbold2019-06-192-2/+2
* fix and workaround container entities in release topicBryan Newbold2019-05-302-2/+8
* fix syntax bugs (container elastic worker)Bryan Newbold2019-05-301-5/+5
* add container update elastic workerBryan Newbold2019-05-302-6/+26
* file and container update kafka topicsBryan Newbold2019-05-301-54/+69
* update elastic for releases when files addedBryan Newbold2019-05-301-1/+36
* 10 MByte default Kafka produce (workers)Bryan Newbold2019-03-062-2/+9
* elastic-release worker w/o APIBryan Newbold2019-03-041-4/+4
* fix elastic research worker api argBryan Newbold2019-03-041-4/+3
* bunch of lint/whitespace cleanupsBryan Newbold2019-02-222-4/+3
* fatcat -> fatcat_release ES indexBryan Newbold2019-01-281-2/+3
* include filesets and webcaptures in exportsBryan Newbold2019-01-181-1/+1
* Merge branch 'bnewbold-crude-auth'Bryan Newbold2019-01-082-9/+7
|\
| * workers do API-passing (not URI-passing)Bryan Newbold2019-01-082-9/+7
* | check request status codes idiomaticallyBryan Newbold2018-12-291-1/+1
|/
* not as strong a todo (timestamps)Bryan Newbold2018-11-191-1/+1
* bunch of pylint cleanupBryan Newbold2018-11-151-1/+1
* large refactor of python names/pathsBryan Newbold2018-11-153-17/+22
* have recent message helper cleanup consumerBryan Newbold2018-11-151-1/+5
* fix worker codeBryan Newbold2018-11-142-2/+5
* most_recent_message as reusable functionBryan Newbold2018-11-142-26/+26
* switch to auto consumer offset updatesBryan Newbold2018-11-132-2/+11
* to_elastic_dict -> release_elastic_dictBryan Newbold2018-11-131-1/+2
* more simple fatcat_client importsBryan Newbold2018-11-131-1/+1
generated by cgit v1.2.3 (git 2.39.1) at 2024-11-27 22:55:00 +0000