aboutsummaryrefslogtreecommitdiffstats
path: root/python/fatcat_tools
Commit message (Expand)AuthorAgeFilesLines
* factor out some basic kafka helpersBryan Newbold2019-12-102-0/+23
* add another ingest request source to whitelistBryan Newbold2019-12-101-2/+5
* refactor kafka producer in crossref harvesterBryan Newbold2019-12-061-21/+26
* tweaks to file ingest importerBryan Newbold2019-12-031-3/+4
* crossref is_update isn't what I thoughtBryan Newbold2019-12-031-6/+2
* re-order ingest want() for better statsBryan Newbold2019-11-151-7/+10
* project -> ingest_request_sourceBryan Newbold2019-11-153-9/+9
* fix release.pmcid typoBryan Newbold2019-11-151-2/+2
* ingest importer fixesBryan Newbold2019-11-151-3/+4
* more ingest importer comments and countsBryan Newbold2019-11-152-2/+29
* crude support for 'sandcrawler' kafka topicsBryan Newbold2019-11-151-2/+3
* ingest file result importerBryan Newbold2019-11-152-2/+135
* add ingest request feature to entity_updates workerBryan Newbold2019-11-151-4/+20
* add ingest request transform (and test)Bryan Newbold2019-11-152-0/+67
* crossref: accurate blank title countsBryan Newbold2019-11-051-0/+1
* crossref: component typeBryan Newbold2019-11-041-1/+3
* crossref: count why skip happenedBryan Newbold2019-11-041-1/+7
* crossref: don't skip on short/null subtitleBryan Newbold2019-11-041-1/+1
* file cleanup tweaks to actually runBryan Newbold2019-10-082-5/+4
* refactor duplicated b32_hex function in importersBryan Newbold2019-10-083-21/+11
* dict wrapper for entity_from_json()Bryan Newbold2019-10-082-3/+7
* new cleanup python tool/frameworkBryan Newbold2019-10-084-0/+241
* review/fix all confluent-kafka produce codeBryan Newbold2019-09-206-27/+75
* small fixes to confluent-kafka importers/workersBryan Newbold2019-09-206-24/+67
* convert pipeline workers from pykafka to confluent-kafkaBryan Newbold2019-09-203-125/+230
* small kafka tweaks for robustnessBryan Newbold2019-09-202-0/+5
* convert importers to confluent-kafka libraryBryan Newbold2019-09-201-19/+71
* bump max message size to ~20 MBytesBryan Newbold2019-09-202-0/+2
* fixes to confluent-kafka harvestersBryan Newbold2019-09-203-20/+21
* first draft harvesters using confluent-kafkaBryan Newbold2019-09-203-48/+104
* handle more external identifiers in pythonBryan Newbold2019-09-181-14/+97
* refactor all python source for client lib nameBryan Newbold2019-09-0521-121/+121
* fix Importer editgroup_extra pass-throughBryan Newbold2019-09-051-2/+1
* comment clarifying container.ident in ES release transformBryan Newbold2019-09-031-0/+2
* file rel: social -> academicsocialBryan Newbold2019-09-031-2/+2
* fix previous fix (need tests)Bryan Newbold2019-09-031-2/+2
* fix typo bug in container ES transformBryan Newbold2019-09-031-2/+2
* last chocula import behavior tweaksBryan Newbold2019-09-031-3/+21
* more careful chocula import counts; don't re-update empty URLsBryan Newbold2019-09-031-2/+6
* better importer 'total' countingBryan Newbold2019-09-031-4/+2
* chocula importer: include DOAJ updatesBryan Newbold2019-09-031-2/+2
* use EZB and szczepanski as OA signals (ES)Bryan Newbold2019-09-031-0/+12
* improvements to chocula importerBryan Newbold2019-09-031-1/+7
* implement ChoculaImporterBryan Newbold2019-09-032-0/+137
* improvements to wayback_static importerBryan Newbold2019-08-221-6/+29
* start new ES container worker kafka groupBryan Newbold2019-07-311-0/+2
* crossref: allow 'name' fallback (for groups, etc)Bryan Newbold2019-06-241-1/+1
* add inflight edit protection to matched importerBryan Newbold2019-06-241-1/+8
* fix typo; do arxiv-specific match import hackBryan Newbold2019-06-241-3/+14
* fix syntax in existing.url cleanupBryan Newbold2019-06-241-1/+1
generated by cgit v1.2.3 (git 2.39.1) at 2024-06-29 22:38:39 +0000