summaryrefslogtreecommitdiffstats
path: root/python/fatcat_tools
Commit message (Expand)AuthorAgeFilesLines
* allow arabesque backfill ingests for some source typesBryan Newbold2019-12-241-0/+5
* make chocula URL updates more conservativeBryan Newbold2019-12-241-5/+5
* pubmed: if doing update, also do subtitle schema updateBryan Newbold2019-12-231-1/+9
* doi parsing fixesBryan Newbold2019-12-231-0/+7
* pubmed: improve warning and stderr formattingBryan Newbold2019-12-231-5/+6
* pubmed: use standard identifier cleanersBryan Newbold2019-12-231-17/+14
* pubmed: remove unused extid mapping codeBryan Newbold2019-12-231-29/+0
* pubmed: do reference lookups by defaultBryan Newbold2019-12-231-1/+1
* normalizers: clean_pmid(), and handle nulls in all other cleanersBryan Newbold2019-12-231-0/+31
* pubmed: null doi parsing checkBryan Newbold2019-12-231-1/+1
* add basic MedlineDate year parsingBryan Newbold2019-12-231-0/+11
* fix spn/ingest importer duplication checkBryan Newbold2019-12-221-6/+8
* write diagnostic messages to stderrMartin Czygan2019-12-161-2/+2
* Merge branch 'martin-importers-common-doc-fix' into 'master'Martin Czygan2019-12-141-13/+10
|\
| * complete parse_record docstringMartin Czygan2019-12-141-0/+6
| * Update EntityImporter docstring.Martin Czygan2019-12-131-13/+4
* | add ingest import file collision protectionBryan Newbold2019-12-131-0/+6
* | update ingest request schemaBryan Newbold2019-12-133-8/+30
* | remove default mimetype from ingest-file importerBryan Newbold2019-12-131-2/+1
* | revert accidentally commited test timingBryan Newbold2019-12-131-2/+2
* | ensure importer description arg isn't clobberedBryan Newbold2019-12-123-5/+5
* | tweaks to ingest-file transformBryan Newbold2019-12-121-13/+7
* | savepapernow result importerBryan Newbold2019-12-122-4/+65
* | flush importer editgroups every few minutesBryan Newbold2019-12-121-5/+20
* | EntityImporter: submit (not accept) modeBryan Newbold2019-12-121-2/+14
|/
* factor out some basic kafka helpersBryan Newbold2019-12-102-0/+23
* add another ingest request source to whitelistBryan Newbold2019-12-101-2/+5
* refactor kafka producer in crossref harvesterBryan Newbold2019-12-061-21/+26
* tweaks to file ingest importerBryan Newbold2019-12-031-3/+4
* crossref is_update isn't what I thoughtBryan Newbold2019-12-031-6/+2
* re-order ingest want() for better statsBryan Newbold2019-11-151-7/+10
* project -> ingest_request_sourceBryan Newbold2019-11-153-9/+9
* fix release.pmcid typoBryan Newbold2019-11-151-2/+2
* ingest importer fixesBryan Newbold2019-11-151-3/+4
* more ingest importer comments and countsBryan Newbold2019-11-152-2/+29
* crude support for 'sandcrawler' kafka topicsBryan Newbold2019-11-151-2/+3
* ingest file result importerBryan Newbold2019-11-152-2/+135
* add ingest request feature to entity_updates workerBryan Newbold2019-11-151-4/+20
* add ingest request transform (and test)Bryan Newbold2019-11-152-0/+67
* crossref: accurate blank title countsBryan Newbold2019-11-051-0/+1
* crossref: component typeBryan Newbold2019-11-041-1/+3
* crossref: count why skip happenedBryan Newbold2019-11-041-1/+7
* crossref: don't skip on short/null subtitleBryan Newbold2019-11-041-1/+1
* file cleanup tweaks to actually runBryan Newbold2019-10-082-5/+4
* refactor duplicated b32_hex function in importersBryan Newbold2019-10-083-21/+11
* dict wrapper for entity_from_json()Bryan Newbold2019-10-082-3/+7
* new cleanup python tool/frameworkBryan Newbold2019-10-084-0/+241
* review/fix all confluent-kafka produce codeBryan Newbold2019-09-206-27/+75
* small fixes to confluent-kafka importers/workersBryan Newbold2019-09-206-24/+67
* convert pipeline workers from pykafka to confluent-kafkaBryan Newbold2019-09-203-125/+230
generated by cgit v1.2.3 (git 2.39.1) at 2024-11-23 21:36:55 +0000