summaryrefslogtreecommitdiffstats
path: root/python/fatcat_tools/importers
Commit message (Expand)AuthorAgeFilesLines
* project -> ingest_request_sourceBryan Newbold2019-11-151-6/+6
* ingest importer fixesBryan Newbold2019-11-151-3/+4
* more ingest importer comments and countsBryan Newbold2019-11-151-1/+28
* crude support for 'sandcrawler' kafka topicsBryan Newbold2019-11-151-2/+3
* ingest file result importerBryan Newbold2019-11-152-2/+135
* crossref: accurate blank title countsBryan Newbold2019-11-051-0/+1
* crossref: component typeBryan Newbold2019-11-041-1/+3
* crossref: count why skip happenedBryan Newbold2019-11-041-1/+7
* crossref: don't skip on short/null subtitleBryan Newbold2019-11-041-1/+1
* refactor duplicated b32_hex function in importersBryan Newbold2019-10-083-21/+11
* review/fix all confluent-kafka produce codeBryan Newbold2019-09-201-1/+0
* small fixes to confluent-kafka importers/workersBryan Newbold2019-09-201-10/+24
* small kafka tweaks for robustnessBryan Newbold2019-09-201-0/+3
* convert importers to confluent-kafka libraryBryan Newbold2019-09-201-19/+71
* refactor all python source for client lib nameBryan Newbold2019-09-0514-106/+106
* fix Importer editgroup_extra pass-throughBryan Newbold2019-09-051-2/+1
* file rel: social -> academicsocialBryan Newbold2019-09-031-2/+2
* last chocula import behavior tweaksBryan Newbold2019-09-031-3/+21
* more careful chocula import counts; don't re-update empty URLsBryan Newbold2019-09-031-2/+6
* better importer 'total' countingBryan Newbold2019-09-031-4/+2
* chocula importer: include DOAJ updatesBryan Newbold2019-09-031-2/+2
* improvements to chocula importerBryan Newbold2019-09-031-1/+7
* implement ChoculaImporterBryan Newbold2019-09-032-0/+137
* improvements to wayback_static importerBryan Newbold2019-08-221-6/+29
* crossref: allow 'name' fallback (for groups, etc)Bryan Newbold2019-06-241-1/+1
* add inflight edit protection to matched importerBryan Newbold2019-06-241-1/+8
* fix typo; do arxiv-specific match import hackBryan Newbold2019-06-241-3/+14
* fix syntax in existing.url cleanupBryan Newbold2019-06-241-1/+1
* fix existing updaterBryan Newbold2019-06-241-2/+3
* add minimal file URL cleanups to matched importerBryan Newbold2019-06-241-0/+8
* matched importer: urls, not urlBryan Newbold2019-06-241-1/+1
* support extids in matched importerBryan Newbold2019-06-201-3/+26
* more pubmed importer fixesBryan Newbold2019-06-031-6/+13
* JALC: handle empty publisher stringBryan Newbold2019-05-301-3/+4
* journal_metadata import: allow KBART updatesBryan Newbold2019-05-301-5/+16
* make importer extid lookups faster by hidingBryan Newbold2019-05-291-2/+2
* yet another pubmed weird DOI corner caseBryan Newbold2019-05-291-1/+1
* handle pubmed CollectiveName null-nessBryan Newbold2019-05-291-1/+1
* remove stray JALC debug codeBryan Newbold2019-05-291-2/+3
* is_cjk() handles kanji betterBryan Newbold2019-05-291-4/+6
* improve JALC author handlingBryan Newbold2019-05-291-59/+85
* handle empty retraction_of.PMID in pubmed importerBryan Newbold2019-05-291-2/+4
* faster LargeFile XML importer for PubMedBryan Newbold2019-05-292-1/+51
* more MARC languages, and less verbose reportingBryan Newbold2019-05-242-4/+15
* better crossref container_name handlingBryan Newbold2019-05-241-7/+12
* set superceded flag on 'old' arxiv releasesBryan Newbold2019-05-231-1/+4
* pubmed DOIs need strip()Bryan Newbold2019-05-221-1/+1
* pubmed: try to work around multi-editsBryan Newbold2019-05-221-3/+13
* more strict pubmed DOI handlingBryan Newbold2019-05-221-1/+3
* more pubmed checks; handle PMID/DOI mismatch differentlyBryan Newbold2019-05-221-2/+7