summaryrefslogtreecommitdiffstats
path: root/python/fatcat_tools
Commit message (Collapse)AuthorAgeFilesLines
* more careful chocula import counts; don't re-update empty URLsBryan Newbold2019-09-031-2/+6
|
* better importer 'total' countingBryan Newbold2019-09-031-4/+2
|
* chocula importer: include DOAJ updatesBryan Newbold2019-09-031-2/+2
|
* use EZB and szczepanski as OA signals (ES)Bryan Newbold2019-09-031-0/+12
|
* improvements to chocula importerBryan Newbold2019-09-031-1/+7
|
* implement ChoculaImporterBryan Newbold2019-09-032-0/+137
|
* improvements to wayback_static importerBryan Newbold2019-08-221-6/+29
|
* start new ES container worker kafka groupBryan Newbold2019-07-311-0/+2
| | | | | | | | The previous group seems to have gotten corrupted; my hypothesis is that this is due to pykafka being somewhat flakey, and am planning to move to librdkafka anyways. Re-indexing all the containers is pretty small/easy, so starting a new consumer group works find in this case; release indexer would be a bigger problem.
* crossref: allow 'name' fallback (for groups, etc)Bryan Newbold2019-06-241-1/+1
|
* add inflight edit protection to matched importerBryan Newbold2019-06-241-1/+8
|
* fix typo; do arxiv-specific match import hackBryan Newbold2019-06-241-3/+14
|
* fix syntax in existing.url cleanupBryan Newbold2019-06-241-1/+1
|
* fix existing updaterBryan Newbold2019-06-241-2/+3
|
* add minimal file URL cleanups to matched importerBryan Newbold2019-06-241-0/+8
|
* matched importer: urls, not urlBryan Newbold2019-06-241-1/+1
| | | | | | This matches the docs in the header. Previous matched imports were using 'cdx' objects with no 'dt' key, but this makes more sense. As far as I know the old 'url' code path was never actually used (or tested, derp).
* fix typo in typoBryan Newbold2019-06-241-1/+1
|
* fix typo in changelog workerBryan Newbold2019-06-241-1/+1
|
* support extids in matched importerBryan Newbold2019-06-201-3/+26
|
* more links on new homepageBryan Newbold2019-06-192-2/+2
| | | | | matching produce sizes. may want to tweak this config in the future for throughput.
* start work on 'generic' search boxBryan Newbold2019-06-131-0/+95
|
* more pubmed importer fixesBryan Newbold2019-06-031-6/+13
|
* JALC: handle empty publisher stringBryan Newbold2019-05-301-3/+4
|
* journal_metadata import: allow KBART updatesBryan Newbold2019-05-301-5/+16
|
* fix and workaround container entities in release topicBryan Newbold2019-05-302-2/+8
|
* fix syntax bugs (container elastic worker)Bryan Newbold2019-05-301-5/+5
|
* add container update elastic workerBryan Newbold2019-05-302-6/+26
|
* file and container update kafka topicsBryan Newbold2019-05-301-54/+69
|
* update elastic for releases when files addedBryan Newbold2019-05-301-1/+36
| | | | A bunch of remaining TODOs here
* make importer extid lookups faster by hidingBryan Newbold2019-05-291-2/+2
|
* yet another pubmed weird DOI corner caseBryan Newbold2019-05-291-1/+1
|
* handle pubmed CollectiveName null-nessBryan Newbold2019-05-291-1/+1
|
* remove stray JALC debug codeBryan Newbold2019-05-291-2/+3
|
* is_cjk() handles kanji betterBryan Newbold2019-05-291-4/+6
|
* improve JALC author handlingBryan Newbold2019-05-291-59/+85
|
* handle empty retraction_of.PMID in pubmed importerBryan Newbold2019-05-291-2/+4
|
* faster LargeFile XML importer for PubMedBryan Newbold2019-05-292-1/+51
|
* elasticsearch transform: fix url.url bugBryan Newbold2019-05-241-11/+11
|
* more MARC languages, and less verbose reportingBryan Newbold2019-05-242-4/+15
|
* better crossref container_name handlingBryan Newbold2019-05-241-7/+12
|
* set superceded flag on 'old' arxiv releasesBryan Newbold2019-05-231-1/+4
|
* add 'superceded' release extra flag to elastic schemaBryan Newbold2019-05-231-0/+1
|
* pubmed DOIs need strip()Bryan Newbold2019-05-221-1/+1
|
* pubmed: try to work around multi-editsBryan Newbold2019-05-221-3/+13
|
* more strict pubmed DOI handlingBryan Newbold2019-05-221-1/+3
|
* more pubmed checks; handle PMID/DOI mismatch differentlyBryan Newbold2019-05-221-2/+7
|
* missing MARC/ISO languagesBryan Newbold2019-05-221-0/+2
|
* arxiv: yet more bad DOI manglingBryan Newbold2019-05-221-1/+1
|
* also track work_id in release elasticsearch tableBryan Newbold2019-05-221-0/+1
|
* count linked refs (not just raw refs) in elasticsearchBryan Newbold2019-05-221-0/+3
|
* arxiv: handle multi-DOIBryan Newbold2019-05-221-1/+1
|
generated by cgit v1.2.3 (git 2.39.1) at 2024-11-27 15:07:11 +0000