Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | improvements to chocula importer | Bryan Newbold | 2019-09-03 | 1 | -1/+7 |
| | |||||
* | implement ChoculaImporter | Bryan Newbold | 2019-09-03 | 2 | -0/+137 |
| | |||||
* | improvements to wayback_static importer | Bryan Newbold | 2019-08-22 | 1 | -6/+29 |
| | |||||
* | start new ES container worker kafka group | Bryan Newbold | 2019-07-31 | 1 | -0/+2 |
| | | | | | | | | The previous group seems to have gotten corrupted; my hypothesis is that this is due to pykafka being somewhat flakey, and am planning to move to librdkafka anyways. Re-indexing all the containers is pretty small/easy, so starting a new consumer group works find in this case; release indexer would be a bigger problem. | ||||
* | crossref: allow 'name' fallback (for groups, etc) | Bryan Newbold | 2019-06-24 | 1 | -1/+1 |
| | |||||
* | add inflight edit protection to matched importer | Bryan Newbold | 2019-06-24 | 1 | -1/+8 |
| | |||||
* | fix typo; do arxiv-specific match import hack | Bryan Newbold | 2019-06-24 | 1 | -3/+14 |
| | |||||
* | fix syntax in existing.url cleanup | Bryan Newbold | 2019-06-24 | 1 | -1/+1 |
| | |||||
* | fix existing updater | Bryan Newbold | 2019-06-24 | 1 | -2/+3 |
| | |||||
* | add minimal file URL cleanups to matched importer | Bryan Newbold | 2019-06-24 | 1 | -0/+8 |
| | |||||
* | matched importer: urls, not url | Bryan Newbold | 2019-06-24 | 1 | -1/+1 |
| | | | | | | This matches the docs in the header. Previous matched imports were using 'cdx' objects with no 'dt' key, but this makes more sense. As far as I know the old 'url' code path was never actually used (or tested, derp). | ||||
* | fix typo in typo | Bryan Newbold | 2019-06-24 | 1 | -1/+1 |
| | |||||
* | fix typo in changelog worker | Bryan Newbold | 2019-06-24 | 1 | -1/+1 |
| | |||||
* | support extids in matched importer | Bryan Newbold | 2019-06-20 | 1 | -3/+26 |
| | |||||
* | more links on new homepage | Bryan Newbold | 2019-06-19 | 2 | -2/+2 |
| | | | | | matching produce sizes. may want to tweak this config in the future for throughput. | ||||
* | start work on 'generic' search box | Bryan Newbold | 2019-06-13 | 1 | -0/+95 |
| | |||||
* | more pubmed importer fixes | Bryan Newbold | 2019-06-03 | 1 | -6/+13 |
| | |||||
* | JALC: handle empty publisher string | Bryan Newbold | 2019-05-30 | 1 | -3/+4 |
| | |||||
* | journal_metadata import: allow KBART updates | Bryan Newbold | 2019-05-30 | 1 | -5/+16 |
| | |||||
* | fix and workaround container entities in release topic | Bryan Newbold | 2019-05-30 | 2 | -2/+8 |
| | |||||
* | fix syntax bugs (container elastic worker) | Bryan Newbold | 2019-05-30 | 1 | -5/+5 |
| | |||||
* | add container update elastic worker | Bryan Newbold | 2019-05-30 | 2 | -6/+26 |
| | |||||
* | file and container update kafka topics | Bryan Newbold | 2019-05-30 | 1 | -54/+69 |
| | |||||
* | update elastic for releases when files added | Bryan Newbold | 2019-05-30 | 1 | -1/+36 |
| | | | | A bunch of remaining TODOs here | ||||
* | make importer extid lookups faster by hiding | Bryan Newbold | 2019-05-29 | 1 | -2/+2 |
| | |||||
* | yet another pubmed weird DOI corner case | Bryan Newbold | 2019-05-29 | 1 | -1/+1 |
| | |||||
* | handle pubmed CollectiveName null-ness | Bryan Newbold | 2019-05-29 | 1 | -1/+1 |
| | |||||
* | remove stray JALC debug code | Bryan Newbold | 2019-05-29 | 1 | -2/+3 |
| | |||||
* | is_cjk() handles kanji better | Bryan Newbold | 2019-05-29 | 1 | -4/+6 |
| | |||||
* | improve JALC author handling | Bryan Newbold | 2019-05-29 | 1 | -59/+85 |
| | |||||
* | handle empty retraction_of.PMID in pubmed importer | Bryan Newbold | 2019-05-29 | 1 | -2/+4 |
| | |||||
* | faster LargeFile XML importer for PubMed | Bryan Newbold | 2019-05-29 | 2 | -1/+51 |
| | |||||
* | elasticsearch transform: fix url.url bug | Bryan Newbold | 2019-05-24 | 1 | -11/+11 |
| | |||||
* | more MARC languages, and less verbose reporting | Bryan Newbold | 2019-05-24 | 2 | -4/+15 |
| | |||||
* | better crossref container_name handling | Bryan Newbold | 2019-05-24 | 1 | -7/+12 |
| | |||||
* | set superceded flag on 'old' arxiv releases | Bryan Newbold | 2019-05-23 | 1 | -1/+4 |
| | |||||
* | add 'superceded' release extra flag to elastic schema | Bryan Newbold | 2019-05-23 | 1 | -0/+1 |
| | |||||
* | pubmed DOIs need strip() | Bryan Newbold | 2019-05-22 | 1 | -1/+1 |
| | |||||
* | pubmed: try to work around multi-edits | Bryan Newbold | 2019-05-22 | 1 | -3/+13 |
| | |||||
* | more strict pubmed DOI handling | Bryan Newbold | 2019-05-22 | 1 | -1/+3 |
| | |||||
* | more pubmed checks; handle PMID/DOI mismatch differently | Bryan Newbold | 2019-05-22 | 1 | -2/+7 |
| | |||||
* | missing MARC/ISO languages | Bryan Newbold | 2019-05-22 | 1 | -0/+2 |
| | |||||
* | arxiv: yet more bad DOI mangling | Bryan Newbold | 2019-05-22 | 1 | -1/+1 |
| | |||||
* | also track work_id in release elasticsearch table | Bryan Newbold | 2019-05-22 | 1 | -0/+1 |
| | |||||
* | count linked refs (not just raw refs) in elasticsearch | Bryan Newbold | 2019-05-22 | 1 | -0/+3 |
| | |||||
* | arxiv: handle multi-DOI | Bryan Newbold | 2019-05-22 | 1 | -1/+1 |
| | |||||
* | arxiv: another type of latex2text error | Bryan Newbold | 2019-05-22 | 1 | -0/+2 |
| | |||||
* | arixv: filter out empty names | Bryan Newbold | 2019-05-22 | 1 | -0/+1 |
| | |||||
* | all new importers need to set contrib index (order) | Bryan Newbold | 2019-05-22 | 4 | -2/+14 |
| | |||||
* | improve arxiv author name parsing | Bryan Newbold | 2019-05-22 | 1 | -0/+24 |
| |