| Commit message (Collapse) | Author | Age | Files | Lines | ||
|---|---|---|---|---|---|---|
| ... | ||||||
| * | more ingest importer comments and counts | Bryan Newbold | 2019-11-15 | 1 | -1/+28 | |
| | | ||||||
| * | crude support for 'sandcrawler' kafka topics | Bryan Newbold | 2019-11-15 | 1 | -2/+3 | |
| | | ||||||
| * | ingest file result importer | Bryan Newbold | 2019-11-15 | 2 | -2/+135 | |
| | | ||||||
| * | crossref: accurate blank title counts | Bryan Newbold | 2019-11-05 | 1 | -0/+1 | |
| | | ||||||
| * | crossref: component type | Bryan Newbold | 2019-11-04 | 1 | -1/+3 | |
| | | ||||||
| * | crossref: count why skip happened | Bryan Newbold | 2019-11-04 | 1 | -1/+7 | |
| | | | | | | | Might skip based on release type (eg container, not a paper/release), or missing title, or other reasons. Over 7 million DOIs are getting skipped, curious why. | |||||
| * | crossref: don't skip on short/null subtitle | Bryan Newbold | 2019-11-04 | 1 | -1/+1 | |
| | | | | | This was a bug. Should only set subtitle black, not skip the import. | |||||
| * | refactor duplicated b32_hex function in importers | Bryan Newbold | 2019-10-08 | 3 | -21/+11 | |
| | | ||||||
| * | review/fix all confluent-kafka produce code | Bryan Newbold | 2019-09-20 | 1 | -1/+0 | |
| | | ||||||
| * | small fixes to confluent-kafka importers/workers | Bryan Newbold | 2019-09-20 | 1 | -10/+24 | |
| | | | | | | | | | - decrease default changelog pipeline to 5.0sec - fix missing KafkaException harvester imports - more confluent-kafka tweaks - updates to kafka consumer configs - bump elastic updates consumergroup (again) | |||||
| * | small kafka tweaks for robustness | Bryan Newbold | 2019-09-20 | 1 | -0/+3 | |
| | | ||||||
| * | convert importers to confluent-kafka library | Bryan Newbold | 2019-09-20 | 1 | -19/+71 | |
| | | ||||||
| * | refactor all python source for client lib name | Bryan Newbold | 2019-09-05 | 14 | -106/+106 | |
| | | ||||||
| * | fix Importer editgroup_extra pass-through | Bryan Newbold | 2019-09-05 | 1 | -2/+1 | |
| | | ||||||
| * | file rel: social -> academicsocial | Bryan Newbold | 2019-09-03 | 1 | -2/+2 | |
| | | ||||||
| * | last chocula import behavior tweaks | Bryan Newbold | 2019-09-03 | 1 | -3/+21 | |
| | | ||||||
| * | more careful chocula import counts; don't re-update empty URLs | Bryan Newbold | 2019-09-03 | 1 | -2/+6 | |
| | | ||||||
| * | better importer 'total' counting | Bryan Newbold | 2019-09-03 | 1 | -4/+2 | |
| | | ||||||
| * | chocula importer: include DOAJ updates | Bryan Newbold | 2019-09-03 | 1 | -2/+2 | |
| | | ||||||
| * | improvements to chocula importer | Bryan Newbold | 2019-09-03 | 1 | -1/+7 | |
| | | ||||||
| * | implement ChoculaImporter | Bryan Newbold | 2019-09-03 | 2 | -0/+137 | |
| | | ||||||
| * | improvements to wayback_static importer | Bryan Newbold | 2019-08-22 | 1 | -6/+29 | |
| | | ||||||
| * | crossref: allow 'name' fallback (for groups, etc) | Bryan Newbold | 2019-06-24 | 1 | -1/+1 | |
| | | ||||||
| * | add inflight edit protection to matched importer | Bryan Newbold | 2019-06-24 | 1 | -1/+8 | |
| | | ||||||
| * | fix typo; do arxiv-specific match import hack | Bryan Newbold | 2019-06-24 | 1 | -3/+14 | |
| | | ||||||
| * | fix syntax in existing.url cleanup | Bryan Newbold | 2019-06-24 | 1 | -1/+1 | |
| | | ||||||
| * | fix existing updater | Bryan Newbold | 2019-06-24 | 1 | -2/+3 | |
| | | ||||||
| * | add minimal file URL cleanups to matched importer | Bryan Newbold | 2019-06-24 | 1 | -0/+8 | |
| | | ||||||
| * | matched importer: urls, not url | Bryan Newbold | 2019-06-24 | 1 | -1/+1 | |
| | | | | | | | This matches the docs in the header. Previous matched imports were using 'cdx' objects with no 'dt' key, but this makes more sense. As far as I know the old 'url' code path was never actually used (or tested, derp). | |||||
| * | support extids in matched importer | Bryan Newbold | 2019-06-20 | 1 | -3/+26 | |
| | | ||||||
| * | more pubmed importer fixes | Bryan Newbold | 2019-06-03 | 1 | -6/+13 | |
| | | ||||||
| * | JALC: handle empty publisher string | Bryan Newbold | 2019-05-30 | 1 | -3/+4 | |
| | | ||||||
| * | journal_metadata import: allow KBART updates | Bryan Newbold | 2019-05-30 | 1 | -5/+16 | |
| | | ||||||
| * | make importer extid lookups faster by hiding | Bryan Newbold | 2019-05-29 | 1 | -2/+2 | |
| | | ||||||
| * | yet another pubmed weird DOI corner case | Bryan Newbold | 2019-05-29 | 1 | -1/+1 | |
| | | ||||||
| * | handle pubmed CollectiveName null-ness | Bryan Newbold | 2019-05-29 | 1 | -1/+1 | |
| | | ||||||
| * | remove stray JALC debug code | Bryan Newbold | 2019-05-29 | 1 | -2/+3 | |
| | | ||||||
| * | is_cjk() handles kanji better | Bryan Newbold | 2019-05-29 | 1 | -4/+6 | |
| | | ||||||
| * | improve JALC author handling | Bryan Newbold | 2019-05-29 | 1 | -59/+85 | |
| | | ||||||
| * | handle empty retraction_of.PMID in pubmed importer | Bryan Newbold | 2019-05-29 | 1 | -2/+4 | |
| | | ||||||
| * | faster LargeFile XML importer for PubMed | Bryan Newbold | 2019-05-29 | 2 | -1/+51 | |
| | | ||||||
| * | more MARC languages, and less verbose reporting | Bryan Newbold | 2019-05-24 | 2 | -4/+15 | |
| | | ||||||
| * | better crossref container_name handling | Bryan Newbold | 2019-05-24 | 1 | -7/+12 | |
| | | ||||||
| * | set superceded flag on 'old' arxiv releases | Bryan Newbold | 2019-05-23 | 1 | -1/+4 | |
| | | ||||||
| * | pubmed DOIs need strip() | Bryan Newbold | 2019-05-22 | 1 | -1/+1 | |
| | | ||||||
| * | pubmed: try to work around multi-edits | Bryan Newbold | 2019-05-22 | 1 | -3/+13 | |
| | | ||||||
| * | more strict pubmed DOI handling | Bryan Newbold | 2019-05-22 | 1 | -1/+3 | |
| | | ||||||
| * | more pubmed checks; handle PMID/DOI mismatch differently | Bryan Newbold | 2019-05-22 | 1 | -2/+7 | |
| | | ||||||
| * | missing MARC/ISO languages | Bryan Newbold | 2019-05-22 | 1 | -0/+2 | |
| | | ||||||
| * | arxiv: yet more bad DOI mangling | Bryan Newbold | 2019-05-22 | 1 | -1/+1 | |
| | | ||||||
 |
index : fatcat | |
| [no description] |
| aboutsummaryrefslogtreecommitdiffstats |