| Commit message (Expand) | Author | Age | Files | Lines |
* | write diagnostic messages to stderr | Martin Czygan | 2019-12-16 | 1 | -2/+2 |
* | Merge branch 'martin-importers-common-doc-fix' into 'master' | Martin Czygan | 2019-12-14 | 1 | -13/+10 |
|\ |
|
| * | complete parse_record docstring | Martin Czygan | 2019-12-14 | 1 | -0/+6 |
| * | Update EntityImporter docstring. | Martin Czygan | 2019-12-13 | 1 | -13/+4 |
* | | add ingest import file collision protection | Bryan Newbold | 2019-12-13 | 1 | -0/+6 |
* | | update ingest request schema | Bryan Newbold | 2019-12-13 | 3 | -8/+30 |
* | | remove default mimetype from ingest-file importer | Bryan Newbold | 2019-12-13 | 1 | -2/+1 |
* | | revert accidentally commited test timing | Bryan Newbold | 2019-12-13 | 1 | -2/+2 |
* | | ensure importer description arg isn't clobbered | Bryan Newbold | 2019-12-12 | 3 | -5/+5 |
* | | tweaks to ingest-file transform | Bryan Newbold | 2019-12-12 | 1 | -13/+7 |
* | | savepapernow result importer | Bryan Newbold | 2019-12-12 | 2 | -4/+65 |
* | | flush importer editgroups every few minutes | Bryan Newbold | 2019-12-12 | 1 | -5/+20 |
* | | EntityImporter: submit (not accept) mode | Bryan Newbold | 2019-12-12 | 1 | -2/+14 |
|/ |
|
* | factor out some basic kafka helpers | Bryan Newbold | 2019-12-10 | 2 | -0/+23 |
* | add another ingest request source to whitelist | Bryan Newbold | 2019-12-10 | 1 | -2/+5 |
* | refactor kafka producer in crossref harvester | Bryan Newbold | 2019-12-06 | 1 | -21/+26 |
* | tweaks to file ingest importer | Bryan Newbold | 2019-12-03 | 1 | -3/+4 |
* | crossref is_update isn't what I thought | Bryan Newbold | 2019-12-03 | 1 | -6/+2 |
* | re-order ingest want() for better stats | Bryan Newbold | 2019-11-15 | 1 | -7/+10 |
* | project -> ingest_request_source | Bryan Newbold | 2019-11-15 | 3 | -9/+9 |
* | fix release.pmcid typo | Bryan Newbold | 2019-11-15 | 1 | -2/+2 |
* | ingest importer fixes | Bryan Newbold | 2019-11-15 | 1 | -3/+4 |
* | more ingest importer comments and counts | Bryan Newbold | 2019-11-15 | 2 | -2/+29 |
* | crude support for 'sandcrawler' kafka topics | Bryan Newbold | 2019-11-15 | 1 | -2/+3 |
* | ingest file result importer | Bryan Newbold | 2019-11-15 | 2 | -2/+135 |
* | add ingest request feature to entity_updates worker | Bryan Newbold | 2019-11-15 | 1 | -4/+20 |
* | add ingest request transform (and test) | Bryan Newbold | 2019-11-15 | 2 | -0/+67 |
* | crossref: accurate blank title counts | Bryan Newbold | 2019-11-05 | 1 | -0/+1 |
* | crossref: component type | Bryan Newbold | 2019-11-04 | 1 | -1/+3 |
* | crossref: count why skip happened | Bryan Newbold | 2019-11-04 | 1 | -1/+7 |
* | crossref: don't skip on short/null subtitle | Bryan Newbold | 2019-11-04 | 1 | -1/+1 |
* | file cleanup tweaks to actually run | Bryan Newbold | 2019-10-08 | 2 | -5/+4 |
* | refactor duplicated b32_hex function in importers | Bryan Newbold | 2019-10-08 | 3 | -21/+11 |
* | dict wrapper for entity_from_json() | Bryan Newbold | 2019-10-08 | 2 | -3/+7 |
* | new cleanup python tool/framework | Bryan Newbold | 2019-10-08 | 4 | -0/+241 |
* | review/fix all confluent-kafka produce code | Bryan Newbold | 2019-09-20 | 6 | -27/+75 |
* | small fixes to confluent-kafka importers/workers | Bryan Newbold | 2019-09-20 | 6 | -24/+67 |
* | convert pipeline workers from pykafka to confluent-kafka | Bryan Newbold | 2019-09-20 | 3 | -125/+230 |
* | small kafka tweaks for robustness | Bryan Newbold | 2019-09-20 | 2 | -0/+5 |
* | convert importers to confluent-kafka library | Bryan Newbold | 2019-09-20 | 1 | -19/+71 |
* | bump max message size to ~20 MBytes | Bryan Newbold | 2019-09-20 | 2 | -0/+2 |
* | fixes to confluent-kafka harvesters | Bryan Newbold | 2019-09-20 | 3 | -20/+21 |
* | first draft harvesters using confluent-kafka | Bryan Newbold | 2019-09-20 | 3 | -48/+104 |
* | handle more external identifiers in python | Bryan Newbold | 2019-09-18 | 1 | -14/+97 |
* | refactor all python source for client lib name | Bryan Newbold | 2019-09-05 | 21 | -121/+121 |
* | fix Importer editgroup_extra pass-through | Bryan Newbold | 2019-09-05 | 1 | -2/+1 |
* | comment clarifying container.ident in ES release transform | Bryan Newbold | 2019-09-03 | 1 | -0/+2 |
* | file rel: social -> academicsocial | Bryan Newbold | 2019-09-03 | 1 | -2/+2 |
* | fix previous fix (need tests) | Bryan Newbold | 2019-09-03 | 1 | -2/+2 |
* | fix typo bug in container ES transform | Bryan Newbold | 2019-09-03 | 1 | -2/+2 |