aboutsummaryrefslogtreecommitdiffstats
Commit message (Expand)AuthorAgeFilesLines
* add GWB-to-S3 delivery pipeline scriptBryan Newbold2019-02-192-0/+162
* give sort way more RAM by defaultBryan Newbold2019-02-013-6/+6
* update (internal) journal-infra linkBryan Newbold2019-01-031-1/+1
* match_filter_enrich notesBryan Newbold2019-01-031-0/+12
* remove old/redundant python CDX directoryBryan Newbold2019-01-033-103/+0
* use ipv4 localhost with kafkacatBryan Newbold2018-12-191-1/+1
* notes on file-level metadata dumpBryan Newbold2018-12-191-0/+31
* longer match-crossref timeoutBryan Newbold2018-12-181-2/+3
* update notesBryan Newbold2018-12-103-1/+59
* crank hbase GROBID worker memory usage downBryan Newbold2018-12-101-1/+1
* increase message size (kafka-grobid-hbase)Bryan Newbold2018-12-101-0/+2
* add python-snappy depBryan Newbold2018-12-102-84/+96
* ah, right, it's more like extract/3sec, not 30secBryan Newbold2018-12-031-4/+4
* tweak grobid worker producer settingsBryan Newbold2018-12-031-2/+2
* tweak kafka config significantlyBryan Newbold2018-12-032-3/+18
* more sentry tags when extractingBryan Newbold2018-12-031-1/+6
* improvements to Kafka GROBID worker loggingBryan Newbold2018-12-032-11/+22
* work around kafka topic/group mistakesBryan Newbold2018-12-011-1/+1
* fix error var typoBryan Newbold2018-11-271-1/+1
* catch more wayback error typesBryan Newbold2018-11-261-1/+11
* only pylint fail on errorsBryan Newbold2018-11-251-1/+1
* fix ungrobid extraction testsBryan Newbold2018-11-221-2/+4
* more kafka/grobid notesBryan Newbold2018-11-211-0/+12
* better default consumergroup nameBryan Newbold2018-11-211-1/+1
* many improvements to kafka HBase inserterBryan Newbold2018-11-211-29/+29
* cherry-pick: correct HBase column filteringBryan Newbold2018-11-211-1/+1
* fixes to hbase workerBryan Newbold2018-11-211-1/+13
* fix kafka grobid command line topic parsingBryan Newbold2018-11-212-3/+9
* kafka_grobid_hbase (not 'ed')Bryan Newbold2018-11-211-0/+0
* kafka_grobid fixes and hbase WIPBryan Newbold2018-11-212-2/+179
* small kafka_grobid tweaksBryan Newbold2018-11-211-1/+2
* updated Pipfile.lock (VERY SLOW)Bryan Newbold2018-11-211-548/+431
* kafka_grobid tweaks for deployment; delay insert decisionBryan Newbold2018-11-211-21/+9
* rename grobided to grobid-outputBryan Newbold2018-11-212-3/+7
* initial work on kafka_grobid workerBryan Newbold2018-11-203-0/+314
* kafka notesBryan Newbold2018-11-202-0/+110
* fix typos in DumpGrobidXmlJobBryan Newbold2018-10-301-2/+2
* one more lint ignoreBryan Newbold2018-10-301-1/+1
* squelch some more lint warningsBryan Newbold2018-10-301-1/+1
* several bugs and lint issues in import_grobid_metadataBryan Newbold2018-10-301-9/+10
* please support DumpGrobidXmlJobBryan Newbold2018-10-301-0/+24
* quick and dirty GROBID XML dumperBryan Newbold2018-10-301-0/+41
* some progress on a crude grobid metadata filterBryan Newbold2018-09-262-7/+151
* longtail grobid metadata parse/filter WIPBryan Newbold2018-09-223-0/+114
* please support for DumpGrobidMetaInsertableJobBryan Newbold2018-09-221-0/+24
* new DumpGrobidMetaInsertableJobBryan Newbold2018-09-221-0/+38
* match_filter_enrich: fix typoBryan Newbold2018-09-221-1/+1
* fix sha1/doi_list confusion in filter_scored_matchesBryan Newbold2018-09-221-2/+2
* pylint can be insufferableBryan Newbold2018-09-201-1/+1
* gitignore in python dirBryan Newbold2018-09-181-0/+3