aboutsummaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
* tweak grobid worker producer settingsBryan Newbold2018-12-031-2/+2
| | | | | Python CPU utilization shot way up; this is an attempt to bring it back down.
* tweak kafka config significantlyBryan Newbold2018-12-032-3/+18
|
* more sentry tags when extractingBryan Newbold2018-12-031-1/+6
|
* improvements to Kafka GROBID worker loggingBryan Newbold2018-12-032-11/+22
|
* work around kafka topic/group mistakesBryan Newbold2018-12-011-1/+1
|
* fix error var typoBryan Newbold2018-11-271-1/+1
|
* catch more wayback error typesBryan Newbold2018-11-261-1/+11
|
* only pylint fail on errorsBryan Newbold2018-11-251-1/+1
|
* fix ungrobid extraction testsBryan Newbold2018-11-221-2/+4
|
* more kafka/grobid notesBryan Newbold2018-11-211-0/+12
|
* better default consumergroup nameBryan Newbold2018-11-211-1/+1
|
* many improvements to kafka HBase inserterBryan Newbold2018-11-211-29/+29
|
* cherry-pick: correct HBase column filteringBryan Newbold2018-11-211-1/+1
|
* fixes to hbase workerBryan Newbold2018-11-211-1/+13
|
* fix kafka grobid command line topic parsingBryan Newbold2018-11-212-3/+9
|
* kafka_grobid_hbase (not 'ed')Bryan Newbold2018-11-211-0/+0
|
* kafka_grobid fixes and hbase WIPBryan Newbold2018-11-212-2/+179
|
* small kafka_grobid tweaksBryan Newbold2018-11-211-1/+2
|
* updated Pipfile.lock (VERY SLOW)Bryan Newbold2018-11-211-548/+431
|
* kafka_grobid tweaks for deployment; delay insert decisionBryan Newbold2018-11-211-21/+9
|
* rename grobided to grobid-outputBryan Newbold2018-11-212-3/+7
|
* initial work on kafka_grobid workerBryan Newbold2018-11-203-0/+314
|
* kafka notesBryan Newbold2018-11-202-0/+110
|
* fix typos in DumpGrobidXmlJobBryan Newbold2018-10-301-2/+2
|
* one more lint ignoreBryan Newbold2018-10-301-1/+1
|
* squelch some more lint warningsBryan Newbold2018-10-301-1/+1
|
* several bugs and lint issues in import_grobid_metadataBryan Newbold2018-10-301-9/+10
|
* please support DumpGrobidXmlJobBryan Newbold2018-10-301-0/+24
|
* quick and dirty GROBID XML dumperBryan Newbold2018-10-301-0/+41
|
* some progress on a crude grobid metadata filterBryan Newbold2018-09-262-7/+151
|
* longtail grobid metadata parse/filter WIPBryan Newbold2018-09-223-0/+114
|
* please support for DumpGrobidMetaInsertableJobBryan Newbold2018-09-221-0/+24
|
* new DumpGrobidMetaInsertableJobBryan Newbold2018-09-221-0/+38
|
* match_filter_enrich: fix typoBryan Newbold2018-09-221-1/+1
|
* fix sha1/doi_list confusion in filter_scored_matchesBryan Newbold2018-09-221-2/+2
|
* pylint can be insufferableBryan Newbold2018-09-201-1/+1
|
* gitignore in python dirBryan Newbold2018-09-181-0/+3
|
* pass more pylintBryan Newbold2018-09-183-24/+23
|
* fix typo in python/READMEBryan Newbold2018-09-171-1/+1
|
* more robust extraction code (against petabox failures)Bryan Newbold2018-09-172-2/+20
|
* filter_scored_matches: fix testsBryan Newbold2018-09-171-2/+7
|
* match and enrich notes+scriptBryan Newbold2018-09-142-0/+64
|
* add manifest sqlite3 -> JSON converterBryan Newbold2018-09-141-0/+58
|
* filter_scored_matches.pyBryan Newbold2018-09-131-0/+110
|
* dumpfilemeta support in pleaseBryan Newbold2018-09-131-0/+24
|
* new simple file metadata dump scriptBryan Newbold2018-09-131-0/+36
|
* TODO updatesBryan Newbold2018-09-121-0/+11
|
* insertable flag for match-crossrefBryan Newbold2018-09-121-1/+9
|
* hack scorejob variant with extra context joined inBryan Newbold2018-09-122-0/+348
| | | | This is to allow pushes to fatcat. There is probably a better way...
* blacklist -> denylistBryan Newbold2018-09-055-12/+12
|