aboutsummaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
* insertable flag for match-crossrefBryan Newbold2018-09-121-1/+9
|
* hack scorejob variant with extra context joined inBryan Newbold2018-09-122-0/+348
| | | | This is to allow pushes to fatcat. There is probably a better way...
* blacklist -> denylistBryan Newbold2018-09-055-12/+12
|
* Merge branch 'ellen-none-refactor' into 'master'bnewbold2018-09-0511-154/+179
|\ | | | | | | | | Ellen none refactor See merge request webgroup/sandcrawler!23
| * Merge branch 'ellen-none-refactor' of git.archive.org:webgroup/sandcrawler ↵Ellen Spertus2018-09-040-0/+0
| |\ | | | | | | | | | into ellen-none-refactor
| | * changed style of ScoreJobTest.bundleEllen Spertus2018-09-041-14/+10
| | |
| | * minor style improvementEllen Spertus2018-09-041-2/+2
| | |
| | * restored code I inadvertantly removed when mergingEllen Spertus2018-08-281-1/+4
| | |
| | * fixed scalastyle issues, including cyclomatic complexityEllen Spertus2018-08-282-48/+62
| | |
| | * fixed tests after replacing NoSlug with NoneEllen Spertus2018-08-284-77/+85
| | |
| | * replaced NoSlug with proper use of OptionEllen Spertus2018-08-287-37/+41
| | |
| * | changed style of ScoreJobTest.bundleEllen Spertus2018-09-041-14/+10
| | |
| * | minor style improvementEllen Spertus2018-09-041-2/+2
| | |
| * | restored code I inadvertantly removed when mergingEllen Spertus2018-09-041-1/+4
| | |
| * | fixed scalastyle issues, including cyclomatic complexityEllen Spertus2018-09-042-48/+62
| | |
| * | fixed tests after replacing NoSlug with NoneEllen Spertus2018-09-044-77/+85
| | |
| * | replaced NoSlug with proper use of OptionEllen Spertus2018-09-047-37/+41
|/ /
* | warning in python/READMEBryan Newbold2018-09-041-0/+22
| |
* | match crossref reducers=200Bryan Newbold2018-08-311-1/+1
|/
* make similarity score case-insensitiveBryan Newbold2018-08-272-1/+9
|
* basic crossref subtitle concatination supportBryan Newbold2018-08-272-1/+40
|
* more special characters to stripBryan Newbold2018-08-272-2/+2
|
* add even more entries to slug blacklistBryan Newbold2018-08-271-0/+96
|
* update python TODOBryan Newbold2018-08-271-4/+1
|
* Merge branch 'bnewbold-ungrobided'Bryan Newbold2018-08-278-0/+703
|\
| * finally got extraction_ungrobided to run in prodBryan Newbold2018-08-261-4/+7
| | | | | | | | | | Problem was that only one python script was getting sent, so couldn't "import from". Should refactor shared code into a new common file.
| * WIP: ungrobided doesn't inherit (copypasta)Bryan Newbold2018-08-252-7/+136
| |
| * please: save extraction outputBryan Newbold2018-08-261-0/+6
| |
| * ungrobided: example real outputBryan Newbold2018-08-251-0/+20
| |
| * ungrobided: fix python call typoBryan Newbold2018-08-251-1/+1
| |
| * disambiguration parse_line methodBryan Newbold2018-08-251-3/+3
| |
| * ungrobided: add real results to testsBryan Newbold2018-08-251-1/+51
| |
| * add extraction_ungrobided support to pleaseBryan Newbold2018-08-251-0/+30
| |
| * python extraction_ungrobided jobBryan Newbold2018-08-243-0/+288
| |
| * HOWTO some common hbase shell queriesBryan Newbold2018-08-241-0/+14
| |
| * rename DumpUnGrobidedJobBryan Newbold2018-08-242-9/+9
| |
| * please support for DumpUnGrobidedJobBryan Newbold2018-08-241-0/+24
| |
| * scalding: UnGrobidedDumpJobBryan Newbold2018-08-242-0/+139
| |
* | crude job stats/metrics in a text fileBryan Newbold2018-08-271-0/+95
| |
* | set CI LANG env variableBryan Newbold2018-08-251-0/+4
| |
* | switch Dockerfile to xenialBryan Newbold2018-08-241-1/+1
|/ | | | To make CI environment reflect production.
* clean up commented out code in scalding/Bryan Newbold2018-08-244-23/+2
|
* Merge branch 'bnewbold-missing-column'Bryan Newbold2018-08-242-0/+96
|\ | | | | | | | | | | Manually Resolved Conflicts: please
| * fixes to please keys-missing-colBryan Newbold2018-08-211-2/+2
| |
| * add please for keysmissingcolumnBryan Newbold2018-08-211-0/+29
| |
| * rewrite MissingColumnDumpJob as a join (sigh)Bryan Newbold2018-08-211-29/+37
| |
| * WIP: MissingColumnDumpJobBryan Newbold2018-08-211-0/+59
| | | | | | | | | | This version won't actually work because SpyGlass doesn't actually support SCAN filters (among other things)
* | more TODOBryan Newbold2018-08-241-0/+5
| |
* | update TODOBryan Newbold2018-08-242-13/+16
| |
* | move HBase schema and notes from journal-infra repoBryan Newbold2018-08-243-0/+331
| |