Commit message (Collapse) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
* | new simple file metadata dump script | Bryan Newbold | 2018-09-13 | 1 | -0/+36 | |
| | ||||||
* | TODO updates | Bryan Newbold | 2018-09-12 | 1 | -0/+11 | |
| | ||||||
* | insertable flag for match-crossref | Bryan Newbold | 2018-09-12 | 1 | -1/+9 | |
| | ||||||
* | hack scorejob variant with extra context joined in | Bryan Newbold | 2018-09-12 | 2 | -0/+348 | |
| | | | | This is to allow pushes to fatcat. There is probably a better way... | |||||
* | blacklist -> denylist | Bryan Newbold | 2018-09-05 | 5 | -12/+12 | |
| | ||||||
* | Merge branch 'ellen-none-refactor' into 'master' | bnewbold | 2018-09-05 | 11 | -154/+179 | |
|\ | | | | | | | | | Ellen none refactor See merge request webgroup/sandcrawler!23 | |||||
| * | Merge branch 'ellen-none-refactor' of git.archive.org:webgroup/sandcrawler ↵ | Ellen Spertus | 2018-09-04 | 0 | -0/+0 | |
| |\ | | | | | | | | | | into ellen-none-refactor | |||||
| | * | changed style of ScoreJobTest.bundle | Ellen Spertus | 2018-09-04 | 1 | -14/+10 | |
| | | | ||||||
| | * | minor style improvement | Ellen Spertus | 2018-09-04 | 1 | -2/+2 | |
| | | | ||||||
| | * | restored code I inadvertantly removed when merging | Ellen Spertus | 2018-08-28 | 1 | -1/+4 | |
| | | | ||||||
| | * | fixed scalastyle issues, including cyclomatic complexity | Ellen Spertus | 2018-08-28 | 2 | -48/+62 | |
| | | | ||||||
| | * | fixed tests after replacing NoSlug with None | Ellen Spertus | 2018-08-28 | 4 | -77/+85 | |
| | | | ||||||
| | * | replaced NoSlug with proper use of Option | Ellen Spertus | 2018-08-28 | 7 | -37/+41 | |
| | | | ||||||
| * | | changed style of ScoreJobTest.bundle | Ellen Spertus | 2018-09-04 | 1 | -14/+10 | |
| | | | ||||||
| * | | minor style improvement | Ellen Spertus | 2018-09-04 | 1 | -2/+2 | |
| | | | ||||||
| * | | restored code I inadvertantly removed when merging | Ellen Spertus | 2018-09-04 | 1 | -1/+4 | |
| | | | ||||||
| * | | fixed scalastyle issues, including cyclomatic complexity | Ellen Spertus | 2018-09-04 | 2 | -48/+62 | |
| | | | ||||||
| * | | fixed tests after replacing NoSlug with None | Ellen Spertus | 2018-09-04 | 4 | -77/+85 | |
| | | | ||||||
| * | | replaced NoSlug with proper use of Option | Ellen Spertus | 2018-09-04 | 7 | -37/+41 | |
|/ / | ||||||
* | | warning in python/README | Bryan Newbold | 2018-09-04 | 1 | -0/+22 | |
| | | ||||||
* | | match crossref reducers=200 | Bryan Newbold | 2018-08-31 | 1 | -1/+1 | |
|/ | ||||||
* | make similarity score case-insensitive | Bryan Newbold | 2018-08-27 | 2 | -1/+9 | |
| | ||||||
* | basic crossref subtitle concatination support | Bryan Newbold | 2018-08-27 | 2 | -1/+40 | |
| | ||||||
* | more special characters to strip | Bryan Newbold | 2018-08-27 | 2 | -2/+2 | |
| | ||||||
* | add even more entries to slug blacklist | Bryan Newbold | 2018-08-27 | 1 | -0/+96 | |
| | ||||||
* | update python TODO | Bryan Newbold | 2018-08-27 | 1 | -4/+1 | |
| | ||||||
* | Merge branch 'bnewbold-ungrobided' | Bryan Newbold | 2018-08-27 | 8 | -0/+703 | |
|\ | ||||||
| * | finally got extraction_ungrobided to run in prod | Bryan Newbold | 2018-08-26 | 1 | -4/+7 | |
| | | | | | | | | | | Problem was that only one python script was getting sent, so couldn't "import from". Should refactor shared code into a new common file. | |||||
| * | WIP: ungrobided doesn't inherit (copypasta) | Bryan Newbold | 2018-08-25 | 2 | -7/+136 | |
| | | ||||||
| * | please: save extraction output | Bryan Newbold | 2018-08-26 | 1 | -0/+6 | |
| | | ||||||
| * | ungrobided: example real output | Bryan Newbold | 2018-08-25 | 1 | -0/+20 | |
| | | ||||||
| * | ungrobided: fix python call typo | Bryan Newbold | 2018-08-25 | 1 | -1/+1 | |
| | | ||||||
| * | disambiguration parse_line method | Bryan Newbold | 2018-08-25 | 1 | -3/+3 | |
| | | ||||||
| * | ungrobided: add real results to tests | Bryan Newbold | 2018-08-25 | 1 | -1/+51 | |
| | | ||||||
| * | add extraction_ungrobided support to please | Bryan Newbold | 2018-08-25 | 1 | -0/+30 | |
| | | ||||||
| * | python extraction_ungrobided job | Bryan Newbold | 2018-08-24 | 3 | -0/+288 | |
| | | ||||||
| * | HOWTO some common hbase shell queries | Bryan Newbold | 2018-08-24 | 1 | -0/+14 | |
| | | ||||||
| * | rename DumpUnGrobidedJob | Bryan Newbold | 2018-08-24 | 2 | -9/+9 | |
| | | ||||||
| * | please support for DumpUnGrobidedJob | Bryan Newbold | 2018-08-24 | 1 | -0/+24 | |
| | | ||||||
| * | scalding: UnGrobidedDumpJob | Bryan Newbold | 2018-08-24 | 2 | -0/+139 | |
| | | ||||||
* | | crude job stats/metrics in a text file | Bryan Newbold | 2018-08-27 | 1 | -0/+95 | |
| | | ||||||
* | | set CI LANG env variable | Bryan Newbold | 2018-08-25 | 1 | -0/+4 | |
| | | ||||||
* | | switch Dockerfile to xenial | Bryan Newbold | 2018-08-24 | 1 | -1/+1 | |
|/ | | | | To make CI environment reflect production. | |||||
* | clean up commented out code in scalding/ | Bryan Newbold | 2018-08-24 | 4 | -23/+2 | |
| | ||||||
* | Merge branch 'bnewbold-missing-column' | Bryan Newbold | 2018-08-24 | 2 | -0/+96 | |
|\ | | | | | | | | | | | Manually Resolved Conflicts: please | |||||
| * | fixes to please keys-missing-col | Bryan Newbold | 2018-08-21 | 1 | -2/+2 | |
| | | ||||||
| * | add please for keysmissingcolumn | Bryan Newbold | 2018-08-21 | 1 | -0/+29 | |
| | | ||||||
| * | rewrite MissingColumnDumpJob as a join (sigh) | Bryan Newbold | 2018-08-21 | 1 | -29/+37 | |
| | | ||||||
| * | WIP: MissingColumnDumpJob | Bryan Newbold | 2018-08-21 | 1 | -0/+59 | |
| | | | | | | | | | | This version won't actually work because SpyGlass doesn't actually support SCAN filters (among other things) | |||||
* | | more TODO | Bryan Newbold | 2018-08-24 | 1 | -0/+5 | |
| | |