Commit message (Collapse) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
| * | | add extraction_ungrobided support to please | Bryan Newbold | 2018-08-25 | 1 | -0/+30 | |
| | | | ||||||
| * | | python extraction_ungrobided job | Bryan Newbold | 2018-08-24 | 3 | -0/+288 | |
| | | | ||||||
| * | | HOWTO some common hbase shell queries | Bryan Newbold | 2018-08-24 | 1 | -0/+14 | |
| | | | ||||||
| * | | rename DumpUnGrobidedJob | Bryan Newbold | 2018-08-24 | 2 | -9/+9 | |
| | | | ||||||
| * | | please support for DumpUnGrobidedJob | Bryan Newbold | 2018-08-24 | 1 | -0/+24 | |
| | | | ||||||
| * | | scalding: UnGrobidedDumpJob | Bryan Newbold | 2018-08-24 | 2 | -0/+139 | |
| | | | ||||||
* | | | crude job stats/metrics in a text file | Bryan Newbold | 2018-08-27 | 1 | -0/+95 | |
| | | | ||||||
* | | | set CI LANG env variable | Bryan Newbold | 2018-08-25 | 1 | -0/+4 | |
| | | | ||||||
* | | | switch Dockerfile to xenial | Bryan Newbold | 2018-08-24 | 1 | -1/+1 | |
|/ / | | | | | | | To make CI environment reflect production. | |||||
* | | clean up commented out code in scalding/ | Bryan Newbold | 2018-08-24 | 4 | -23/+2 | |
| | | ||||||
* | | Merge branch 'bnewbold-missing-column' | Bryan Newbold | 2018-08-24 | 2 | -0/+96 | |
|\ \ | | | | | | | | | | | | | | | | Manually Resolved Conflicts: please | |||||
| * | | fixes to please keys-missing-col | Bryan Newbold | 2018-08-21 | 1 | -2/+2 | |
| | | | ||||||
| * | | add please for keysmissingcolumn | Bryan Newbold | 2018-08-21 | 1 | -0/+29 | |
| | | | ||||||
| * | | rewrite MissingColumnDumpJob as a join (sigh) | Bryan Newbold | 2018-08-21 | 1 | -29/+37 | |
| | | | ||||||
| * | | WIP: MissingColumnDumpJob | Bryan Newbold | 2018-08-21 | 1 | -0/+59 | |
| | | | | | | | | | | | | | | | This version won't actually work because SpyGlass doesn't actually support SCAN filters (among other things) | |||||
* | | | more TODO | Bryan Newbold | 2018-08-24 | 1 | -0/+5 | |
| | | | ||||||
* | | | update TODO | Bryan Newbold | 2018-08-24 | 2 | -13/+16 | |
| | | | ||||||
* | | | move HBase schema and notes from journal-infra repo | Bryan Newbold | 2018-08-24 | 3 | -0/+331 | |
| | | | ||||||
* | | | commit notes from my laptop | Bryan Newbold | 2018-08-24 | 6 | -0/+256 | |
| | | | ||||||
* | | | move RFC/design-doc from journal-infra repo | Bryan Newbold | 2018-08-24 | 1 | -0/+180 | |
| | | | ||||||
* | | | update READMEs | Bryan Newbold | 2018-08-24 | 2 | -43/+46 | |
| | | | ||||||
* | | | clarify please docs | Bryan Newbold | 2018-08-24 | 1 | -2/+2 | |
| | | | ||||||
* | | | update scalding README | Bryan Newbold | 2018-08-24 | 1 | -13/+23 | |
| | | | ||||||
* | | | add un-commited scalding debug notes | Bryan Newbold | 2018-08-24 | 1 | -0/+26 | |
| | | | ||||||
* | | | rename ./mapreduce to ./python | Bryan Newbold | 2018-08-24 | 25 | -7/+7 | |
| | | | ||||||
* | | | gitignore match test output | Bryan Newbold | 2018-08-24 | 1 | -0/+1 | |
| | | | ||||||
* | | | match results | Bryan Newbold | 2018-08-24 | 1 | -0/+13 | |
| | | | ||||||
* | | | run please in CI, at least to check syntax | Bryan Newbold | 2018-08-24 | 1 | -0/+1 | |
| | | | ||||||
* | | | fix merge typos in please | Bryan Newbold | 2018-08-24 | 1 | -2/+2 | |
| | | | ||||||
* | | | Merge branch 'bnewbold-match-quality' | Bryan Newbold | 2018-08-24 | 12 | -27/+2125 | |
|\ \ \ | | | | | | | | | | | | | | | | | | | | | Manually resolved merge conflict in: please | |||||
| * | | | start tracking benchmark results | Bryan Newbold | 2018-08-24 | 1 | -0/+17 | |
| | | | | ||||||
| * | | | rework fetch_hadoop script | Bryan Newbold | 2018-08-24 | 5 | -27/+45 | |
| | | | | | | | | | | | | | | | | | | | | Should work on macOS now, and fetches hadoop in addition to pig. Still requires wget (not installed by default on macOS). | |||||
| * | | | BibjsonScorable: fix ScorableFeatures (after rebase) | Bryan Newbold | 2018-08-21 | 1 | -1/+1 | |
| | | | | ||||||
| * | | | please support for match-benchmark | Bryan Newbold | 2018-08-21 | 1 | -0/+26 | |
| | | | | ||||||
| * | | | fix bug with qa/prod detection | Bryan Newbold | 2018-08-21 | 1 | -0/+1 | |
| | | | | ||||||
| * | | | local bibjson-to-bibjson matching job (no tests) | Bryan Newbold | 2018-08-21 | 1 | -0/+29 | |
| | | | | ||||||
| * | | | bibjson scorable class (no tests) | Bryan Newbold | 2018-08-21 | 1 | -0/+50 | |
| | | | | ||||||
| * | | | add matching bibjson files | Bryan Newbold | 2018-08-21 | 3 | -0/+1956 | |
| | | | | ||||||
* | | | | add counters to ScoreJob | Bryan Newbold | 2018-08-24 | 1 | -13/+47 | |
| | | | | ||||||
* | | | | remove duplicate imports | Bryan Newbold | 2018-08-24 | 1 | -2/+0 | |
| | | | | ||||||
* | | | | add a content-type filter for crossref works | Bryan Newbold | 2018-08-23 | 2 | -1/+26 | |
| | | | | ||||||
* | | | | require crossref works to have at least one author (for matching) | Bryan Newbold | 2018-08-23 | 2 | -1/+7 | |
| | | | | ||||||
* | | | | author parsing (and year, for crossref) | Bryan Newbold | 2018-08-23 | 5 | -7/+57 | |
| | | | | ||||||
* | | | | set a minimum slug size (8 chars) | Bryan Newbold | 2018-08-23 | 4 | -15/+31 | |
| | | | | ||||||
* | | | | clean up indendation in ScoreJob.scala | Bryan Newbold | 2018-08-23 | 1 | -5/+5 | |
| | | | | ||||||
* | | | | clean up commented-out code in ScoreJob.scala | Bryan Newbold | 2018-08-23 | 1 | -30/+0 | |
| | | | | ||||||
* | | | | increase MaxTitleLength from 255 to 1023 | Bryan Newbold | 2018-08-23 | 1 | -1/+1 | |
| | | | | | | | | | | | | | | | | | | | | | | | | Motivated after finding some long titles with MathML mixed in. Until this issue can be investigated further, bumping this limit to pass the handful of matches found. | |||||
* | | | | additions to slug blacklist | Bryan Newbold | 2018-08-23 | 1 | -383/+414 | |
| | | | | ||||||
* | | | | Merge branch 'bnewbold-extraction-tweaks' | Bryan Newbold | 2018-08-23 | 1 | -4/+7 | |
|\ \ \ \ | ||||||
| * | | | | extraction: do want content, not text | Bryan Newbold | 2018-08-21 | 1 | -1/+1 | |
| | | | | | | | | | | | | | | | | | | | | XML can have non-unicode characters? Who knew. |