aboutsummaryrefslogtreecommitdiffstats
path: root/scalding/src/test
Commit message (Expand)AuthorAgeFilesLines
* Tests pass. Still have changes to do but made huge progress.Ellen Spertus2018-08-102-2/+3
* WIPEllen Spertus2018-08-092-84/+205
* Added test for null argument to titleToSlug()Ellen Spertus2018-08-091-0/+4
* Removed HBaseCrossrefScore{Job,Test} and references thereto.Ellen Spertus2018-08-071-293/+0
* Commented out guts of HBaseCrossrefScoreTest.Ellen Spertus2018-08-071-3/+2
* Added punctuation removal to slug creation and similarity comparisonsEllen Spertus2018-08-072-0/+17
* Added GrobidScorableTest, minor improvements.Ellen Spertus2018-08-072-42/+146
* Added CrossrefScorableTest, minor cleanups.Ellen Spertus2018-08-071-0/+84
* Minor refactoring. Added test.Ellen Spertus2018-08-071-2/+3
* Added test, which passes.Ellen Spertus2018-08-071-5/+8
* Added ScorableTest, which passes.Ellen Spertus2018-08-071-7/+7
* Removed commented-out code.Ellen Spertus2018-08-071-0/+108
* Added StringUtilitiesTest.scala, which passes.Ellen Spertus2018-08-071-0/+75
* Changed scoring, including adding code to compute string differences. Turned ...Ellen Spertus2018-07-301-1/+48
* Added accent removal to titleToSlug().Ellen Spertus2018-07-281-1/+24
* Added tests (both pass) to try to understand crash when run on real datwa.Ellen Spertus2018-07-281-0/+9
* Computes and outputs (score, sha1, doi, grobidTitle, crossrefTitle).Ellen Spertus2018-07-261-9/+22
* Made progress on crossrefPipe.Ellen Spertus2018-07-251-6/+6
* Fixed bug with reading from TextLine. (Thanks, Bryan\!) Still had to comment ...Ellen Spertus2018-07-251-5/+4
* Restored my old tests. Commented out broken tests.Ellen Spertus2018-07-251-22/+24
* Checked all fields of first entry in grobid pipe.Ellen Spertus2018-07-251-2/+4
* Grobid entries without legal slugs are removed from the pipe.Ellen Spertus2018-07-251-6/+12
* Figured out string conversion. Tests pass. Still WIP.Ellen Spertus2018-07-251-3/+7
* WIP. I'm having problems converting between ImmutableBytesWritable and String.Ellen Spertus2018-07-241-5/+44
* Clean-upEllen Spertus2018-07-241-2/+3
* Added grobidToSlug().Ellen Spertus2018-07-241-5/+75
* Changed return type of grobidToSlug() to Option[String].Ellen Spertus2018-07-241-3/+9
* grobidToSlug() seems to work, including parsing of valid JSON strings.Ellen Spertus2018-07-241-0/+73
* Undid changes that did not belong in this branch.Ellen Spertus2018-07-191-117/+0
* more complete CdxBackfillJob (untested)Bryan Newbold2018-07-191-2/+68
* fix confusing whitespace in HBaseStatusCountTestBryan Newbold2018-07-191-11/+11
* early work on scalding CDX backfillBryan Newbold2018-07-191-0/+51
* refactor HBaseStatusCountJob to convert Long columnBryan Newbold2018-07-171-17/+19
* Merge branch 'bnewbold-args'Bryan Newbold2018-07-133-3/+12
|\
| * snake_case to lowerCamelCaseBryan Newbold2018-07-133-12/+12
| * hbase table and zk host as argumentsBryan Newbold2018-06-173-3/+12
* | Changed grobid0:status to grobid0:status_code, per issue 1.Ellen Spertus2018-06-181-1/+1
|/
* Refactored HBaseStatusCount{Job,Test}.scala.Ellen Spertus2018-06-091-1/+1
* Pulled out HBaseBuilder.parseColSpec.Ellen Spertus2018-06-091-6/+6
* Tests pass.Ellen Spertus2018-06-081-1/+1
* Added status count.Ellen Spertus2018-06-071-0/+61
* Made test data more robust.Ellen Spertus2018-06-061-2/+2
* Removed copied comment.Ellen Spertus2018-06-061-8/+1
* Added job and test for counting mime types.Ellen Spertus2018-06-061-0/+68
* Made package names match directory names. Cleaned up imports.Ellen Spertus2018-06-053-11/+9
* Made changes suggested in merge request review.Ellen Spertus2018-06-041-5/+5
* Changed interface to HBaseBuilder.parseColSpec.Ellen Spertus2018-06-031-5/+5
* Added HBaseBuilder.parseColSpecs and tests, which pass.Ellen Spertus2018-06-031-0/+43
* Factored common code out of HBaseRowCountJob and its test into a new companio...Ellen Spertus2018-06-011-11/+3
* switch HBaseRowCountJob to SCAN_ALLBryan Newbold2018-05-291-4/+10