aboutsummaryrefslogtreecommitdiffstats
path: root/scalding/src/test
Commit message (Expand)AuthorAgeFilesLines
* Now ignores grobid entries with status other than 200.Ellen Spertus2018-08-142-17/+32
* Factored out ScorableFeatures.Ellen Spertus2018-08-132-32/+37
* Pipeline works, all tests pass, no scalastyle errors.Ellen Spertus2018-08-132-33/+53
* Snapshot before changing Scorable to find bug.Ellen Spertus2018-08-123-17/+23
* Added back file I shouldn't have deleted.Ellen Spertus2018-08-121-0/+89
* Tests pass.Ellen Spertus2018-08-123-104/+33
* It compiles.Ellen Spertus2018-08-112-22/+23
* Tests pass. Still have changes to do but made huge progress.Ellen Spertus2018-08-102-2/+3
* WIPEllen Spertus2018-08-092-84/+205
* Added test for null argument to titleToSlug()Ellen Spertus2018-08-091-0/+4
* Removed HBaseCrossrefScore{Job,Test} and references thereto.Ellen Spertus2018-08-071-293/+0
* Commented out guts of HBaseCrossrefScoreTest.Ellen Spertus2018-08-071-3/+2
* Added punctuation removal to slug creation and similarity comparisonsEllen Spertus2018-08-072-0/+17
* Added GrobidScorableTest, minor improvements.Ellen Spertus2018-08-072-42/+146
* Added CrossrefScorableTest, minor cleanups.Ellen Spertus2018-08-071-0/+84
* Minor refactoring. Added test.Ellen Spertus2018-08-071-2/+3
* Added test, which passes.Ellen Spertus2018-08-071-5/+8
* Added ScorableTest, which passes.Ellen Spertus2018-08-071-7/+7
* Removed commented-out code.Ellen Spertus2018-08-071-0/+108
* Added StringUtilitiesTest.scala, which passes.Ellen Spertus2018-08-071-0/+75
* Changed scoring, including adding code to compute string differences. Turned ...Ellen Spertus2018-07-301-1/+48
* Added accent removal to titleToSlug().Ellen Spertus2018-07-281-1/+24
* Added tests (both pass) to try to understand crash when run on real datwa.Ellen Spertus2018-07-281-0/+9
* Computes and outputs (score, sha1, doi, grobidTitle, crossrefTitle).Ellen Spertus2018-07-261-9/+22
* Made progress on crossrefPipe.Ellen Spertus2018-07-251-6/+6
* Fixed bug with reading from TextLine. (Thanks, Bryan\!) Still had to comment ...Ellen Spertus2018-07-251-5/+4
* Restored my old tests. Commented out broken tests.Ellen Spertus2018-07-251-22/+24
* Checked all fields of first entry in grobid pipe.Ellen Spertus2018-07-251-2/+4
* Grobid entries without legal slugs are removed from the pipe.Ellen Spertus2018-07-251-6/+12
* Figured out string conversion. Tests pass. Still WIP.Ellen Spertus2018-07-251-3/+7
* WIP. I'm having problems converting between ImmutableBytesWritable and String.Ellen Spertus2018-07-241-5/+44
* Clean-upEllen Spertus2018-07-241-2/+3
* Added grobidToSlug().Ellen Spertus2018-07-241-5/+75
* Changed return type of grobidToSlug() to Option[String].Ellen Spertus2018-07-241-3/+9
* grobidToSlug() seems to work, including parsing of valid JSON strings.Ellen Spertus2018-07-241-0/+73
* Undid changes that did not belong in this branch.Ellen Spertus2018-07-191-117/+0
* more complete CdxBackfillJob (untested)Bryan Newbold2018-07-191-2/+68
* fix confusing whitespace in HBaseStatusCountTestBryan Newbold2018-07-191-11/+11
* early work on scalding CDX backfillBryan Newbold2018-07-191-0/+51
* refactor HBaseStatusCountJob to convert Long columnBryan Newbold2018-07-171-17/+19
* Merge branch 'bnewbold-args'Bryan Newbold2018-07-133-3/+12
|\
| * snake_case to lowerCamelCaseBryan Newbold2018-07-133-12/+12
| * hbase table and zk host as argumentsBryan Newbold2018-06-173-3/+12
* | Changed grobid0:status to grobid0:status_code, per issue 1.Ellen Spertus2018-06-181-1/+1
|/
* Refactored HBaseStatusCount{Job,Test}.scala.Ellen Spertus2018-06-091-1/+1
* Pulled out HBaseBuilder.parseColSpec.Ellen Spertus2018-06-091-6/+6
* Tests pass.Ellen Spertus2018-06-081-1/+1
* Added status count.Ellen Spertus2018-06-071-0/+61
* Made test data more robust.Ellen Spertus2018-06-061-2/+2
* Removed copied comment.Ellen Spertus2018-06-061-8/+1