index
:
sandcrawler
bnewbold-args
bnewbold-backfill
bnewbold-persist-grobid-errors
bnewbold-refactor-loggging
master
trawler
[no description]
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
path:
root
/
scalding
/
src
/
main
Commit message (
Expand
)
Author
Age
Files
Lines
*
Tests pass.
Ellen Spertus
2018-08-12
1
-5
/
+6
*
It compiles.
Ellen Spertus
2018-08-11
3
-42
/
+73
*
Tests pass. Still have changes to do but made huge progress.
Ellen Spertus
2018-08-10
2
-55
/
+27
*
It compiles
Ellen Spertus
2018-08-10
4
-31
/
+43
*
Broken code to share with Bryan.
Ellen Spertus
2018-08-09
5
-8
/
+90
*
WIP
Ellen Spertus
2018-08-09
4
-5
/
+226
*
WIP
Ellen Spertus
2018-08-09
4
-13
/
+21
*
Removed implicit parameters. Does not compile.
Ellen Spertus
2018-08-09
4
-10
/
+9
*
WIP
Ellen Spertus
2018-08-09
4
-18
/
+46
*
Fixed scalastyle violations.
Ellen Spertus
2018-08-09
4
-18
/
+14
*
Added test for null argument to titleToSlug()
Ellen Spertus
2018-08-09
1
-4
/
+9
*
Removed HBaseCrossrefScore{Job,Test} and references thereto.
Ellen Spertus
2018-08-07
2
-219
/
+5
*
Added punctuation removal to slug creation and similarity comparisons
Ellen Spertus
2018-08-07
2
-2
/
+9
*
Added GrobidScorableTest, minor improvements.
Ellen Spertus
2018-08-07
2
-10
/
+33
*
Minor refactoring. Added test.
Ellen Spertus
2018-08-07
2
-10
/
+9
*
Removed commented-out code.
Ellen Spertus
2018-08-07
1
-29
/
+0
*
Minor cleanup. Passes scalastyle.
Ellen Spertus
2018-08-07
1
-3
/
+0
*
Added CrossrefScorable.scala. All code compiles.
Ellen Spertus
2018-08-07
3
-10
/
+34
*
New code compiles. Old tests pass. New tests not yet written.
Ellen Spertus
2018-08-06
5
-9
/
+65
*
Partly refactored HBaseCrossrefScoreJob. Everything compiles.
Ellen Spertus
2018-08-06
3
-0
/
+194
*
Changed scoring, including adding code to compute string differences. Turned ...
Ellen Spertus
2018-07-30
1
-21
/
+36
*
Added accent removal to titleToSlug().
Ellen Spertus
2018-07-28
1
-1
/
+27
*
Commented out debug() calls.
Ellen Spertus
2018-07-26
1
-2
/
+1
*
Made changes suggested in MR.
Ellen Spertus
2018-07-26
1
-30
/
+41
*
Computes and outputs (score, sha1, doi, grobidTitle, crossrefTitle).
Ellen Spertus
2018-07-26
1
-24
/
+49
*
Made progress on crossrefPipe.
Ellen Spertus
2018-07-25
1
-6
/
+13
*
Fixed bug with reading from TextLine. (Thanks, Bryan\!) Still had to comment ...
Ellen Spertus
2018-07-25
1
-6
/
+6
*
Restored my old tests. Commented out broken tests.
Ellen Spertus
2018-07-25
1
-21
/
+44
*
Grobid entries without legal slugs are removed from the pipe.
Ellen Spertus
2018-07-25
1
-4
/
+10
*
Figured out string conversion. Tests pass. Still WIP.
Ellen Spertus
2018-07-25
1
-14
/
+14
*
WIP. I'm having problems converting between ImmutableBytesWritable and String.
Ellen Spertus
2018-07-24
1
-18
/
+40
*
Clean-up
Ellen Spertus
2018-07-24
1
-17
/
+25
*
Added grobidToSlug().
Ellen Spertus
2018-07-24
1
-4
/
+16
*
Changed return type of grobidToSlug() to Option[String].
Ellen Spertus
2018-07-24
1
-7
/
+11
*
grobidToSlug() seems to work, including parsing of valid JSON strings.
Ellen Spertus
2018-07-24
1
-0
/
+58
*
Undid changes that did not belong in this branch.
Ellen Spertus
2018-07-19
1
-173
/
+0
*
Removed remaining warning.
Ellen Spertus
2018-07-19
1
-1
/
+1
*
Improved style and style checking.
Ellen Spertus
2018-07-19
4
-17
/
+27
*
refactor CdxBackfillJob to be all Typed (failed tests)
Bryan Newbold
2018-07-19
1
-21
/
+46
*
add buildSink() method for writing to HBase
Bryan Newbold
2018-07-19
1
-0
/
+7
*
early work on scalding CDX backfill
Bryan Newbold
2018-07-19
1
-0
/
+148
*
Added rule to warn about block imports. Removed block imports.
Ellen Spertus
2018-07-19
2
-2
/
+4
*
Added import order checking. Fixed misordered imports in our code.
Ellen Spertus
2018-07-17
3
-4
/
+2
*
Merge branch 'scalastyle' into 'master'
bnewbold
2018-07-17
3
-4
/
+4
|
\
|
*
Fixed style errors.
Ellen Spertus
2018-07-17
3
-4
/
+4
*
|
lint/cleanup fixes from review
Bryan Newbold
2018-07-17
1
-17
/
+12
|
/
*
refactor HBaseStatusCountJob to convert Long column
Bryan Newbold
2018-07-17
1
-1
/
+29
*
Merge branch 'bnewbold-args'
Bryan Newbold
2018-07-13
2
-13
/
+18
|
\
|
*
snake_case to lowerCamelCase
Bryan Newbold
2018-07-13
2
-6
/
+6
|
*
hbase table and zk host as arguments
Bryan Newbold
2018-06-17
2
-13
/
+18
[next]