index
:
sandcrawler
bnewbold-args
bnewbold-backfill
bnewbold-persist-grobid-errors
bnewbold-refactor-loggging
master
trawler
[no description]
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
path:
root
/
scalding
Commit message (
Expand
)
Author
Age
Files
Lines
*
more special characters to strip
Bryan Newbold
2018-08-27
2
-2
/
+2
*
add even more entries to slug blacklist
Bryan Newbold
2018-08-27
1
-0
/
+96
*
rename DumpUnGrobidedJob
Bryan Newbold
2018-08-24
2
-9
/
+9
*
scalding: UnGrobidedDumpJob
Bryan Newbold
2018-08-24
2
-0
/
+139
*
clean up commented out code in scalding/
Bryan Newbold
2018-08-24
4
-23
/
+2
*
Merge branch 'bnewbold-missing-column'
Bryan Newbold
2018-08-24
1
-0
/
+67
|
\
|
*
rewrite MissingColumnDumpJob as a join (sigh)
Bryan Newbold
2018-08-21
1
-29
/
+37
|
*
WIP: MissingColumnDumpJob
Bryan Newbold
2018-08-21
1
-0
/
+59
*
|
update scalding README
Bryan Newbold
2018-08-24
1
-13
/
+23
*
|
add un-commited scalding debug notes
Bryan Newbold
2018-08-24
1
-0
/
+26
*
|
Merge branch 'bnewbold-match-quality'
Bryan Newbold
2018-08-24
2
-0
/
+79
|
\
\
|
*
|
BibjsonScorable: fix ScorableFeatures (after rebase)
Bryan Newbold
2018-08-21
1
-1
/
+1
|
*
|
local bibjson-to-bibjson matching job (no tests)
Bryan Newbold
2018-08-21
1
-0
/
+29
|
*
|
bibjson scorable class (no tests)
Bryan Newbold
2018-08-21
1
-0
/
+50
*
|
|
add counters to ScoreJob
Bryan Newbold
2018-08-24
1
-13
/
+47
*
|
|
remove duplicate imports
Bryan Newbold
2018-08-24
1
-2
/
+0
*
|
|
add a content-type filter for crossref works
Bryan Newbold
2018-08-23
2
-1
/
+26
*
|
|
require crossref works to have at least one author (for matching)
Bryan Newbold
2018-08-23
2
-1
/
+7
*
|
|
author parsing (and year, for crossref)
Bryan Newbold
2018-08-23
5
-7
/
+57
*
|
|
set a minimum slug size (8 chars)
Bryan Newbold
2018-08-23
4
-15
/
+31
*
|
|
clean up indendation in ScoreJob.scala
Bryan Newbold
2018-08-23
1
-5
/
+5
*
|
|
clean up commented-out code in ScoreJob.scala
Bryan Newbold
2018-08-23
1
-30
/
+0
*
|
|
increase MaxTitleLength from 255 to 1023
Bryan Newbold
2018-08-23
1
-1
/
+1
*
|
|
additions to slug blacklist
Bryan Newbold
2018-08-23
1
-383
/
+414
*
|
|
Fixed style violations.
Ellen Spertus
2018-08-22
2
-4
/
+5
*
|
|
Added ScoreJob test for title-length filtering.
Ellen Spertus
2018-08-22
1
-5
/
+13
*
|
|
Merge branch 'master' into ellen-length-filtering
Ellen Spertus
2018-08-22
2
-2
/
+2
|
\
\
\
|
*
|
|
add more punctuation characters to slug filter
Bryan Newbold
2018-08-22
2
-2
/
+2
*
|
|
|
Added title-length filtering to CrossrefScorable.
Ellen Spertus
2018-08-22
2
-15
/
+71
*
|
|
|
Added more tests of GrobidScorable.keepRecord
Ellen Spertus
2018-08-22
1
-0
/
+5
*
|
|
|
Added title length filtering to GrobidScorable
Ellen Spertus
2018-08-22
3
-2
/
+46
|
/
/
/
*
|
|
expand slug-blacklist with results from prod GROBID/crossref match
Bryan Newbold
2018-08-21
1
-0
/
+393
*
|
|
remove slug-blacklist conservative test
Bryan Newbold
2018-08-21
1
-16
/
+0
|
|
/
|
/
|
*
|
Merge branch 'bnewbold-match-scale'
Bryan Newbold
2018-08-21
2
-5
/
+10
|
\
\
|
*
|
add a trap to ScoreJob
Bryan Newbold
2018-08-20
2
-5
/
+10
*
|
|
update spyglass patch/version (as an experiment)
Bryan Newbold
2018-08-21
1
-1
/
+1
*
|
|
scalastyle
Bryan Newbold
2018-08-21
1
-9
/
+8
*
|
|
fix bugs/typos in HBaseColCountJob and HBaseStatusCountJob
Bryan Newbold
2018-08-21
4
-18
/
+11
*
|
|
make col counter generic
Bryan Newbold
2018-08-21
1
-6
/
+7
*
|
|
add dedicated job for counting GrobidMetadata column
Bryan Newbold
2018-08-21
1
-0
/
+36
*
|
|
use grobid0:metadata, not tei_json
Bryan Newbold
2018-08-21
2
-10
/
+10
*
|
|
distinction between status_code and status counting
Bryan Newbold
2018-08-21
4
-10
/
+111
*
|
|
fold all scorable code into sanity check; counters
Bryan Newbold
2018-08-21
1
-7
/
+52
*
|
|
add GrobidScorableDumpJob and basic test
Bryan Newbold
2018-08-21
2
-0
/
+142
|
|
/
|
/
|
*
|
Merge branch 'strings'
Bryan Newbold
2018-08-21
4
-9
/
+65
|
\
\
|
*
|
Reads blacklist from file.
Ellen Spertus
2018-08-20
4
-18
/
+77
|
|
/
*
|
Removed debugging code, fixed style warnings.
Ellen Spertus
2018-08-20
1
-11
/
+6
*
|
Created static factory method for ScorableCreations to deal with null.
Ellen Spertus
2018-08-20
4
-18
/
+26
*
|
Disabled scalastyle null checking where we want to test null values.
Ellen Spertus
2018-08-20
1
-0
/
+2
*
|
Reduced boilerplate code.
Ellen Spertus
2018-08-20
1
-11
/
+11
|
/
[next]