index
:
sandcrawler
bnewbold-args
bnewbold-backfill
bnewbold-persist-grobid-errors
bnewbold-refactor-loggging
master
trawler
[no description]
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
path:
root
/
scalding
/
src
/
main
/
scala
Commit message (
Expand
)
Author
Age
Files
Lines
*
Merge branch 'bnewbold-backfill' of git.archive.org:webgroup/sandcrawler
Ellen Spertus
2018-07-19
2
-0
/
+180
|
\
|
*
refactor CdxBackfillJob to be all Typed (failed tests)
Bryan Newbold
2018-07-17
1
-21
/
+46
|
*
add buildSink() method for writing to HBase
Bryan Newbold
2018-07-17
1
-0
/
+7
|
*
early work on scalding CDX backfill
Bryan Newbold
2018-07-17
1
-0
/
+148
*
|
Added rule to warn about block imports. Removed block imports.
Ellen Spertus
2018-07-19
2
-2
/
+4
*
|
Added import order checking. Fixed misordered imports in our code.
Ellen Spertus
2018-07-17
3
-4
/
+2
|
/
*
Merge branch 'scalastyle' into 'master'
bnewbold
2018-07-17
3
-4
/
+4
|
\
|
*
Fixed style errors.
Ellen Spertus
2018-07-17
3
-4
/
+4
*
|
lint/cleanup fixes from review
Bryan Newbold
2018-07-17
1
-17
/
+12
|
/
*
refactor HBaseStatusCountJob to convert Long column
Bryan Newbold
2018-07-17
1
-1
/
+29
*
Merge branch 'bnewbold-args'
Bryan Newbold
2018-07-13
2
-13
/
+18
|
\
|
*
snake_case to lowerCamelCase
Bryan Newbold
2018-07-13
2
-6
/
+6
|
*
hbase table and zk host as arguments
Bryan Newbold
2018-06-17
2
-13
/
+18
*
|
Changed grobid0:status to grobid0:status_code, per issue 1.
Ellen Spertus
2018-06-18
1
-1
/
+1
|
/
*
Refactored HBaseStatusCount{Job,Test}.scala.
Ellen Spertus
2018-06-09
1
-25
/
+2
*
Cleaned up imports in HBaseMimeCountJob.scala.
Ellen Spertus
2018-06-09
1
-7
/
+1
*
Pulled out HBaseBuilder.parseColSpec.
Ellen Spertus
2018-06-09
2
-14
/
+19
*
Tests pass.
Ellen Spertus
2018-06-08
2
-17
/
+31
*
Added status count.
Ellen Spertus
2018-06-07
1
-0
/
+28
*
Added job and test for counting mime types.
Ellen Spertus
2018-06-06
1
-0
/
+28
*
Made package names match directory names. Cleaned up imports.
Ellen Spertus
2018-06-05
1
-5
/
+4
*
Made changes suggested in merge request review.
Ellen Spertus
2018-06-04
2
-10
/
+5
*
Changed interface to HBaseBuilder.parseColSpec.
Ellen Spertus
2018-06-03
2
-3
/
+7
*
Added HBaseBuilder.build() and had HBaseRowCountJob call it.
Ellen Spertus
2018-06-03
2
-11
/
+5
*
Added HBaseBuilder.parseColSpecs and tests, which pass.
Ellen Spertus
2018-06-03
1
-0
/
+49
*
Factored common code out of HBaseRowCountJob and its test into a new companio...
Ellen Spertus
2018-06-01
1
-5
/
+9
*
switch HBaseRowCountJob to SCAN_ALL
Bryan Newbold
2018-05-29
1
-1
/
+1
*
HBaseRowCountJob actually counts rows
Bryan Newbold
2018-05-29
1
-11
/
+2
*
rename jvm/scalding directories
Bryan Newbold
2018-05-24
3
-0
/
+89