index
:
sandcrawler
bnewbold-args
bnewbold-backfill
bnewbold-persist-grobid-errors
bnewbold-refactor-loggging
master
trawler
[no description]
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
Commit message (
Expand
)
Author
Age
Files
Lines
*
Cleanup after merge master. Note: I am not fixing warnings in CdxBackfillJob....
Ellen Spertus
2018-07-19
8
-30
/
+341
|
\
|
*
Merge branch 'bnewbold-backfill' of git.archive.org:webgroup/sandcrawler
Ellen Spertus
2018-07-19
5
-11
/
+322
|
|
\
|
|
*
more debugging notes
Bryan Newbold
2018-07-17
1
-0
/
+14
|
|
*
refactor CdxBackfillJob to be all Typed (failed tests)
Bryan Newbold
2018-07-17
1
-21
/
+46
|
|
*
more complete CdxBackfillJob (untested)
Bryan Newbold
2018-07-17
1
-2
/
+68
|
|
*
fix confusing whitespace in HBaseStatusCountTest
Bryan Newbold
2018-07-17
1
-11
/
+11
|
|
*
add buildSink() method for writing to HBase
Bryan Newbold
2018-07-17
1
-0
/
+7
|
|
*
early work on scalding CDX backfill
Bryan Newbold
2018-07-17
2
-0
/
+199
|
*
|
Added rule to warn about block imports. Removed block imports.
Ellen Spertus
2018-07-19
3
-3
/
+6
|
*
|
Eliminated example directories
Ellen Spertus
2018-07-17
1
-0
/
+8
|
*
|
Added import order checking. Fixed misordered imports in our code.
Ellen Spertus
2018-07-17
4
-4
/
+12
|
|
/
|
*
Merge branch 'scalastyle' into 'master'
bnewbold
2018-07-17
5
-4
/
+122
|
|
\
|
*
\
Merge branch 'both-status-code' into 'master'
bnewbold
2018-07-17
2
-18
/
+43
|
|
\
\
|
|
*
|
lint/cleanup fixes from review
Bryan Newbold
2018-07-17
1
-17
/
+12
*
|
|
|
Fixed mistake found while testing.
Ellen Spertus
2018-07-19
1
-1
/
+1
*
|
|
|
Improved style and style checking.
Ellen Spertus
2018-07-19
6
-25
/
+54
|
|
_
|
/
|
/
|
|
*
|
|
Turned off header checking.
Ellen Spertus
2018-07-17
1
-2
/
+2
*
|
|
Fixed style errors.
Ellen Spertus
2018-07-17
3
-4
/
+4
*
|
|
Installed scalastyle and created configuration file. Run with: sbt scalastyle
Ellen Spertus
2018-07-17
2
-0
/
+118
|
|
/
|
/
|
*
|
refactor HBaseStatusCountJob to convert Long column
Bryan Newbold
2018-07-17
2
-18
/
+48
|
/
*
update please helpers to provide hbase+zk config
Bryan Newbold
2018-07-15
1
-2
/
+13
*
Merge branch 'bnewbold-args'
Bryan Newbold
2018-07-13
5
-16
/
+30
|
\
|
*
snake_case to lowerCamelCase
Bryan Newbold
2018-07-13
5
-18
/
+18
|
*
hbase table and zk host as arguments
Bryan Newbold
2018-06-17
5
-16
/
+30
*
|
Merge branch 'spertus-issue1' into 'master'
bnewbold
2018-07-13
2
-2
/
+2
|
\
\
|
*
|
Changed grobid0:status to grobid0:status_code, per issue 1.
Ellen Spertus
2018-06-18
2
-2
/
+2
*
|
|
commit old tweak to pig script (from cluster)
Bryan Newbold
2018-07-06
1
-2
/
+4
*
|
|
possibly-broken version of hbase-count-rows.pig
Bryan Newbold
2018-07-06
1
-0
/
+13
*
|
|
monkey-patch SHA-1 blacklist
Bryan Newbold
2018-07-05
1
-0
/
+8
|
|
/
|
/
|
*
|
Merge branch 'spertus-abstract' into 'master'
bnewbold
2018-06-17
7
-70
/
+60
|
\
|
|
*
Refactored HBaseStatusCount{Job,Test}.scala.
Ellen Spertus
2018-06-09
2
-26
/
+3
|
*
Cleaned up imports in HBaseMimeCountJob.scala.
Ellen Spertus
2018-06-09
1
-7
/
+1
|
*
Pulled out HBaseBuilder.parseColSpec.
Ellen Spertus
2018-06-09
3
-20
/
+25
|
*
Tests pass.
Ellen Spertus
2018-06-08
3
-18
/
+32
*
|
please: status-count
Bryan Newbold
2018-06-15
1
-0
/
+21
*
|
please: extract
Bryan Newbold
2018-06-15
1
-0
/
+31
*
|
please: split out rebuild steps
Bryan Newbold
2018-06-15
1
-3
/
+18
*
|
doc improvements and fixes to 'please' helper
Bryan Newbold
2018-06-15
6
-38
/
+41
*
|
helper script for running jobs
Bryan Newbold
2018-06-14
1
-0
/
+86
*
|
"why scalding"
Bryan Newbold
2018-06-14
1
-0
/
+7
|
/
*
Merge branch 'groupby' into 'master'
bnewbold
2018-06-07
4
-0
/
+178
|
\
|
*
Added status count.
Ellen Spertus
2018-06-07
2
-0
/
+89
|
*
Made test data more robust.
Ellen Spertus
2018-06-06
1
-2
/
+2
|
*
Removed copied comment.
Ellen Spertus
2018-06-06
1
-8
/
+1
|
*
Added job and test for counting mime types.
Ellen Spertus
2018-06-06
2
-0
/
+96
*
|
Merge branch 'spertus-packages' into 'master'
bnewbold
2018-06-07
4
-16
/
+13
|
\
|
|
*
Made package names match directory names. Cleaned up imports.
Ellen Spertus
2018-06-05
4
-16
/
+13
|
/
*
Merge branch 'refactoring' into 'master'
bnewbold
2018-06-04
4
-20
/
+101
|
\
|
*
Made changes suggested in merge request review.
Ellen Spertus
2018-06-04
3
-15
/
+10
|
*
Changed interface to HBaseBuilder.parseColSpec.
Ellen Spertus
2018-06-03
3
-8
/
+12
[next]