sandcrawler - [no description]

	Commit message (Collapse)	Author	Age	Files	Lines
...
\| *	grobidToSlug() seems to work, including parsing of valid JSON strings.	Ellen Spertus	2018-07-24	1	-0/+58
\| \|
* \|	row-count: require f:c, not file:size	Bryan Newbold	2018-08-08	1	-1/+1
\|/ \| \| \| \| \| \| \| \| \| \|	I tried using the empty List() and got a test failure, so it seems like we do need to specific some field here. file:size gets populated by the extraction job, not the backfill job, so I had been miscounting table sizes (counting only the number of GROBID extracted items, not rows in the table). TODO: count on key or no column, not f:c
*	Undid changes that did not belong in this branch.	Ellen Spertus	2018-07-19	1	-173/+0
\|
*	Removed remaining warning.	Ellen Spertus	2018-07-19	1	-1/+1
\|
*	Improved style and style checking.	Ellen Spertus	2018-07-19	4	-17/+27
\| \| \| \| \| \| \|	- Excludes checking of files in /example directories. - Warns about block imports, which have been removed. - Checks indenting. Parameters should be indented 2 spaces. See https://docs.scala-lang.org/style/indentation.html#methods-with-numerous-arguments - Imports should be grouped (java., scala., other), with a blank line between groups
*	refactor CdxBackfillJob to be all Typed (failed tests)	Bryan Newbold	2018-07-19	1	-21/+46
\|
*	add buildSink() method for writing to HBase	Bryan Newbold	2018-07-19	1	-0/+7
\|
*	early work on scalding CDX backfill	Bryan Newbold	2018-07-19	1	-0/+148
\|
*	Added rule to warn about block imports. Removed block imports.	Ellen Spertus	2018-07-19	2	-2/+4
\|
*	Added import order checking. Fixed misordered imports in our code.	Ellen Spertus	2018-07-17	3	-4/+2
\|
*	Merge branch 'scalastyle' into 'master'	bnewbold	2018-07-17	3	-4/+4
\|\ \| \| \| \| \| \| \| \|	Added scalastyle and fixed style errors See merge request webgroup/sandcrawler!10
\| *	Fixed style errors.	Ellen Spertus	2018-07-17	3	-4/+4
\| \|
* \|	lint/cleanup fixes from review	Bryan Newbold	2018-07-17	1	-17/+12
\|/ \| \| \|	Thanks Ellen!
*	refactor HBaseStatusCountJob to convert Long column	Bryan Newbold	2018-07-17	1	-1/+29
\|
*	Merge branch 'bnewbold-args'	Bryan Newbold	2018-07-13	2	-13/+18
\|\
\| *	snake_case to lowerCamelCase	Bryan Newbold	2018-07-13	2	-6/+6
\| \| \| \| \| \| \| \| \| \| \| \|	... following scala norms. (as per Ellen's review)
\| *	hbase table and zk host as arguments	Bryan Newbold	2018-06-17	2	-13/+18
\| \|
* \|	Changed grobid0:status to grobid0:status_code, per issue 1.	Ellen Spertus	2018-06-18	1	-1/+1
\|/
*	Refactored HBaseStatusCount{Job,Test}.scala.	Ellen Spertus	2018-06-09	1	-25/+2
\|
*	Cleaned up imports in HBaseMimeCountJob.scala.	Ellen Spertus	2018-06-09	1	-7/+1
\|
*	Pulled out HBaseBuilder.parseColSpec.	Ellen Spertus	2018-06-09	2	-14/+19
\|
*	Tests pass.	Ellen Spertus	2018-06-08	2	-17/+31
\|
*	Added status count.	Ellen Spertus	2018-06-07	1	-0/+28
\|
*	Added job and test for counting mime types.	Ellen Spertus	2018-06-06	1	-0/+28
\|
*	Made package names match directory names. Cleaned up imports.	Ellen Spertus	2018-06-05	1	-5/+4
\|
*	Made changes suggested in merge request review.	Ellen Spertus	2018-06-04	2	-10/+5
\| \| \| \| \|	- Changed inverseSchema from Map to List, eliminating incorrect comment. - Changing format of argument to HBaseBuilder.build from String to List[String].
*	Changed interface to HBaseBuilder.parseColSpec.	Ellen Spertus	2018-06-03	2	-3/+7
\|
*	Added HBaseBuilder.build() and had HBaseRowCountJob call it.	Ellen Spertus	2018-06-03	2	-11/+5
\|
*	Added HBaseBuilder.parseColSpecs and tests, which pass.	Ellen Spertus	2018-06-03	1	-0/+49
\|
*	Factored common code out of HBaseRowCountJob and its test into a new ↵	Ellen Spertus	2018-06-01	1	-5/+9
\| \| \| \|	companion object.
*	switch HBaseRowCountJob to SCAN_ALL	Bryan Newbold	2018-05-29	1	-1/+1
\|
*	HBaseRowCountJob actually counts rows	Bryan Newbold	2018-05-29	1	-11/+2
\|
*	rename jvm/scalding directories	Bryan Newbold	2018-05-24	3	-0/+89