sandcrawler - [no description]

	Commit message (Collapse)	Author	Age	Files	Lines
*	Removed commented-out code.	Ellen Spertus	2018-08-07	2	-29/+108
\|
*	Added StringUtilitiesTest.scala, which passes.	Ellen Spertus	2018-08-07	1	-0/+75
\|
*	Minor cleanup. Passes scalastyle.	Ellen Spertus	2018-08-07	1	-3/+0
\|
*	Added CrossrefScorable.scala. All code compiles.	Ellen Spertus	2018-08-07	3	-10/+34
\|
*	New code compiles. Old tests pass. New tests not yet written.	Ellen Spertus	2018-08-06	5	-9/+65
\|
*	Partly refactored HBaseCrossrefScoreJob. Everything compiles.	Ellen Spertus	2018-08-06	3	-0/+194
\|
*	Changed scoring, including adding code to compute string differences. Turned ↵	Ellen Spertus	2018-07-30	2	-22/+84
\| \| \| \| \| \| \| \| \| \|	off line length checking. New scores: ['(583,sha1:K2DKSSVTXWPRMFDTWSTCQW3RVWRIOV3Q,DOI-0,'title 1','title 1: tng')'] ['(500,sha1:K2DKSSVTXWPRMFDTWSTCQW3RVWRIOV3Q,DOI-0.5,'title 1','title 1: tng 2')'] ['(500,sha1:K2DKSSVTXWPRMFDTWSTCQW3RVWRIOV3Q,DOI-0.75,'title 1','title 1: tng 3')'] ['(588,sha1:C3YNNEGH5WAG5ZAAXWAEBNXJWT6CZ3WU,DOI-1,'title 2: tng','title 2: rebooted')']
*	Added accent removal to titleToSlug().	Ellen Spertus	2018-07-28	2	-2/+51
\|
*	Added tests (both pass) to try to understand crash when run on real datwa.	Ellen Spertus	2018-07-28	1	-0/+9
\|
*	Commented out debug() calls.	Ellen Spertus	2018-07-26	1	-2/+1
\|
*	Made changes suggested in MR.	Ellen Spertus	2018-07-26	1	-30/+41
\|
*	Computes and outputs (score, sha1, doi, grobidTitle, crossrefTitle).	Ellen Spertus	2018-07-26	2	-33/+71
\|
*	Made progress on crossrefPipe.	Ellen Spertus	2018-07-25	2	-12/+19
\|
*	Fixed bug with reading from TextLine. (Thanks, Bryan\!) Still had to comment ↵	Ellen Spertus	2018-07-25	2	-11/+10
\| \| \| \|	out some tests.
*	Restored my old tests. Commented out broken tests.	Ellen Spertus	2018-07-25	2	-43/+68
\|
*	Checked all fields of first entry in grobid pipe.	Ellen Spertus	2018-07-25	1	-2/+4
\|
*	Grobid entries without legal slugs are removed from the pipe.	Ellen Spertus	2018-07-25	2	-10/+22
\|
*	Figured out string conversion. Tests pass. Still WIP.	Ellen Spertus	2018-07-25	2	-17/+21
\|
*	WIP. I'm having problems converting between ImmutableBytesWritable and String.	Ellen Spertus	2018-07-24	2	-23/+84
\|
*	Clean-up	Ellen Spertus	2018-07-24	2	-19/+28
\|
*	Added grobidToSlug().	Ellen Spertus	2018-07-24	2	-9/+91
\|
*	Changed return type of grobidToSlug() to Option[String].	Ellen Spertus	2018-07-24	2	-10/+20
\|
*	grobidToSlug() seems to work, including parsing of valid JSON strings.	Ellen Spertus	2018-07-24	2	-0/+131
\|
*	Undid changes that did not belong in this branch.	Ellen Spertus	2018-07-19	2	-290/+0
\|
*	Removed remaining warning.	Ellen Spertus	2018-07-19	1	-1/+1
\|
*	Improved style and style checking.	Ellen Spertus	2018-07-19	4	-17/+27
\| \| \| \| \| \| \|	- Excludes checking of files in /example directories. - Warns about block imports, which have been removed. - Checks indenting. Parameters should be indented 2 spaces. See https://docs.scala-lang.org/style/indentation.html#methods-with-numerous-arguments - Imports should be grouped (java., scala., other), with a blank line between groups
*	refactor CdxBackfillJob to be all Typed (failed tests)	Bryan Newbold	2018-07-19	1	-21/+46
\|
*	more complete CdxBackfillJob (untested)	Bryan Newbold	2018-07-19	1	-2/+68
\|
*	fix confusing whitespace in HBaseStatusCountTest	Bryan Newbold	2018-07-19	1	-11/+11
\|
*	add buildSink() method for writing to HBase	Bryan Newbold	2018-07-19	1	-0/+7
\|
*	early work on scalding CDX backfill	Bryan Newbold	2018-07-19	2	-0/+199
\|
*	Added rule to warn about block imports. Removed block imports.	Ellen Spertus	2018-07-19	2	-2/+4
\|
*	Added import order checking. Fixed misordered imports in our code.	Ellen Spertus	2018-07-17	3	-4/+2
\|
*	Merge branch 'scalastyle' into 'master'	bnewbold	2018-07-17	3	-4/+4
\|\ \| \| \| \| \| \| \| \|	Added scalastyle and fixed style errors See merge request webgroup/sandcrawler!10
\| *	Fixed style errors.	Ellen Spertus	2018-07-17	3	-4/+4
\| \|
* \|	lint/cleanup fixes from review	Bryan Newbold	2018-07-17	1	-17/+12
\|/ \| \| \|	Thanks Ellen!
*	refactor HBaseStatusCountJob to convert Long column	Bryan Newbold	2018-07-17	2	-18/+48
\|
*	Merge branch 'bnewbold-args'	Bryan Newbold	2018-07-13	5	-16/+30
\|\
\| *	snake_case to lowerCamelCase	Bryan Newbold	2018-07-13	5	-18/+18
\| \| \| \| \| \| \| \| \| \| \| \|	... following scala norms. (as per Ellen's review)
\| *	hbase table and zk host as arguments	Bryan Newbold	2018-06-17	5	-16/+30
\| \|
* \|	Changed grobid0:status to grobid0:status_code, per issue 1.	Ellen Spertus	2018-06-18	2	-2/+2
\|/
*	Refactored HBaseStatusCount{Job,Test}.scala.	Ellen Spertus	2018-06-09	2	-26/+3
\|
*	Cleaned up imports in HBaseMimeCountJob.scala.	Ellen Spertus	2018-06-09	1	-7/+1
\|
*	Pulled out HBaseBuilder.parseColSpec.	Ellen Spertus	2018-06-09	3	-20/+25
\|
*	Tests pass.	Ellen Spertus	2018-06-08	3	-18/+32
\|
*	Added status count.	Ellen Spertus	2018-06-07	2	-0/+89
\|
*	Made test data more robust.	Ellen Spertus	2018-06-06	1	-2/+2
\|
*	Removed copied comment.	Ellen Spertus	2018-06-06	1	-8/+1
\|
*	Added job and test for counting mime types.	Ellen Spertus	2018-06-06	2	-0/+96
\|
*	Made package names match directory names. Cleaned up imports.	Ellen Spertus	2018-06-05	4	-16/+13
\|