sandcrawler - [no description]

	Commit message (Collapse)	Author	Age	Files	Lines
*	remove slug-blacklist conservative test	Bryan Newbold	2018-08-21	1	-16/+0
\|
*	Merge branch 'bnewbold-match-scale'	Bryan Newbold	2018-08-21	1	-0/+2
\|\
\| *	add a trap to ScoreJob	Bryan Newbold	2018-08-20	1	-0/+2
\| \|
* \|	fix bugs/typos in HBaseColCountJob and HBaseStatusCountJob	Bryan Newbold	2018-08-21	2	-14/+7
\| \|
* \|	distinction between status_code and status counting	Bryan Newbold	2018-08-21	2	-6/+75
\| \|
* \|	add GrobidScorableDumpJob and basic test	Bryan Newbold	2018-08-21	1	-0/+124
\| \|
* \|	Merge branch 'strings'	Bryan Newbold	2018-08-21	2	-0/+22
\|\ \ \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	Resolved conflicts in: scalding/src/main/scala/sandcrawler/ScorableFeatures.scala
\| * \|	Reads blacklist from file.	Ellen Spertus	2018-08-20	2	-0/+22
\| \|/
* \|	Created static factory method for ScorableCreations to deal with null.	Ellen Spertus	2018-08-20	1	-3/+3
\| \|
* \|	Disabled scalastyle null checking where we want to test null values.	Ellen Spertus	2018-08-20	1	-0/+2
\| \|
* \|	Reduced boilerplate code.	Ellen Spertus	2018-08-20	1	-11/+11
\|/
*	change slugification behavior to not split on colon	Bryan Newbold	2018-08-15	2	-23/+23
\|
*	add a stub title blacklist	Bryan Newbold	2018-08-15	1	-0/+6
\|
*	handle null status_code lines	Bryan Newbold	2018-08-15	1	-3/+7
\|
*	unrelated TODO about testing with null HBase values	Bryan Newbold	2018-08-15	1	-0/+1
\|
*	scorable: test for more punctuation removal	Bryan Newbold	2018-08-15	1	-0/+8
\|
*	crossref: test for empty-string title	Bryan Newbold	2018-08-15	1	-0/+6
\|
*	scorable: test for null strings	Bryan Newbold	2018-08-15	1	-0/+5
\|
*	grobid scoring: status_code as signed int, not string	Bryan Newbold	2018-08-15	1	-2/+3
\|
*	Fixed style problems (or disabled warning when appropriate) for tests.	Ellen Spertus	2018-08-14	9	-100/+128
\|
*	Minor improvements.	Ellen Spertus	2018-08-14	1	-10/+7
\|
*	Now ignores grobid entries with status other than 200.	Ellen Spertus	2018-08-14	2	-17/+32
\|
*	Factored out ScorableFeatures.	Ellen Spertus	2018-08-13	2	-32/+37
\|
*	Pipeline works, all tests pass, no scalastyle errors.	Ellen Spertus	2018-08-13	2	-33/+53
\|
*	Snapshot before changing Scorable to find bug.	Ellen Spertus	2018-08-12	3	-17/+23
\|
*	Added back file I shouldn't have deleted.	Ellen Spertus	2018-08-12	1	-0/+89
\|
*	Tests pass.	Ellen Spertus	2018-08-12	3	-104/+33
\|
*	It compiles.	Ellen Spertus	2018-08-11	2	-22/+23
\|
*	Tests pass. Still have changes to do but made huge progress.	Ellen Spertus	2018-08-10	2	-2/+3
\|
*	WIP	Ellen Spertus	2018-08-09	2	-84/+205
\|
*	Added test for null argument to titleToSlug()	Ellen Spertus	2018-08-09	1	-0/+4
\|
*	Removed HBaseCrossrefScore{Job,Test} and references thereto.	Ellen Spertus	2018-08-07	1	-293/+0
\|
*	Commented out guts of HBaseCrossrefScoreTest.	Ellen Spertus	2018-08-07	1	-3/+2
\|
*	Added punctuation removal to slug creation and similarity comparisons	Ellen Spertus	2018-08-07	2	-0/+17
\|
*	Added GrobidScorableTest, minor improvements.	Ellen Spertus	2018-08-07	2	-42/+146
\|
*	Added CrossrefScorableTest, minor cleanups.	Ellen Spertus	2018-08-07	1	-0/+84
\|
*	Minor refactoring. Added test.	Ellen Spertus	2018-08-07	1	-2/+3
\|
*	Added test, which passes.	Ellen Spertus	2018-08-07	1	-5/+8
\|
*	Added ScorableTest, which passes.	Ellen Spertus	2018-08-07	1	-7/+7
\|
*	Removed commented-out code.	Ellen Spertus	2018-08-07	1	-0/+108
\|
*	Added StringUtilitiesTest.scala, which passes.	Ellen Spertus	2018-08-07	1	-0/+75
\|
*	Changed scoring, including adding code to compute string differences. Turned ↵	Ellen Spertus	2018-07-30	1	-1/+48
\| \| \| \| \| \| \| \| \| \|	off line length checking. New scores: ['(583,sha1:K2DKSSVTXWPRMFDTWSTCQW3RVWRIOV3Q,DOI-0,'title 1','title 1: tng')'] ['(500,sha1:K2DKSSVTXWPRMFDTWSTCQW3RVWRIOV3Q,DOI-0.5,'title 1','title 1: tng 2')'] ['(500,sha1:K2DKSSVTXWPRMFDTWSTCQW3RVWRIOV3Q,DOI-0.75,'title 1','title 1: tng 3')'] ['(588,sha1:C3YNNEGH5WAG5ZAAXWAEBNXJWT6CZ3WU,DOI-1,'title 2: tng','title 2: rebooted')']
*	Added accent removal to titleToSlug().	Ellen Spertus	2018-07-28	1	-1/+24
\|
*	Added tests (both pass) to try to understand crash when run on real datwa.	Ellen Spertus	2018-07-28	1	-0/+9
\|
*	Computes and outputs (score, sha1, doi, grobidTitle, crossrefTitle).	Ellen Spertus	2018-07-26	1	-9/+22
\|
*	Made progress on crossrefPipe.	Ellen Spertus	2018-07-25	1	-6/+6
\|
*	Fixed bug with reading from TextLine. (Thanks, Bryan\!) Still had to comment ↵	Ellen Spertus	2018-07-25	1	-5/+4
\| \| \| \|	out some tests.
*	Restored my old tests. Commented out broken tests.	Ellen Spertus	2018-07-25	1	-22/+24
\|
*	Checked all fields of first entry in grobid pipe.	Ellen Spertus	2018-07-25	1	-2/+4
\|
*	Grobid entries without legal slugs are removed from the pipe.	Ellen Spertus	2018-07-25	1	-6/+12
\|