sandcrawler - [no description]

	Commit message (Collapse)	Author	Age	Files	Lines
*	do strip periods ('.')	Bryan Newbold	2018-08-15	1	-1/+1
\|
*	add a stub title blacklist	Bryan Newbold	2018-08-15	2	-1/+18
\|
*	handle null status_code lines	Bryan Newbold	2018-08-15	2	-3/+8
\|
*	unrelated TODO about testing with null HBase values	Bryan Newbold	2018-08-15	1	-0/+1
\|
*	comment about possible slugification process	Bryan Newbold	2018-08-15	1	-0/+9
\|
*	scorable: test for more punctuation removal	Bryan Newbold	2018-08-15	1	-0/+8
\|
*	crossref: test for empty-string title	Bryan Newbold	2018-08-15	1	-0/+6
\|
*	scorable: test for null strings	Bryan Newbold	2018-08-15	3	-1/+10
\|
*	grobid scoring: status_code as signed int, not string	Bryan Newbold	2018-08-15	2	-4/+10
\|
*	update 'please' command for scoring refactor	Bryan Newbold	2018-08-15	1	-1/+10
\|
*	Fixed style problems (or disabled warning when appropriate) for tests.	Ellen Spertus	2018-08-14	10	-100/+135
\|
*	Minor improvements.	Ellen Spertus	2018-08-14	1	-10/+7
\|
*	Now ignores grobid entries with status other than 200.	Ellen Spertus	2018-08-14	3	-20/+39
\|
*	Factored out ScorableFeatures.	Ellen Spertus	2018-08-13	6	-72/+70
\|
*	Pipeline works, all tests pass, no scalastyle errors.	Ellen Spertus	2018-08-13	7	-323/+65
\|
*	Snapshot before changing Scorable to find bug.	Ellen Spertus	2018-08-12	5	-36/+46
\|
*	Added back file I shouldn't have deleted.	Ellen Spertus	2018-08-12	2	-22/+89
\|
*	Tests pass.	Ellen Spertus	2018-08-12	4	-109/+39
\|
*	It compiles.	Ellen Spertus	2018-08-11	5	-64/+96
\|
*	Tests pass. Still have changes to do but made huge progress.	Ellen Spertus	2018-08-10	4	-57/+30
\|
*	It compiles	Ellen Spertus	2018-08-10	4	-31/+43
\|
*	Broken code to share with Bryan.	Ellen Spertus	2018-08-09	5	-8/+90
\|
*	WIP	Ellen Spertus	2018-08-09	4	-5/+226
\|
*	WIP	Ellen Spertus	2018-08-09	4	-13/+21
\|
*	Removed implicit parameters. Does not compile.	Ellen Spertus	2018-08-09	4	-10/+9
\|
*	WIP	Ellen Spertus	2018-08-09	6	-102/+251
\|
*	Fixed scalastyle violations.	Ellen Spertus	2018-08-09	4	-18/+14
\|
*	Added test for null argument to titleToSlug()	Ellen Spertus	2018-08-09	2	-4/+13
\|
*	Removed HBaseCrossrefScore{Job,Test} and references thereto.	Ellen Spertus	2018-08-07	3	-512/+5
\|
*	Commented out guts of HBaseCrossrefScoreTest.	Ellen Spertus	2018-08-07	1	-3/+2
\|
*	Added punctuation removal to slug creation and similarity comparisons	Ellen Spertus	2018-08-07	4	-2/+26
\|
*	Added GrobidScorableTest, minor improvements.	Ellen Spertus	2018-08-07	4	-52/+179
\|
*	Added CrossrefScorableTest, minor cleanups.	Ellen Spertus	2018-08-07	1	-0/+84
\|
*	Minor refactoring. Added test.	Ellen Spertus	2018-08-07	3	-12/+12
\|
*	Added test, which passes.	Ellen Spertus	2018-08-07	1	-5/+8
\|
*	Added ScorableTest, which passes.	Ellen Spertus	2018-08-07	1	-7/+7
\|
*	Removed commented-out code.	Ellen Spertus	2018-08-07	2	-29/+108
\|
*	Added StringUtilitiesTest.scala, which passes.	Ellen Spertus	2018-08-07	1	-0/+75
\|
*	Minor cleanup. Passes scalastyle.	Ellen Spertus	2018-08-07	1	-3/+0
\|
*	Added CrossrefScorable.scala. All code compiles.	Ellen Spertus	2018-08-07	3	-10/+34
\|
*	New code compiles. Old tests pass. New tests not yet written.	Ellen Spertus	2018-08-06	5	-9/+65
\|
*	Partly refactored HBaseCrossrefScoreJob. Everything compiles.	Ellen Spertus	2018-08-06	3	-0/+194
\|
*	Changed scoring, including adding code to compute string differences. Turned ↵	Ellen Spertus	2018-07-30	3	-23/+85
\| \| \| \| \| \| \| \| \| \|	off line length checking. New scores: ['(583,sha1:K2DKSSVTXWPRMFDTWSTCQW3RVWRIOV3Q,DOI-0,'title 1','title 1: tng')'] ['(500,sha1:K2DKSSVTXWPRMFDTWSTCQW3RVWRIOV3Q,DOI-0.5,'title 1','title 1: tng 2')'] ['(500,sha1:K2DKSSVTXWPRMFDTWSTCQW3RVWRIOV3Q,DOI-0.75,'title 1','title 1: tng 3')'] ['(588,sha1:C3YNNEGH5WAG5ZAAXWAEBNXJWT6CZ3WU,DOI-1,'title 2: tng','title 2: rebooted')']
*	Added accent removal to titleToSlug().	Ellen Spertus	2018-07-28	2	-2/+51
\|
*	Merge branch 'grobid-crossref' of git.archive.org:webgroup/sandcrawler into ↵	Ellen Spertus	2018-07-28	1	-0/+28
\|\ \| \| \| \| \| \|	grobid-crossref
\| *	add 'please' command for crossref matching	Bryan Newbold	2018-07-27	1	-0/+28
\| \|
* \|	Added tests (both pass) to try to understand crash when run on real datwa.	Ellen Spertus	2018-07-28	1	-0/+9
\|/
*	Commented out debug() calls.	Ellen Spertus	2018-07-26	1	-2/+1
\|
*	Made changes suggested in MR.	Ellen Spertus	2018-07-26	1	-30/+41
\|
*	Computes and outputs (score, sha1, doi, grobidTitle, crossrefTitle).	Ellen Spertus	2018-07-26	2	-33/+71
\|