sandcrawler - [no description]

	Commit message (Collapse)	Author	Age	Files	Lines
*	set a minimum slug size (8 chars)	Bryan Newbold	2018-08-23	1	-1/+5
\|
*	clean up indendation in ScoreJob.scala	Bryan Newbold	2018-08-23	1	-5/+5
\|
*	clean up commented-out code in ScoreJob.scala	Bryan Newbold	2018-08-23	1	-30/+0
\|
*	increase MaxTitleLength from 255 to 1023	Bryan Newbold	2018-08-23	1	-1/+1
\| \| \| \| \| \|	Motivated after finding some long titles with MathML mixed in. Until this issue can be investigated further, bumping this limit to pass the handful of matches found.
*	Fixed style violations.	Ellen Spertus	2018-08-22	1	-2/+4
\|
*	Merge branch 'master' into ellen-length-filtering	Ellen Spertus	2018-08-22	1	-1/+1
\|\
\| *	add more punctuation characters to slug filter	Bryan Newbold	2018-08-22	1	-1/+1
\| \|
* \|	Added title-length filtering to CrossrefScorable.	Ellen Spertus	2018-08-22	1	-13/+37
\| \|
* \|	Added title length filtering to GrobidScorable	Ellen Spertus	2018-08-22	2	-0/+17
\|/
*	Merge branch 'bnewbold-match-scale'	Bryan Newbold	2018-08-21	1	-5/+8
\|\
\| *	add a trap to ScoreJob	Bryan Newbold	2018-08-20	1	-5/+8
\| \|
* \|	scalastyle	Bryan Newbold	2018-08-21	1	-9/+8
\| \|
* \|	fix bugs/typos in HBaseColCountJob and HBaseStatusCountJob	Bryan Newbold	2018-08-21	2	-4/+4
\| \|
* \|	make col counter generic	Bryan Newbold	2018-08-21	1	-6/+7
\| \|
* \|	add dedicated job for counting GrobidMetadata column	Bryan Newbold	2018-08-21	1	-0/+36
\| \|
* \|	use grobid0:metadata, not tei_json	Bryan Newbold	2018-08-21	2	-10/+10
\| \| \| \| \| \| \| \| \| \|	This is for efficiency. I had forgotten that the extract script actually writes this path!
* \|	distinction between status_code and status counting	Bryan Newbold	2018-08-21	2	-4/+36
\| \|
* \|	fold all scorable code into sanity check; counters	Bryan Newbold	2018-08-21	1	-7/+52
\| \|
* \|	add GrobidScorableDumpJob and basic test	Bryan Newbold	2018-08-21	1	-0/+18
\| \|
* \|	Merge branch 'strings'	Bryan Newbold	2018-08-21	1	-9/+9
\|\ \ \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	Resolved conflicts in: scalding/src/main/scala/sandcrawler/ScorableFeatures.scala
\| * \|	Reads blacklist from file.	Ellen Spertus	2018-08-20	1	-18/+21
\| \|/
* \|	Removed debugging code, fixed style warnings.	Ellen Spertus	2018-08-20	1	-11/+6
\| \|
* \|	Created static factory method for ScorableCreations to deal with null.	Ellen Spertus	2018-08-20	3	-15/+23
\|/
*	Merge branch 'bnewbold-scoring-patches' into 'master'	bnewbold	2018-08-16	6	-0/+359
\|\ \| \| \| \| \| \| \| \|	Patches on top of scoring-refactor branch (Crossref/GROBID matching work) See merge request webgroup/sandcrawler!15
\| *	change slugification behavior to not split on colon	Bryan Newbold	2018-08-15	1	-2/+2
\| \|
\| *	do strip periods ('.')	Bryan Newbold	2018-08-15	1	-1/+1
\| \|
\| *	add a stub title blacklist	Bryan Newbold	2018-08-15	1	-1/+12
\| \|
\| *	handle null status_code lines	Bryan Newbold	2018-08-15	1	-0/+1
\| \|
\| *	comment about possible slugification process	Bryan Newbold	2018-08-15	1	-0/+9
\| \|
\| *	scorable: test for null strings	Bryan Newbold	2018-08-15	2	-1/+5
\| \|
\| *	grobid scoring: status_code as signed int, not string	Bryan Newbold	2018-08-15	1	-2/+7
\| \|
\| *	Now ignores grobid entries with status other than 200.	Ellen Spertus	2018-08-14	1	-3/+7
\| \|
\| *	Factored out ScorableFeatures.	Ellen Spertus	2018-08-13	4	-40/+33
\| \|
\| *	Pipeline works, all tests pass, no scalastyle errors.	Ellen Spertus	2018-08-13	5	-290/+12
\| \|
\| *	Snapshot before changing Scorable to find bug.	Ellen Spertus	2018-08-12	2	-19/+23
\| \|
\| *	Added back file I shouldn't have deleted.	Ellen Spertus	2018-08-12	1	-22/+0
\| \|
\| *	Tests pass.	Ellen Spertus	2018-08-12	1	-5/+6
\| \|
\| *	It compiles.	Ellen Spertus	2018-08-11	3	-42/+73
\| \|
\| *	Tests pass. Still have changes to do but made huge progress.	Ellen Spertus	2018-08-10	2	-55/+27
\| \|
\| *	It compiles	Ellen Spertus	2018-08-10	4	-31/+43
\| \|
\| *	Broken code to share with Bryan.	Ellen Spertus	2018-08-09	5	-8/+90
\| \|
\| *	WIP	Ellen Spertus	2018-08-09	4	-5/+226
\| \|
\| *	WIP	Ellen Spertus	2018-08-09	4	-13/+21
\| \|
\| *	Removed implicit parameters. Does not compile.	Ellen Spertus	2018-08-09	4	-10/+9
\| \|
\| *	WIP	Ellen Spertus	2018-08-09	4	-18/+46
\| \|
\| *	Fixed scalastyle violations.	Ellen Spertus	2018-08-09	4	-18/+14
\| \|
\| *	Added test for null argument to titleToSlug()	Ellen Spertus	2018-08-09	1	-4/+9
\| \|
\| *	Removed HBaseCrossrefScore{Job,Test} and references thereto.	Ellen Spertus	2018-08-07	2	-219/+5
\| \|
\| *	Added punctuation removal to slug creation and similarity comparisons	Ellen Spertus	2018-08-07	2	-2/+9
\| \|
\| *	Added GrobidScorableTest, minor improvements.	Ellen Spertus	2018-08-07	2	-10/+33
\| \|