sandcrawler - [no description]

	Commit message (Collapse)	Author	Age	Files	Lines
...
\| *	python extraction_ungrobided job	Bryan Newbold	2018-08-24	3	-0/+288
\| \|
\| *	HOWTO some common hbase shell queries	Bryan Newbold	2018-08-24	1	-0/+14
\| \|
\| *	rename DumpUnGrobidedJob	Bryan Newbold	2018-08-24	2	-9/+9
\| \|
\| *	please support for DumpUnGrobidedJob	Bryan Newbold	2018-08-24	1	-0/+24
\| \|
\| *	scalding: UnGrobidedDumpJob	Bryan Newbold	2018-08-24	2	-0/+139
\| \|
* \|	crude job stats/metrics in a text file	Bryan Newbold	2018-08-27	1	-0/+95
\| \|
* \|	set CI LANG env variable	Bryan Newbold	2018-08-25	1	-0/+4
\| \|
* \|	switch Dockerfile to xenial	Bryan Newbold	2018-08-24	1	-1/+1
\|/ \| \| \|	To make CI environment reflect production.
*	clean up commented out code in scalding/	Bryan Newbold	2018-08-24	4	-23/+2
\|
*	Merge branch 'bnewbold-missing-column'	Bryan Newbold	2018-08-24	2	-0/+96
\|\ \| \| \| \| \| \| \| \| \| \|	Manually Resolved Conflicts: please
\| *	fixes to please keys-missing-col	Bryan Newbold	2018-08-21	1	-2/+2
\| \|
\| *	add please for keysmissingcolumn	Bryan Newbold	2018-08-21	1	-0/+29
\| \|
\| *	rewrite MissingColumnDumpJob as a join (sigh)	Bryan Newbold	2018-08-21	1	-29/+37
\| \|
\| *	WIP: MissingColumnDumpJob	Bryan Newbold	2018-08-21	1	-0/+59
\| \| \| \| \| \| \| \| \| \|	This version won't actually work because SpyGlass doesn't actually support SCAN filters (among other things)
* \|	more TODO	Bryan Newbold	2018-08-24	1	-0/+5
\| \|
* \|	update TODO	Bryan Newbold	2018-08-24	2	-13/+16
\| \|
* \|	move HBase schema and notes from journal-infra repo	Bryan Newbold	2018-08-24	3	-0/+331
\| \|
* \|	commit notes from my laptop	Bryan Newbold	2018-08-24	6	-0/+256
\| \|
* \|	move RFC/design-doc from journal-infra repo	Bryan Newbold	2018-08-24	1	-0/+180
\| \|
* \|	update READMEs	Bryan Newbold	2018-08-24	2	-43/+46
\| \|
* \|	clarify please docs	Bryan Newbold	2018-08-24	1	-2/+2
\| \|
* \|	update scalding README	Bryan Newbold	2018-08-24	1	-13/+23
\| \|
* \|	add un-commited scalding debug notes	Bryan Newbold	2018-08-24	1	-0/+26
\| \|
* \|	rename ./mapreduce to ./python	Bryan Newbold	2018-08-24	25	-7/+7
\| \|
* \|	gitignore match test output	Bryan Newbold	2018-08-24	1	-0/+1
\| \|
* \|	match results	Bryan Newbold	2018-08-24	1	-0/+13
\| \|
* \|	run please in CI, at least to check syntax	Bryan Newbold	2018-08-24	1	-0/+1
\| \|
* \|	fix merge typos in please	Bryan Newbold	2018-08-24	1	-2/+2
\| \|
* \|	Merge branch 'bnewbold-match-quality'	Bryan Newbold	2018-08-24	12	-27/+2125
\|\ \ \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	Manually resolved merge conflict in: please
\| * \|	start tracking benchmark results	Bryan Newbold	2018-08-24	1	-0/+17
\| \| \|
\| * \|	rework fetch_hadoop script	Bryan Newbold	2018-08-24	5	-27/+45
\| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	Should work on macOS now, and fetches hadoop in addition to pig. Still requires wget (not installed by default on macOS).
\| * \|	BibjsonScorable: fix ScorableFeatures (after rebase)	Bryan Newbold	2018-08-21	1	-1/+1
\| \| \|
\| * \|	please support for match-benchmark	Bryan Newbold	2018-08-21	1	-0/+26
\| \| \|
\| * \|	fix bug with qa/prod detection	Bryan Newbold	2018-08-21	1	-0/+1
\| \| \|
\| * \|	local bibjson-to-bibjson matching job (no tests)	Bryan Newbold	2018-08-21	1	-0/+29
\| \| \|
\| * \|	bibjson scorable class (no tests)	Bryan Newbold	2018-08-21	1	-0/+50
\| \| \|
\| * \|	add matching bibjson files	Bryan Newbold	2018-08-21	3	-0/+1956
\| \| \|
* \| \|	add counters to ScoreJob	Bryan Newbold	2018-08-24	1	-13/+47
\| \| \|
* \| \|	remove duplicate imports	Bryan Newbold	2018-08-24	1	-2/+0
\| \| \|
* \| \|	add a content-type filter for crossref works	Bryan Newbold	2018-08-23	2	-1/+26
\| \| \|
* \| \|	require crossref works to have at least one author (for matching)	Bryan Newbold	2018-08-23	2	-1/+7
\| \| \|
* \| \|	author parsing (and year, for crossref)	Bryan Newbold	2018-08-23	5	-7/+57
\| \| \|
* \| \|	set a minimum slug size (8 chars)	Bryan Newbold	2018-08-23	4	-15/+31
\| \| \|
* \| \|	clean up indendation in ScoreJob.scala	Bryan Newbold	2018-08-23	1	-5/+5
\| \| \|
* \| \|	clean up commented-out code in ScoreJob.scala	Bryan Newbold	2018-08-23	1	-30/+0
\| \| \|
* \| \|	increase MaxTitleLength from 255 to 1023	Bryan Newbold	2018-08-23	1	-1/+1
\| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	Motivated after finding some long titles with MathML mixed in. Until this issue can be investigated further, bumping this limit to pass the handful of matches found.
* \| \|	additions to slug blacklist	Bryan Newbold	2018-08-23	1	-383/+414
\| \| \|
* \| \|	Merge branch 'bnewbold-extraction-tweaks'	Bryan Newbold	2018-08-23	1	-4/+7
\|\ \ \
\| * \| \|	extraction: do want content, not text	Bryan Newbold	2018-08-21	1	-1/+1
\| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	XML can have non-unicode characters? Who knew.
\| * \| \|	extraction: status reporting tweaks	Bryan Newbold	2018-08-21	1	-5/+8
\| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \| \|	Improvements to how the extraction function in the extraction script reports status (in output, hbase, and counters)