aboutsummaryrefslogtreecommitdiffstats
Commit message (Expand)AuthorAgeFilesLines
* Added repository to find com.hadoop.gplcompression#hadoop-lzo;0.4.16.Ellen Spertus2018-05-221-0/+1
* more tests (failing)Bryan Newbold2018-05-222-1/+56
* update README with invocationsBryan Newbold2018-05-211-0/+13
* point SimpleHBaseSourceExample to actual zookeeper quorum hostBryan Newbold2018-05-211-1/+2
* another attempt at a simple job variationBryan Newbold2018-05-211-3/+16
* update HBaseRowCountJob based on Simple exampleBryan Newbold2018-05-211-10/+11
* spyglass/hbase test examples (from upstream)Bryan Newbold2018-05-212-0/+93
* deps updates: cdh libs, hbase, custom spyglassBryan Newbold2018-05-212-3/+7
* docs of how to munge around custom spyglass jarsBryan Newbold2018-05-211-0/+19
* add dependencyTree helper pluginBryan Newbold2018-05-212-1/+2
* building (but nullpointer) spyglass integrationBryan Newbold2018-05-212-3/+27
* more deps locationsBryan Newbold2018-05-211-0/+8
* gitignore for scalding directoryBryan Newbold2018-05-211-0/+3
* fix WordCountJob package; tests; hadoop versionBryan Newbold2018-05-213-2/+43
* WordCount -> WordCountJobBryan Newbold2018-05-213-13/+13
* success running with com.twitter.scalding.ToolBryan Newbold2018-05-212-4/+11
* remove main function; class name same as fileBryan Newbold2018-05-211-12/+1
* copy in jvm ecosystem notesBryan Newbold2018-05-211-0/+46
* copy in scalding learning exampleBryan Newbold2018-05-216-0/+93
* jvm/scala/scalding setup notesBryan Newbold2018-05-171-0/+16
* fix tests post-DISTINCTBryan Newbold2018-05-085-25/+30
* distinct on SHA1 in cdx scriptsBryan Newbold2018-05-082-6/+18
* pig cdx join improvementsBryan Newbold2018-05-081-1/+1
* how to run pig in productionBryan Newbold2018-05-081-0/+5
* WIP on filter-cdx-join-urls.pigBryan Newbold2018-05-071-0/+37
* Merge branch 'master' of git.archive.org:webgroup/sandcrawlerBryan Newbold2018-05-088-3/+139
|\
| * stale TODOBryan Newbold2018-05-071-0/+1
| * pig script to filter GWB CDX by SURT regexesBryan Newbold2018-05-076-0/+127
| * improve pig helperBryan Newbold2018-05-071-3/+11
* | actually fix oversize insertsBryan Newbold2018-05-081-7/+7
|/
* XML size limitBryan Newbold2018-04-261-0/+6
* force_existing flag for extractionBryan Newbold2018-04-191-1/+5
* NLineInputFormat requires RawProtocolBryan Newbold2018-04-191-1/+2
* local mrjob configBryan Newbold2018-04-191-0/+6
* switch to new (local) sentry instanceBryan Newbold2018-04-181-1/+1
* notes on attempted vinay setupBryan Newbold2018-04-182-1/+9
* start adding macOS instructionsBryan Newbold2018-04-161-0/+4
* update Pipfile.lock (new pluggy)Bryan Newbold2018-04-161-59/+64
* use NLineInputFormat so we can control split sizeBryan Newbold2018-04-111-0/+1
* revert PYTHONPATH in cmdenvBryan Newbold2018-04-111-1/+2
* Merge branch 'bnewbold-sentry'Bryan Newbold2018-04-104-19/+31
|\
| * prototype sentry integrationBryan Newbold2018-04-104-19/+31
* | don't try to decode GROBID outputBryan Newbold2018-04-111-2/+2
|/
* partially lint extraction_cdx_grobid.pyBryan Newbold2018-04-101-8/+6
* yet more test improvementsBryan Newbold2018-04-102-9/+61
* cleanup tests; add one for double-processingBryan Newbold2018-04-102-20/+43
* TODO updatesBryan Newbold2018-04-103-18/+3
* wayback 404 testBryan Newbold2018-04-102-5/+49
* extraction test fixesBryan Newbold2018-04-102-27/+50
* grobid2json test fixesBryan Newbold2018-04-102-1/+3
generated by cgit v1.2.3 (git 2.39.1) at 2024-11-28 20:23:46 +0000