sandcrawler/scald-mvp/src, branch master [no description] https://git.bnewbold.net/sandcrawler/atom?h=master 2018-05-24T07:02:36+00:00 rename jvm/scalding directories 2018-05-24T07:02:36+00:00 Bryan Newbold bnewbold@archive.org 2018-05-23T19:27:59+00:00 urn:sha1:4ba428db30593b67283dd90b92141f99840dc78e fix up HBaseRowCountTest 2018-05-24T07:02:36+00:00 Bryan Newbold bnewbold@archive.org 2018-05-22T23:37:21+00:00 urn:sha1:29e4a83ff76da07bc6ad5d3f49d746ee0bc72023 Again, seems like test fixture must match *exactly* or very obscure errors crop up. get quorum fields to match, fixing test 2018-05-24T07:02:36+00:00 Bryan Newbold bnewbold@archive.org 2018-05-22T23:21:51+00:00 urn:sha1:58447ff883db0331bfd2450b8607ba332f53b3b6 Writing this commit message in anger: It seems that the HBaseSource must match exactly between the instantiated Job class and the JobTest. The error when this isn't the case is very obscure: a `None.get()` exception deep in SpyGlass internals. Blech. This may or may not explain other test failure issues. more tests (failing) 2018-05-22T19:07:01+00:00 Bryan Newbold bnewbold@archive.org 2018-05-22T19:07:01+00:00 urn:sha1:a5a3df30bad2250b4f50e6234dc810efaeaceb2f point SimpleHBaseSourceExample to actual zookeeper quorum host 2018-05-22T02:19:14+00:00 Bryan Newbold bnewbold@archive.org 2018-05-22T02:19:14+00:00 urn:sha1:3b64d9c4f852b29964eca0e215d636bc37f0d856 another attempt at a simple job variation 2018-05-22T02:18:52+00:00 Bryan Newbold bnewbold@archive.org 2018-05-22T02:18:52+00:00 urn:sha1:aafec7a8307342479cacfc5aa6a794068b799823 update HBaseRowCountJob based on Simple example 2018-05-22T01:51:46+00:00 Bryan Newbold bnewbold@archive.org 2018-05-22T01:51:46+00:00 urn:sha1:e906399e4bb54bfe5a2124bd13aa78733bcac03b spyglass/hbase test examples (from upstream) 2018-05-22T01:36:43+00:00 Bryan Newbold bnewbold@archive.org 2018-05-22T01:36:43+00:00 urn:sha1:b2c59428fec807ef4dbe4cedcec3614154334817 building (but nullpointer) spyglass integration 2018-05-22T00:51:43+00:00 Bryan Newbold bnewbold@archive.org 2018-05-22T00:51:43+00:00 urn:sha1:4ebb3f83cc1a438abe2af0d79e6e55c83fdb431d fix WordCountJob package; tests; hadoop version 2018-05-21T19:25:16+00:00 Bryan Newbold bnewbold@archive.org 2018-05-21T19:25:13+00:00 urn:sha1:e517b2dd05d29e36b62b3ddfff4537cb980928f0 When copying from upstream scalding, forgot to change the path/namespace of the WordCountJob. Production IA cluster is actually running Hadoop 2.5, not 2.6 (I keep forgetting). Pull in more dependencies so test runs (copied from scalding repo, only changed the namespace of the job)