aboutsummaryrefslogtreecommitdiffstats
path: root/scald-mvp/README.md
diff options
context:
space:
mode:
Diffstat (limited to 'scald-mvp/README.md')
-rw-r--r--scald-mvp/README.md13
1 files changed, 13 insertions, 0 deletions
diff --git a/scald-mvp/README.md b/scald-mvp/README.md
index 7afcef8..e41e9ec 100644
--- a/scald-mvp/README.md
+++ b/scald-mvp/README.md
@@ -31,6 +31,19 @@ helpful for debugging dependency woes:
sbt dependencyTree
+testing the spyglass example program (expect a table error):
+
+ hadoop jar scald-mvp-assembly-0.1.0-SNAPSHOT.jar com.twitter.scalding.Tool example.SimpleHBaseSourceExample --hdfs --output hdfs:///user/bnewbold/spyglass_out_test --app.conf.path thing.conf --debug true
+ # org.apache.hadoop.hbase.TableNotFoundException: table_name
+
+running a spyglass job (gives a nullpointer exception):
+
+ hadoop jar scald-mvp-assembly-0.1.0-SNAPSHOT.jar com.twitter.scalding.Tool sandcrawler.HBaseRowCountJob --hdfs --output hdfs:///user/bnewbold/spyglass_out_test --app.conf.path thing.conf
+
+ # Caused by: java.lang.NullPointerException
+ # at parallelai.spyglass.hbase.HBaseSource.<init>(HBaseSource.scala:48)
+ # at sandcrawler.HBaseRowCountJob.<init>(HBaseRowCountJob.scala:17)
+
## Custom build
in SpyGlass repo: