aboutsummaryrefslogtreecommitdiffstats
path: root/scald-mvp
diff options
context:
space:
mode:
authorBryan Newbold <bnewbold@archive.org>2018-05-21 11:59:14 -0700
committerBryan Newbold <bnewbold@archive.org>2018-05-21 11:59:14 -0700
commitca8c5dedea7907cf26ec63309f4e99030e644351 (patch)
tree08c944c1cd0ed90d10a5171bbb56d89e82be53d9 /scald-mvp
parent53c2b11d4d234d933742651051ef57ca3c145382 (diff)
downloadsandcrawler-ca8c5dedea7907cf26ec63309f4e99030e644351.tar.gz
sandcrawler-ca8c5dedea7907cf26ec63309f4e99030e644351.zip
success running with com.twitter.scalding.Tool
Diffstat (limited to 'scald-mvp')
-rw-r--r--scald-mvp/README.md6
1 files changed, 2 insertions, 4 deletions
diff --git a/scald-mvp/README.md b/scald-mvp/README.md
index 10cac0f..dfa2bca 100644
--- a/scald-mvp/README.md
+++ b/scald-mvp/README.md
@@ -23,8 +23,6 @@ running on my laptop:
# on cluster:
yarn jar scald-mvp-assembly-0.1.0-SNAPSHOT.jar WordCount --hdfs --input hdfs:///user/bnewbold/dummy.txt
-## ATTIC
+later, using hadop command instead:
-wrote build.sbt from scratch
-
-`sbt` command from `twitter/scalding` upstream repo
+ hadoop jar scald-mvp-assembly-0.1.0-SNAPSHOT.jar com.twitter.scalding.Tool example.WordCount --hdfs --input hdfs:///user/bnewbold/dummy.txt --output hdfs:///user/bnewbold/test_scalding_out2