From ed00bfffeac7b731f4edeaa4e283a3a09dcd2ee2 Mon Sep 17 00:00:00 2001 From: Bryan Newbold Date: Mon, 21 May 2018 18:34:51 -0700 Subject: docs of how to munge around custom spyglass jars --- scald-mvp/README.md | 19 +++++++++++++++++++ 1 file changed, 19 insertions(+) diff --git a/scald-mvp/README.md b/scald-mvp/README.md index 6c7ec76..31c174b 100644 --- a/scald-mvp/README.md +++ b/scald-mvp/README.md @@ -26,3 +26,22 @@ running on my laptop: later, using hadop command instead: hadoop jar scald-mvp-assembly-0.1.0-SNAPSHOT.jar com.twitter.scalding.Tool example.WordCountJob --hdfs --input hdfs:///user/bnewbold/dummy.txt --output hdfs:///user/bnewbold/test_scalding_out3 + +helpful for debugging dependency woes: + + sbt dependencyTree + +## Custom build + +in SpyGlass repo: + + # This builds the new .jar and installs it in the (laptop local) ~/.m2 + # repository + mvn clean install -U + + # Copy that .jar (and associated pom.xml) over to where sbt can find it + mkdir -p ~/.sbt/preloaded/parallelai/ + cp -r ~/.m2/repository/parallelai/parallelai.spyglass ~/.sbt/preloaded/parallelai/ + + # then build here + sbt assembly -- cgit v1.2.3