aboutsummaryrefslogtreecommitdiffstats
diff options
context:
space:
mode:
authorBryan Newbold <bnewbold@archive.org>2018-05-23 12:56:27 -0700
committerBryan Newbold <bnewbold@archive.org>2018-05-24 00:02:36 -0700
commit62bfc9d5f40ccd690b4b070d64d046fb6b1e3e8a (patch)
treef0bfa7171a2e2d5a1a290f58b5039c7b03c54769
parent84f8937002e99025701d7b4a75fff95f78aedb16 (diff)
downloadsandcrawler-62bfc9d5f40ccd690b4b070d64d046fb6b1e3e8a.tar.gz
sandcrawler-62bfc9d5f40ccd690b4b070d64d046fb6b1e3e8a.zip
update version and project name
-rw-r--r--scalding/README.md4
-rw-r--r--scalding/build.sbt4
-rw-r--r--scalding/scalding-background.md2
3 files changed, 6 insertions, 4 deletions
diff --git a/scalding/README.md b/scalding/README.md
index 7f87fe0..9df06a6 100644
--- a/scalding/README.md
+++ b/scalding/README.md
@@ -18,12 +18,12 @@ Run tests:
Build a jar and upload to a cluster machine (from which to run in production):
sbt assembly
- scp scp target/scala-2.11/scald-mvp-assembly-0.1.0-SNAPSHOT.jar devbox:
+ scp target/scala-2.11/sandcrawler-assembly-0.2.0-SNAPSHOT.jar devbox:
Run on cluster:
devbox$ touch thing.conf
- devbox$ hadoop jar scald-mvp-assembly-0.1.0-SNAPSHOT.jar \
+ devbox$ hadoop jar sandcrawler-assembly-0.2.0-SNAPSHOT.jar \
com.twitter.scalding.Tool sandcrawler.HBaseRowCountJob --hdfs \
--app.conf.path thing.conf \
--output hdfs:///user/bnewbold/spyglass_out_test
diff --git a/scalding/build.sbt b/scalding/build.sbt
index 073315f..1a90168 100644
--- a/scalding/build.sbt
+++ b/scalding/build.sbt
@@ -9,11 +9,11 @@ lazy val root = (project in file(".")).
inThisBuild(List(
organization := "org.archive",
scalaVersion := "2.11.8",
- version := "0.1.0-SNAPSHOT",
+ version := "0.2.0-SNAPSHOT",
test in assembly := {},
)),
- name := "scald-mvp",
+ name := "sandcrawler",
resolvers += "conjars.org" at "http://conjars.org/repo",
resolvers += "Apache HBase" at "https://repository.apache.org/content/repositories/releases",
diff --git a/scalding/scalding-background.md b/scalding/scalding-background.md
index f57022b..99b363a 100644
--- a/scalding/scalding-background.md
+++ b/scalding/scalding-background.md
@@ -3,6 +3,8 @@
`.scala` file names should match internal classes.
+This project used to be called `scald-mvp`; now it's `sandcrawler`.
+
## Dev Environment
Versions running on Bryan's Debian/Linux laptop: