aboutsummaryrefslogtreecommitdiffstats
path: root/jvm-mapreduce
diff options
context:
space:
mode:
authorBryan Newbold <bnewbold@archive.org>2018-05-17 17:28:26 -0700
committerBryan Newbold <bnewbold@archive.org>2018-05-17 17:28:26 -0700
commitb18c68c81b4c426b5d83f2e6c31026b9febcb6e0 (patch)
tree135ada52f316064648a2dc8ddb0104bf836caa5d /jvm-mapreduce
parent18a55d37a87d4391bd8161201c523dd7d7f0f1e7 (diff)
downloadsandcrawler-b18c68c81b4c426b5d83f2e6c31026b9febcb6e0.tar.gz
sandcrawler-b18c68c81b4c426b5d83f2e6c31026b9febcb6e0.zip
jvm/scala/scalding setup notes
Diffstat (limited to 'jvm-mapreduce')
-rw-r--r--jvm-mapreduce/TODO16
1 files changed, 16 insertions, 0 deletions
diff --git a/jvm-mapreduce/TODO b/jvm-mapreduce/TODO
new file mode 100644
index 0000000..46b3b15
--- /dev/null
+++ b/jvm-mapreduce/TODO
@@ -0,0 +1,16 @@
+
+Libraries:
+- sbt? or gradle? (build tool)
+ => debian packages: https://www.scala-sbt.org/download.html
+ (or just a single .deb...)
+- scalding (mapreduce framework)
+- scala (java also fine?)
+ => will scala work with java 1.7?
+ => scala 2.11 (~2014) works with java 7; scala 2.12 and up require 8
+ => debian stretch: scala 2.11.8-1
+ => ubuntu xenial: scala/xenial 2.11.6-6
+ => "Scalding works with Scala 2.10 and 2.11 is recommended"
+- testing
+- hbase connector library
+ => maybe spyglass?
+- hbase mock