diff options
| author | Bryan Newbold <bnewbold@archive.org> | 2018-05-17 17:28:26 -0700 |
|---|---|---|
| committer | Bryan Newbold <bnewbold@archive.org> | 2018-05-17 17:28:26 -0700 |
| commit | b18c68c81b4c426b5d83f2e6c31026b9febcb6e0 (patch) | |
| tree | 135ada52f316064648a2dc8ddb0104bf836caa5d | |
| parent | 18a55d37a87d4391bd8161201c523dd7d7f0f1e7 (diff) | |
| download | sandcrawler-b18c68c81b4c426b5d83f2e6c31026b9febcb6e0.tar.gz sandcrawler-b18c68c81b4c426b5d83f2e6c31026b9febcb6e0.zip | |
jvm/scala/scalding setup notes
| -rw-r--r-- | jvm-mapreduce/TODO | 16 |
1 files changed, 16 insertions, 0 deletions
diff --git a/jvm-mapreduce/TODO b/jvm-mapreduce/TODO new file mode 100644 index 0000000..46b3b15 --- /dev/null +++ b/jvm-mapreduce/TODO @@ -0,0 +1,16 @@ + +Libraries: +- sbt? or gradle? (build tool) + => debian packages: https://www.scala-sbt.org/download.html + (or just a single .deb...) +- scalding (mapreduce framework) +- scala (java also fine?) + => will scala work with java 1.7? + => scala 2.11 (~2014) works with java 7; scala 2.12 and up require 8 + => debian stretch: scala 2.11.8-1 + => ubuntu xenial: scala/xenial 2.11.6-6 + => "Scalding works with Scala 2.10 and 2.11 is recommended" +- testing +- hbase connector library + => maybe spyglass? +- hbase mock |