From 076d44fa40ce93cb6cc14fa600f91f4c9ef5d1e1 Mon Sep 17 00:00:00 2001 From: Ellen Spertus Date: Thu, 31 May 2018 19:12:49 +0000 Subject: Added tip on OutOfMemoryError. --- scalding/README.md | 6 +++++- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/scalding/README.md b/scalding/README.md index 9df06a6..13c2e1a 100644 --- a/scalding/README.md +++ b/scalding/README.md @@ -1,4 +1,3 @@ - This directory contains Hadoop map/reduce jobs written in Scala (compiled to the JVM) using the Scalding framework. @@ -27,6 +26,11 @@ Run on cluster: com.twitter.scalding.Tool sandcrawler.HBaseRowCountJob --hdfs \ --app.conf.path thing.conf \ --output hdfs:///user/bnewbold/spyglass_out_test + +If your `sbt` task fails with this error: + + java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Metaspace +try restarting `sbt` with more memory (e.g., `sbt -mem 2048`). ## Building SpyGlass Jar -- cgit v1.2.3