diff options
| author | Bryan Newbold <bnewbold@archive.org> | 2018-08-24 12:05:39 -0700 |
|---|---|---|
| committer | Bryan Newbold <bnewbold@archive.org> | 2018-08-24 12:05:41 -0700 |
| commit | 92584ec4201ecc27af423cbff7b4bc1573edf175 (patch) | |
| tree | 416d1fae8bd82af1f470a1be25c8763da042a5e4 /pig/fetch_deps.sh | |
| parent | e81774a66980ba17c42380884f39aa61b54e5eef (diff) | |
| download | sandcrawler-92584ec4201ecc27af423cbff7b4bc1573edf175.tar.gz sandcrawler-92584ec4201ecc27af423cbff7b4bc1573edf175.zip | |
rework fetch_hadoop script
Should work on macOS now, and fetches hadoop in addition to pig. Still
requires wget (not installed by default on macOS).
Diffstat (limited to 'pig/fetch_deps.sh')
| -rwxr-xr-x | pig/fetch_deps.sh | 20 |
1 files changed, 0 insertions, 20 deletions
diff --git a/pig/fetch_deps.sh b/pig/fetch_deps.sh deleted file mode 100755 index 4cefa5e..0000000 --- a/pig/fetch_deps.sh +++ /dev/null @@ -1,20 +0,0 @@ -#!/usr/bin/env bash - -set -euo pipefail - -#PIG_VERSION="0.12.0-cdh5.2.0" -# Using more recent version to work around snappy classpath problem -PIG_VERSION="0.17.0" -JAVA_HOME=$(readlink -f /usr/bin/java | sed "s:bin/java::") - -mkdir -p deps/ -cd deps/ - -# Fetch Pig -#wget -c https://archive.cloudera.com/cdh5/cdh/5/pig-${PIG_VERSION}.tar.gz -#wget -c http://mirror.metrocast.net/apache/pig/pig-${PIG_VERSION}/pig-${PIG_VERSION}.tar.gz -wget -c https://archive.org/serve/hadoop_pig_mirror/pig-${PIG_VERSION}.tar.gz -tar xvf pig-${PIG_VERSION}.tar.gz -ln -fs pig-${PIG_VERSION} pig -./pig/bin/pig -x local -version - |