aboutsummaryrefslogtreecommitdiffstats
path: root/pig/README.md
blob: c5185915147450de18c1cadfaecb9600afbb676c (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28

As of March 2018, the archive runs Pig version 0.12.0, via CDH5.0.1 (Cloudera
Distribution).

## Development and Testing

To run pig in development on your laptop, you can either use docker or 

https://hub.docker.com/r/chalimartines/local-pig

    wget https://archive.cloudera.com/cdh5/cdh/5/pig-0.12.0-cdh5.0.1.tar.gz
    tar xvf pig-*.tar.gz
    ln -s pig-0.12.0-cdh5.0.1/pig-0.12.0-cdh5.0.1.jar pig-0.12.0-cdh5.0.1/pig.jar
    ./pig-*/bin/pig -x local -version

    #XXX: don't need Hadoop?
    #wget https://archive.cloudera.com/cdh5/cdh/5/hadoop-2.3.0-cdh5.0.1.tar.gz
    #tar xvf hadoop-*.tar.gz
    #export HADOOP_HOME=hadoop-2.3*

Tests require python3, nosetests3, and pigpy. You can install these with:

    pip install pipenv
    pipenv install --three

Then:

    pipenv run nosetests3