diff options
author | Bryan Newbold <bnewbold@archive.org> | 2018-04-18 22:13:48 -0700 |
---|---|---|
committer | Bryan Newbold <bnewbold@archive.org> | 2018-04-18 22:13:48 -0700 |
commit | a0f08d71092fee41802b435386bc7a1558ce6a5a (patch) | |
tree | e7d5c831d1f4d436fee777c99f6cbe67b91d5b0a | |
parent | e762cdd3e0825b966cbab8c57135941209f68dcb (diff) | |
download | sandcrawler-a0f08d71092fee41802b435386bc7a1558ce6a5a.tar.gz sandcrawler-a0f08d71092fee41802b435386bc7a1558ce6a5a.zip |
notes on attempted vinay setup
-rw-r--r-- | README.md | 8 | ||||
-rw-r--r-- | TODO | 2 |
2 files changed, 9 insertions, 1 deletions
@@ -20,7 +20,7 @@ Pretty much everything here uses python/pipenv. To setup your environment for this, and python in general: # libjpeg-dev is for some wayback/pillow stuff - sudo apt install python3-dev python3-pip python3-wheel libjpeg-dev + sudo apt install -y python3-dev python3-pip python3-wheel libjpeg-dev build-essentials pip3 install --user pipenv On macOS: @@ -29,5 +29,11 @@ On macOS: Each directory has it's own environment. Do something like: + cd mapreduce pipenv install --dev pipenv shell + +## Possible Issues with Setup + +Bryan had `~/.local/bin` in his `$PATH`, and that seemed to make everything +work. @@ -1,4 +1,6 @@ +- play with test image on older releases (eg, trusty) + - how to get argument (like --hbase-table) into mrjob.conf, or similar? - fix pig gitlab-ci tests (JAVA_HOME). also make fetch_deps *way* more quiet - sentry: https://github.com/getsentry/raven-python |