aboutsummaryrefslogtreecommitdiffstats
diff options
context:
space:
mode:
authorBryan Newbold <bnewbold@archive.org>2018-04-18 22:13:48 -0700
committerBryan Newbold <bnewbold@archive.org>2018-04-18 22:13:48 -0700
commita0f08d71092fee41802b435386bc7a1558ce6a5a (patch)
treee7d5c831d1f4d436fee777c99f6cbe67b91d5b0a
parente762cdd3e0825b966cbab8c57135941209f68dcb (diff)
downloadsandcrawler-a0f08d71092fee41802b435386bc7a1558ce6a5a.tar.gz
sandcrawler-a0f08d71092fee41802b435386bc7a1558ce6a5a.zip
notes on attempted vinay setup
-rw-r--r--README.md8
-rw-r--r--TODO2
2 files changed, 9 insertions, 1 deletions
diff --git a/README.md b/README.md
index 20c834b..90bfd75 100644
--- a/README.md
+++ b/README.md
@@ -20,7 +20,7 @@ Pretty much everything here uses python/pipenv. To setup your environment for
this, and python in general:
# libjpeg-dev is for some wayback/pillow stuff
- sudo apt install python3-dev python3-pip python3-wheel libjpeg-dev
+ sudo apt install -y python3-dev python3-pip python3-wheel libjpeg-dev build-essentials
pip3 install --user pipenv
On macOS:
@@ -29,5 +29,11 @@ On macOS:
Each directory has it's own environment. Do something like:
+ cd mapreduce
pipenv install --dev
pipenv shell
+
+## Possible Issues with Setup
+
+Bryan had `~/.local/bin` in his `$PATH`, and that seemed to make everything
+work.
diff --git a/TODO b/TODO
index c52ab17..1d88140 100644
--- a/TODO
+++ b/TODO
@@ -1,4 +1,6 @@
+- play with test image on older releases (eg, trusty)
+
- how to get argument (like --hbase-table) into mrjob.conf, or similar?
- fix pig gitlab-ci tests (JAVA_HOME). also make fetch_deps *way* more quiet
- sentry: https://github.com/getsentry/raven-python