diff options
author | Bryan Newbold <bnewbold@archive.org> | 2018-04-07 00:55:02 +0000 |
---|---|---|
committer | Bryan Newbold <bnewbold@archive.org> | 2018-04-07 00:55:02 +0000 |
commit | 683844f6bb26d867ea6bd2fd89d7669ace45075a (patch) | |
tree | f013ac467116f5982409bf2a05eb4bf354dafecf /TODO | |
parent | 1b7f579a881777a8e6fe517e9ee860ff875fe51f (diff) | |
download | sandcrawler-683844f6bb26d867ea6bd2fd89d7669ace45075a.tar.gz sandcrawler-683844f6bb26d867ea6bd2fd89d7669ace45075a.zip |
configs and README updates
Diffstat (limited to 'TODO')
-rw-r--r-- | TODO | 1 |
1 files changed, 1 insertions, 0 deletions
@@ -3,6 +3,7 @@ Will probably eventually refactor into top-level plus modules. Eg, "common" directory, "backfill" and "extraction" as sub-directories. Downside of this is single giant pipenv venv with all dependencies? +- how to get argument (like --hbase-table) into mrjob.conf, or similar? - fix pig gitlab-ci tests (JAVA_HOME). also make fetch_deps *way* more quiet sentry: |