diff options
| author | Bryan Newbold <bnewbold@archive.org> | 2018-08-20 19:14:41 -0700 |
|---|---|---|
| committer | Bryan Newbold <bnewbold@archive.org> | 2018-08-21 21:25:56 -0700 |
| commit | f5c52210aa331b329cd36dbd711977b065a70eb2 (patch) | |
| tree | dea837626286f69950516f170a061232a3282be0 | |
| parent | cce6047bdcf979729ec286d4c1f37676aeff2707 (diff) | |
| download | sandcrawler-f5c52210aa331b329cd36dbd711977b065a70eb2.tar.gz sandcrawler-f5c52210aa331b329cd36dbd711977b065a70eb2.zip | |
HDFS doesn't like colons
| -rwxr-xr-x | please | 2 |
1 files changed, 1 insertions, 1 deletions
@@ -194,7 +194,7 @@ def run_colcount(args): HDFS_DIR, args.env, datetime.strftime(datetime.now(), "%Y-%m-%d-%H%M.%S"), - args.column) + args.column.replace(':', '_')) cmd = """hadoop jar \ scalding/target/scala-2.11/sandcrawler-assembly-0.2.0-SNAPSHOT.jar \ com.twitter.scalding.Tool sandcrawler.HBaseColCountJob \ |