diff options
| author | Bryan Newbold <bnewbold@archive.org> | 2018-05-30 19:40:05 -0700 |
|---|---|---|
| committer | Bryan Newbold <bnewbold@archive.org> | 2018-06-04 12:42:29 -0700 |
| commit | d2dd016aa8da93ad14654237dbb7cfac214f9da8 (patch) | |
| tree | 678e1ec0014a07fd4942d637e5bb4fb7b348c349 | |
| parent | 8e3a5ba6f3bdfad32e9bfefeebcb85bbe254cbc9 (diff) | |
| download | sandcrawler-d2dd016aa8da93ad14654237dbb7cfac214f9da8.tar.gz sandcrawler-d2dd016aa8da93ad14654237dbb7cfac214f9da8.zip | |
bnewbold-dev > wbgrp-svc263
This is a new production VM running an HBase-Thrift gateway
| -rw-r--r-- | mapreduce/README.md | 8 |
1 files changed, 4 insertions, 4 deletions
diff --git a/mapreduce/README.md b/mapreduce/README.md index ed4067e..b63e84b 100644 --- a/mapreduce/README.md +++ b/mapreduce/README.md @@ -26,7 +26,7 @@ running on a devbox and GROBID running on a dedicated machine: ./extraction_cdx_grobid.py \ --hbase-table wbgrp-journal-extract-0-qa \ - --hbase-host bnewbold-dev.us.archive.org \ + --hbase-host wbgrp-svc263.us.archive.org \ --grobid-uri http://wbgrp-svc096.us.archive.org:8070 \ tests/files/example.cdx @@ -39,7 +39,7 @@ Running from the cluster: ./extraction_cdx_grobid.py \ --hbase-table wbgrp-journal-extract-0-qa \ - --hbase-host bnewbold-dev.us.archive.org \ + --hbase-host wbgrp-svc263.us.archive.org \ --grobid-uri http://wbgrp-svc096.us.archive.org:8070 \ -r hadoop \ -c mrjob.conf \ @@ -53,7 +53,7 @@ running on a devbox: ./backfill_hbase_from_cdx.py \ --hbase-table wbgrp-journal-extract-0-qa \ - --hbase-host bnewbold-dev.us.archive.org \ + --hbase-host wbgrp-svc263.us.archive.org \ tests/files/example.cdx Actual invocation to run on Hadoop cluster (running on an IA devbox, where @@ -65,7 +65,7 @@ hadoop environment is configured): tar -czf $VENVSHORT.tar.gz -C /home/bnewbold/.local/share/virtualenvs/$VENVSHORT . ./backfill_hbase_from_cdx.py \ - --hbase-host bnewbold-dev.us.archive.org \ + --hbase-host wbgrp-svc263.us.archive.org \ --hbase-table wbgrp-journal-extract-0-qa \ -r hadoop \ -c mrjob.conf \ |