move HBase schema and notes from journal-infra repo

1 files changed, 28 insertions, 0 deletions

diff --git a/hbase/howto.md b/hbase/howto.md
new file mode 100644
index 0000000..fcf561f
--- /dev/null
+++ b/hbase/howto.md
@@ -0,0 +1,28 @@
+
+Commands can be run from any cluster machine with hadoop environment config
+set up. Most of these commands are run from the shell (start with `hbase
+shell`). There is only one AIT/Webgroup HBase instance/namespace; there may be
+QA/prod tables, but there are not QA/prod clusters.
+
+## Create Table
+
+Create column families (note: not all individual columns) with something like:
+
+    create 'wbgrp-journal-extract-0-qa', 'f', 'file', {NAME => 'grobid0', COMPRESSION => 'snappy'}
+
+## Run Thrift Server Informally
+
+The Thrift server can technically be run from any old cluster machine that has
+Hadoop client stuff set up, using:
+
+    hbase thrift start -nonblocking -c
+
+Note that this will run version 0.96, while the actual HBase service seems to
+be running 0.98.
+
+To interact with this config, use happybase (python) config:
+
+    conn = happybase.Connection("bnewbold-dev.us.archive.org", transport="framed", protocol="compact")
+    # Test connection
+    conn.tables()
+