diff options
| author | Kristian Kaufmann <kristianwkaufmann@gmail.com> | 2015-06-12 16:20:09 -0400 |
|---|---|---|
| committer | Kristian Kaufmann <kristianwkaufmann@gmail.com> | 2015-06-12 16:20:09 -0400 |
| commit | d9f59cf18afadb81b18c0d270948d82721d16cfb (patch) | |
| tree | ffb57477385df684c16bc3cd211cb74cea17c71a /src/main/java/parallelai/spyglass/hbase/HBaseOutputFormat.java | |
| parent | 4c1f607584fe923aa2a5de50d4b6ec59a58be85a (diff) | |
| download | SpyGlass-d9f59cf18afadb81b18c0d270948d82721d16cfb.tar.gz SpyGlass-d9f59cf18afadb81b18c0d270948d82721d16cfb.zip | |
Adds autoFlush setting to HbaseSource.
The setting defaults to true to reproduce current behavior
Diffstat (limited to 'src/main/java/parallelai/spyglass/hbase/HBaseOutputFormat.java')
| -rw-r--r-- | src/main/java/parallelai/spyglass/hbase/HBaseOutputFormat.java | 3 |
1 files changed, 1 insertions, 2 deletions
diff --git a/src/main/java/parallelai/spyglass/hbase/HBaseOutputFormat.java b/src/main/java/parallelai/spyglass/hbase/HBaseOutputFormat.java index 401dea0..2ad8924 100644 --- a/src/main/java/parallelai/spyglass/hbase/HBaseOutputFormat.java +++ b/src/main/java/parallelai/spyglass/hbase/HBaseOutputFormat.java @@ -51,8 +51,7 @@ FileOutputFormat<ImmutableBytesWritable, Put> implements JobConfigurable { LOG.error(e); throw e; } - // TODO: Should Autoflush be set to true ???? - DONE - table.setAutoFlush(true); + table.setAutoFlush(job.getBoolean(String.format(HBaseConstants.AUTO_FLUSH, tableName),false)); HBaseRecordWriter recordWriter = new HBaseRecordWriter(table); recordWriter.setSinkMode(sinkMode); return recordWriter; |