aboutsummaryrefslogtreecommitdiffstats
path: root/extra/elasticsearch
diff options
context:
space:
mode:
authorBryan Newbold <bnewbold@robocracy.org>2018-09-24 18:07:15 -0700
committerBryan Newbold <bnewbold@robocracy.org>2018-09-24 18:07:15 -0700
commitbf0c3399d3a80b32301a3554971a962478614692 (patch)
treecba3bc6b33c07880a63d023f4129c7dec515889d /extra/elasticsearch
parented78736b5d96a294c89b201c1d992bd30d809434 (diff)
downloadfatcat-bf0c3399d3a80b32301a3554971a962478614692.tar.gz
fatcat-bf0c3399d3a80b32301a3554971a962478614692.zip
script for partitioning dumps (needs test)
Diffstat (limited to 'extra/elasticsearch')
-rw-r--r--extra/elasticsearch/README.md1
1 files changed, 1 insertions, 0 deletions
diff --git a/extra/elasticsearch/README.md b/extra/elasticsearch/README.md
index 0d205903..8f4925aa 100644
--- a/extra/elasticsearch/README.md
+++ b/extra/elasticsearch/README.md
@@ -44,6 +44,7 @@ Bulk insert from a file on disk:
Or, in a bulk production live-stream conversion:
time zcat /srv/fatcat/snapshots/fatcat_release_dump_expanded.json.gz | ./transform_release.py | esbulk -verbose -size 20000 -id ident -w 8 -index fatcat-releases -type release
+ # 2018/09/24 21:42:26 53028167 docs in 1h0m56.853006293s at 14501.039 docs/s with 8 workers
## Full-Text Querying