diff options
| author | Bryan Newbold <bnewbold@robocracy.org> | 2018-09-24 18:07:15 -0700 |
|---|---|---|
| committer | Bryan Newbold <bnewbold@robocracy.org> | 2018-09-24 18:07:15 -0700 |
| commit | bf0c3399d3a80b32301a3554971a962478614692 (patch) | |
| tree | cba3bc6b33c07880a63d023f4129c7dec515889d /extra/elasticsearch | |
| parent | ed78736b5d96a294c89b201c1d992bd30d809434 (diff) | |
| download | fatcat-bf0c3399d3a80b32301a3554971a962478614692.tar.gz fatcat-bf0c3399d3a80b32301a3554971a962478614692.zip | |
script for partitioning dumps (needs test)
Diffstat (limited to 'extra/elasticsearch')
| -rw-r--r-- | extra/elasticsearch/README.md | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/extra/elasticsearch/README.md b/extra/elasticsearch/README.md index 0d205903..8f4925aa 100644 --- a/extra/elasticsearch/README.md +++ b/extra/elasticsearch/README.md @@ -44,6 +44,7 @@ Bulk insert from a file on disk: Or, in a bulk production live-stream conversion: time zcat /srv/fatcat/snapshots/fatcat_release_dump_expanded.json.gz | ./transform_release.py | esbulk -verbose -size 20000 -id ident -w 8 -index fatcat-releases -type release + # 2018/09/24 21:42:26 53028167 docs in 1h0m56.853006293s at 14501.039 docs/s with 8 workers ## Full-Text Querying |