diff options
| author | Bryan Newbold <bnewbold@robocracy.org> | 2019-01-25 18:41:33 -0800 |
|---|---|---|
| committer | Bryan Newbold <bnewbold@robocracy.org> | 2019-01-25 18:41:33 -0800 |
| commit | f6f7450903bdbe36bd5fff146b942e34ad221557 (patch) | |
| tree | c50332c832f414b5c0070e58a42ceb4751ed4d81 /extra/elasticsearch/README.md | |
| parent | 16256f8ed119c072c09b13b0b1a6d4a56bed5113 (diff) | |
| download | fatcat-f6f7450903bdbe36bd5fff146b942e34ad221557.tar.gz fatcat-f6f7450903bdbe36bd5fff146b942e34ad221557.zip | |
transform and import fixes/tweaks
Diffstat (limited to 'extra/elasticsearch/README.md')
| -rw-r--r-- | extra/elasticsearch/README.md | 16 |
1 files changed, 10 insertions, 6 deletions
diff --git a/extra/elasticsearch/README.md b/extra/elasticsearch/README.md index 761ad6ab..691c6ed5 100644 --- a/extra/elasticsearch/README.md +++ b/extra/elasticsearch/README.md @@ -38,13 +38,17 @@ There is a Dockerfile in this directory which includes this installation. Drop and rebuild the schema: - http delete :9200/fatcat - http put :9200/fatcat < release_schema.json + http delete :9200/fatcat_release + http delete :9200/fatcat_container + http delete :9200/fatcat_changelog + http put :9200/fatcat_release < release_schema.json + http put :9200/fatcat_container < container_schema.json + http put :9200/fatcat_changelog < changelog_schema.json Put a single object (good for debugging): - head -n1 examples.json | http post :9200/fatcat/release/0 - http get :9200/fatcat/release/0 + head -n1 examples.json | http post :9200/fatcat_release/release/0 + http get :9200/fatcat_release/release/0 Bulk insert from a file on disk: @@ -53,14 +57,14 @@ Bulk insert from a file on disk: Or, in a bulk production live-stream conversion: export LC_ALL=C.UTF-8 - time zcat /srv/fatcat/snapshots/fatcat_release_dump_expanded.json.gz | ./fatcat_export.py transform-releases - - | esbulk -verbose -size 20000 -id ident -w 8 -index fatcat -type release + time zcat /srv/fatcat_release/snapshots/fatcat_release_dump_expanded.json.gz | ./fatcat_export.py transform-releases - - | esbulk -verbose -size 20000 -id ident -w 8 -index fatcat -type release ## Full-Text Querying A generic full-text "query string" query look like this (replace "blood" with actual query string, and "size" field with the max results to return): - GET /fatcat/release/_search + GET /fatcat_release/release/_search { "query": { "query_string": { |