aboutsummaryrefslogtreecommitdiffstats
diff options
context:
space:
mode:
authorMartin Czygan <martin.czygan@gmail.com>2021-07-19 19:49:43 +0200
committerMartin Czygan <martin.czygan@gmail.com>2021-07-19 19:49:43 +0200
commitf1542ba4d5ee7e6cd63e1de3a393e4cd591f72f1 (patch)
tree497be02af90bed9272d31a91db3880562c920006
parent03a2119d0b6f0a7a76194c1aaa074b218bc90a2f (diff)
downloadrefcat-f1542ba4d5ee7e6cd63e1de3a393e4cd591f72f1.tar.gz
refcat-f1542ba4d5ee7e6cd63e1de3a393e4cd591f72f1.zip
update notes on es indexing
-rw-r--r--notes/es-indexing.md11
1 files changed, 11 insertions, 0 deletions
diff --git a/notes/es-indexing.md b/notes/es-indexing.md
index 61c192e..7d8419a 100644
--- a/notes/es-indexing.md
+++ b/notes/es-indexing.md
@@ -40,6 +40,17 @@ Watch indexing:
watch -n 10 'curl -s localhost:9200/_cat/indices | grep fatcat_ref_v02_20210716'
+Indexing time:
+
+ real 1599m7.314s
+ user 1926m34.791s
+ sys 169m16.626s
+
+ $ curl -s localhost:9200/_cat/indices | grep fatcat_ref_v02_20210716
+ green open fatcat_ref_v02_20210716 Cg-LNym9Q6OPUKJekNPCPw 6 0 1865637767 0 435.7gb 435.7gb
+
+After 26h, indexing completed; only unique edges in the dataset; size: 435G.
+
## 2021-04-12
Reduced `number_of_shards` from 12 to 6.