aboutsummaryrefslogtreecommitdiffstats
path: root/python
diff options
context:
space:
mode:
authorMartin Czygan <martin.czygan@gmail.com>2021-08-04 17:27:19 +0200
committerMartin Czygan <martin.czygan@gmail.com>2021-08-04 17:27:19 +0200
commit9f71dc1060e90bc3ab183c82a1098428e304c183 (patch)
tree8e98903da5a38395de8b5313d3921b2ec1f1fe5a /python
parent922ff2fce2e7bfe0a114e69021afa94eae71a858 (diff)
downloadrefcat-9f71dc1060e90bc3ab183c82a1098428e304c183.tar.gz
refcat-9f71dc1060e90bc3ab183c82a1098428e304c183.zip
update note
Diffstat (limited to 'python')
-rw-r--r--python/notes/version_4.md14
1 files changed, 14 insertions, 0 deletions
diff --git a/python/notes/version_4.md b/python/notes/version_4.md
index d56440d..52fad8b 100644
--- a/python/notes/version_4.md
+++ b/python/notes/version_4.md
@@ -950,3 +950,17 @@ Only a single thread; ssd tmp;
* total:1768min, about 30h
Performance headroom: run all mappers in one go; run tasks in parallel
+
+Indexing time, about 35h. So whole derivation about 3 days (30h+ for "BrefCombined" and 35h to index).
+
+```
+2021/08/04 09:56:57 [worker-5] @148044000
+2021/08/04 09:56:57 2077597833 docs in 127016.87s at 16356.865 docs/s with 14 workers
+2021/08/04 09:56:57 applied setting: {"index": {"refresh_interval": "1s"}} with status 200 OK
+2021/08/04 09:56:57 applied setting: {"index": {"number_of_replicas": "0"}} with status 200 OK
+2021/08/04 09:56:58 index flushed: 200 OK
+
+real 2116m57.951s
+user 2193m20.229s
+sys 268m34.241s
+```