fatcat-scholar/schema, branch x-attic-rescore Unnamed repository; edit this file 'description' to name the repository. https://git.bnewbold.net/fatcat-scholar/atom?h=x-attic-rescore 2020-08-07T02:01:12+00:00 ES schema: access_type should be any option, not just 'best' 2020-08-07T02:01:12+00:00 Bryan Newbold bnewbold@archive.org 2020-08-06T23:10:19+00:00 urn:sha1:dd96b7906e417dd74081e508aaabfebaeac5ece1 enable index_phrases on everything, biblio_all, title_all 2020-08-06T19:33:01+00:00 Bryan Newbold bnewbold@archive.org 2020-08-06T19:32:59+00:00 urn:sha1:b33f69d92dbdfbf1be15521bf1893c053765a580 Want phrase queries to be faster. Expect this to increase term index size, requiring more disk space. ES schema: do not index fulltext.body or fulltext.annex separately from 'everything' 2020-08-06T19:32:09+00:00 Bryan Newbold bnewbold@archive.org 2020-08-06T19:31:53+00:00 urn:sha1:8611d4cfd348b57120f936c064e9591c419a7ace The goal here is to reduce term index size. This means that querying/matching only on these fields (distinct from "everything") will not work. ES schema: use smaller integer size (short) for most numbers 2020-08-06T19:31:10+00:00 Bryan Newbold bnewbold@archive.org 2020-08-06T19:31:10+00:00 urn:sha1:8b5a78cd13ebfe5843bb0f04839afde69e09bb59 ES schema: copy_to titles into single title_all field 2020-08-06T19:30:44+00:00 Bryan Newbold bnewbold@archive.org 2020-08-06T19:30:44+00:00 urn:sha1:da2e89152d882ee0ace9878c7ceba2567f8b01a1 schema: 12 shards, 0 replicas, more compression 2020-07-27T22:53:51+00:00 Bryan Newbold bnewbold@archive.org 2020-07-27T22:53:51+00:00 urn:sha1:0c7a2ace5d7c5b357dd4afa708a07e3fa85849fd schema: access as object (list), not nested 2020-07-21T20:47:11+00:00 Bryan Newbold bnewbold@archive.org 2020-07-21T20:47:07+00:00 urn:sha1:f6db34857ea6e09d60f9d085cead3f045d171b84 Nested allows more precise filter queries, but it seems that simple "dot notation" filters/queries don't work. We don't have anything doing the sophisticated queries yet, so keep it simple. 'tag' alias for 'tags' 2020-06-04T20:41:13+00:00 Bryan Newbold bnewbold@archive.org 2020-06-04T20:41:13+00:00 urn:sha1:264dadb59b046794880121eaad7f0f8082568cd1 collapse pages by SIM issue 2020-06-04T20:18:35+00:00 Bryan Newbold bnewbold@archive.org 2020-06-04T20:18:35+00:00 urn:sha1:198db52d3a93a2b7d7cab0a4140c6402a14eca84 HTML strip in ES indexing 2020-05-22T03:23:45+00:00 Bryan Newbold bnewbold@archive.org 2020-05-22T03:23:45+00:00 urn:sha1:fee17cf6518e13b6f1c3945dd769aba56d7606d5