diff options
author | Bryan Newbold <bnewbold@robocracy.org> | 2021-07-27 19:54:11 -0700 |
---|---|---|
committer | Bryan Newbold <bnewbold@robocracy.org> | 2021-07-27 19:54:11 -0700 |
commit | bfdbbdd50ab06d28a2099e408ff154b0ce1cbc4b (patch) | |
tree | 95e09e1cc9917d24ebfe59d67fecc5e76f40e3ec /guide/src/search_api.md | |
parent | ed56037d929d50abab707ee5eb9f583789a8ac7a (diff) | |
download | fatcat-bfdbbdd50ab06d28a2099e408ff154b0ce1cbc4b.tar.gz fatcat-bfdbbdd50ab06d28a2099e408ff154b0ce1cbc4b.zip |
start CHANGELOG for refs work
Diffstat (limited to 'guide/src/search_api.md')
-rw-r--r-- | guide/src/search_api.md | 29 |
1 files changed, 29 insertions, 0 deletions
diff --git a/guide/src/search_api.md b/guide/src/search_api.md new file mode 100644 index 00000000..91b7c8e9 --- /dev/null +++ b/guide/src/search_api.md @@ -0,0 +1,29 @@ + +# Search API + +The Elasticsearch indices used to power metadata search, statistics, and graphs +on the fatcat web interface are exposed publicly at +`https://search.fatcat.wiki`. Third parties can make queries using the +Elasticsearch API, which is well documented online and has client libraries in +many programming languages. + +A thin proxy (`es-public-proxy`) filters requests to avoid expensive queries +which could cause problems for search queries on the web interface, but most of +the Elasticsearch API is supported, including powerful aggregation queries. + +There is a short delay between updates to the fatcat catalog (via the main API) +and updates to the search index. + +Notable indices include: + +- `fatcat_release`: release entity metadata +- `fatcat_container`: container entity metadata +- `fatcat_ref`: reference graph + +Schemas for these indices can be fetched directly from the index (eg, +`https://search.fatcat.wiki/fatcat_release/_mapping`), and are versioned in the +fatcat git repository under `fatcat:extra/eleasticsearch/`. They are a +simplification and transform of the regular entity schemas, and include some +synthesized fields (such as "preservation status" for releases). Note that the +search schemas are likely to change over time with less notice and stability +guarantees than the primary catalog API schema. |