aboutsummaryrefslogtreecommitdiffstats
path: root/proposals/work_schema.md
diff options
context:
space:
mode:
authorBryan Newbold <bnewbold@archive.org>2020-05-16 13:43:04 -0700
committerBryan Newbold <bnewbold@archive.org>2020-05-16 13:43:04 -0700
commitb8eec609b60ca00cb6d8d2bb253e11f8dc474b53 (patch)
tree87a9e71444932f9aa9269fd9788b3bf79621e1e7 /proposals/work_schema.md
parent2d3d0274a23f0e52bff8b786aa7a930cb5b74c99 (diff)
downloadfatcat-scholar-b8eec609b60ca00cb6d8d2bb253e11f8dc474b53.tar.gz
fatcat-scholar-b8eec609b60ca00cb6d8d2bb253e11f8dc474b53.zip
tweak ES schema fields a bit
Diffstat (limited to 'proposals/work_schema.md')
-rw-r--r--proposals/work_schema.md35
1 files changed, 23 insertions, 12 deletions
diff --git a/proposals/work_schema.md b/proposals/work_schema.md
index 1e0f272..933e750 100644
--- a/proposals/work_schema.md
+++ b/proposals/work_schema.md
@@ -1,19 +1,21 @@
## Top-Level
-- type: _doc
-- key: keyword
-- key_type: keyword (work or page)
-- `work_id`
-- biblio: obj
-- fulltext: obj
-- sim: obj
-- abstracts: nested
+- type: `_doc` (aka, no type, `include_type_name=false`)
+- key: keyword (same as `_id`)
+- `doc_type`: keyword (work or page)
+- `doc_index_ts`: timestamp when document indexed
+- `work_id`: fatcat work ident (optional)
+
+- `biblio`: obj
+- `fulltext`: obj
+- `ia_sim`: obj
+- `abstracts`: nested
body
lang
-- releases: nested (TBD)
-- access
-- tags: array of keywords
+- `releases`: nested (TBD)
+- `access`
+- `tags`: array of keywords
TODO:
- summary fields to index "everything" into?
@@ -50,11 +52,14 @@ NEW:
- `container_name` (etc)
- `container_id`
- `container_issnl`
-- `container_issn` (array)
+- `container_wikidata_qid`
+- `issns` (array)
- `contrib_names`
- `affiliations`
- `creator_ids`
+TODO: should all external identifiers go under `releases` instead of `biblio`? Or some duplicated?
+
## Fulltext
- `status`: web, sim, shadow
@@ -81,6 +86,12 @@ Only index one abstract per language.
Enough details to construct a link or do a lookup or whatever. Note that might
be doing CDL status lookups on SERP pages.
+- `issue_item`: str
+- `pub_collection`: str
+- `sim_pubid`: str
+- `first_page`: str
+
+
Also pass-through archive.org metadata here (collection-level and item-level)
## Access