fatcat/python/fatcat_tools/transforms, branch v0.4.0 [no description] https://git.bnewbold.net/fatcat/atom?h=v0.4.0 2021-10-13T23:21:31+00:00 python: implement ES schema changes 2021-10-13T23:21:31+00:00 Bryan Newbold bnewbold@robocracy.org 2021-10-13T03:05:02+00:00 urn:sha1:88497e378e2e4c93906c7485865724133511d4e6 refs: generalize web endpoints; JSON content negotiation; openlibrary inbound view; etc 2021-07-24T00:51:41+00:00 Bryan Newbold bnewbold@robocracy.org 2021-07-24T00:51:22+00:00 urn:sha1:05665c448e846e4834fa59dfe3cd0f11ac789ac9 remove unused imports (lint) 2021-07-23T18:58:41+00:00 Bryan Newbold bnewbold@robocracy.org 2021-07-23T18:58:41+00:00 urn:sha1:d01ab339a0aa568b6ccd6c56beb611a2e7ac9686 partial access options transform for releases 2021-07-23T17:55:09+00:00 Bryan Newbold bnewbold@robocracy.org 2021-04-16T06:29:34+00:00 urn:sha1:bb085c92760d6ccbd6c92e13fcae0af02b5a3d17 more consistent and defensive lower-casing of DOIs 2021-06-24T00:51:15+00:00 Bryan Newbold bnewbold@robocracy.org 2021-06-17T23:26:50+00:00 urn:sha1:fa11747574f086e99459914f93d24bad7a8eacce After noticing more upper/lower ambiguity in production. In particular, we have some old ingest requests in sandcrawler DB, which get re-submitted/re-tried, which have capitalized DOIs in the link source id field. small python lint fixes (no behavior change) 2021-05-25T23:30:09+00:00 Bryan Newbold bnewbold@robocracy.org 2021-05-25T23:30:09+00:00 urn:sha1:7aa19b92f0e7808a341aec8ae17485408dfae68c ingest: add per-container ingest type overrides 2021-05-22T00:46:37+00:00 Bryan Newbold bnewbold@robocracy.org 2021-05-22T00:46:37+00:00 urn:sha1:be28fd5d4a600bc29507418fddfdc95802abc98f transforms: fix 'display_ame' typo 2021-04-19T23:41:06+00:00 Bryan Newbold bnewbold@robocracy.org 2021-04-19T23:41:06+00:00 urn:sha1:b736f98ec603ac99b3061db6e59e586129181fcb prefer contrib.creator.display_name over contrib.raw_name 2021-04-13T00:35:53+00:00 Bryan Newbold bnewbold@robocracy.org 2021-04-13T00:30:01+00:00 urn:sha1:09caaed60efbf525d7eadb73887b50843bd2d9bd These will be getting updates from ORCID and are usually more complete and more correct for display, attribution, and search purposes. Might need to tweak fuzzycat code to handle multiple names at the verification stage. ES schema updates: doc_index_ts as a str, not datetime 2021-04-07T04:58:54+00:00 Bryan Newbold bnewbold@robocracy.org 2021-04-07T03:25:46+00:00 urn:sha1:5ba1859a2308c72e7e3e4e86af3c275210c5bacd The schema is a timestamp, but python needs to serialize as JSON, and doesn't do datetime automatically.