fatcat/python/tests/files, branch bnewbold-rust-gen-v5 [no description] https://git.bnewbold.net/fatcat/atom?h=bnewbold-rust-gen-v5 2020-04-22T20:25:36+00:00 datacite: fix type error 2020-04-22T20:25:36+00:00 Martin Czygan martin.czygan@gmail.com 2020-04-22T20:25:36+00:00 urn:sha1:e0baeade7924019c5bbd27d9a7c116a1e26854fc Up to now, we expected the description to be a string or list. Add handling for int as well. First appeared: Apr 22 19:58:39. datacite: fix a raw name constraint violation 2020-04-20T18:52:10+00:00 Martin Czygan martin.czygan@gmail.com 2020-04-20T18:52:10+00:00 urn:sha1:7c6febf20c84dd4f5778e1fb02369456f7dad344 It was possible that contribs got added which had no raw name. One example would be a name consisting of whitespace only. This fix adds a final check for this case. pubmed: handle multiple ReferenceList 2020-03-20T20:00:52+00:00 Bryan Newbold bnewbold@robocracy.org 2020-03-20T20:00:50+00:00 urn:sha1:a6f74183dd1cf1eaa44f7edeb98dbc5dc737dabb This resolves a situation noticed in prod where we were only importing/updating a single reference per article. Includes a regression test. Merge branch 'martin-kafka-bs4-import' into 'master' 2020-03-10T15:33:17+00:00 Martin Czygan martin@archive.org 2020-03-10T15:33:17+00:00 urn:sha1:336630e1d445fb9d233447f9af4bac94473a12bf pubmed and arxiv harvest preparations See merge request webgroup/fatcat!28 Merge branch 'bnewbold-elastic-v03b' 2020-02-27T06:05:43+00:00 Bryan Newbold bnewbold@robocracy.org 2020-02-27T06:05:43+00:00 urn:sha1:ae50ee2274031ddc178fa4a10b59280e8440a24c more pubmed adjustments 2020-02-22T16:44:38+00:00 Martin Czygan martin.czygan@gmail.com 2020-02-19T01:28:11+00:00 urn:sha1:376053a479a8d683fc5e099d0b0b3cb76c026d16 * regenerate map in continuous mode * add tests shadow import: more filtering of file_meta fields 2020-02-14T06:24:20+00:00 Bryan Newbold bnewbold@robocracy.org 2020-01-30T20:15:09+00:00 urn:sha1:87029cb13d244381f915fe66e40760477edb5675 basic shadow importer 2020-02-14T06:24:20+00:00 Bryan Newbold bnewbold@robocracy.org 2019-12-24T01:59:10+00:00 urn:sha1:e59d1b617d4abd5f002d9e59b6bbaebc9ff30993 datacite: add exception for https://www.micropublication.org/ 2020-01-31T00:44:46+00:00 Martin Czygan martin.czygan@gmail.com 2020-01-31T00:44:46+00:00 urn:sha1:a42206d2603e28f1311ac3873dc168c78eabffee datacite: improve date handling and minor tweak 2020-01-30T12:36:01+00:00 Martin Czygan martin.czygan@gmail.com 2020-01-30T12:36:01+00:00 urn:sha1:7dec2d1560ebf5ca6d0d337eb246fe345f6ec0bb Records from https://www.micropublication.org/ did not have a date in FC, although raw data contained date strings - they were not using the finer-grained "attributes.date" but "attributes.published" and/or "attributes.publicationYear". Support for those fields has been added, including a test case. During this test (#30) a processing gap for names became clear (author may have "given_name" and "surname", but no "name"). This bug has been fixed, too.