fatcat/python/fatcat_tools/importers, branch bnewbold-rust-gen-v5 [no description] https://git.bnewbold.net/fatcat/atom?h=bnewbold-rust-gen-v5 2020-04-22T20:25:36Z datacite: fix type error 2020-04-22T20:25:36Z Martin Czygan martin.czygan@gmail.com 2020-04-22T20:25:36Z urn:sha1:e0baeade7924019c5bbd27d9a7c116a1e26854fc Up to now, we expected the description to be a string or list. Add handling for int as well. First appeared: Apr 22 19:58:39. datacite: fix a raw name constraint violation 2020-04-20T18:52:10Z Martin Czygan martin.czygan@gmail.com 2020-04-20T18:52:10Z urn:sha1:7c6febf20c84dd4f5778e1fb02369456f7dad344 It was possible that contribs got added which had no raw name. One example would be a name consisting of whitespace only. This fix adds a final check for this case. consistently use raw string prefix for regex 2020-04-17T17:56:17Z Bryan Newbold bnewbold@robocracy.org 2020-04-16T04:35:48Z urn:sha1:116a26f072e8628cc4cfabb2e55c6661b6b94605 pubmed: use untranslated title if translated not available 2020-04-01T19:02:45Z Bryan Newbold bnewbold@robocracy.org 2020-04-01T19:02:43Z urn:sha1:938d2c5366d80618b839c83baadc9b5c62d10dce The primary motivation for this change is that fatcat *requires* a non-empty title for each release entity. Pubmed/Medline occasionally indexes just a VenacularTitle with no ArticleTitle for foreign publications, and currently those records don't end up in fatcat at all. importers: replace newlines in get_text() strings 2020-04-01T19:02:20Z Bryan Newbold bnewbold@robocracy.org 2020-04-01T19:02:20Z urn:sha1:f77a553350238c8ccc9c3bc0edcf47fb9dd067b3 importers: more string/get_text swaps 2020-03-29T03:12:58Z Bryan Newbold bnewbold@robocracy.org 2020-03-29T03:12:54Z urn:sha1:6681500eeffe39b7d029a0e0d6b2ed83729f555f See previous pubmed commit for details. pubmed: bunch of .get_text() instead of .string 2020-03-29T03:01:48Z Bryan Newbold bnewbold@robocracy.org 2020-03-29T03:01:46Z urn:sha1:d6af7b7544ddb3b5e7b1f4a0fd76bd9cd5ed9125 Yikes! Apparently when a tag has child tags, .string will return None instead of all the strings. .get_text() returns all of it: https://www.crummy.com/software/BeautifulSoup/bs4/doc/#get-text https://www.crummy.com/software/BeautifulSoup/bs4/doc/#string I've things like identifiers as .string, when we expect only a single string inside. Merge pull request #53 from EdwardBetts/spelling 2020-03-27T23:50:08Z bnewbold bnewbold@archive.org 2020-03-27T23:50:08Z urn:sha1:98abe2e751187aa7c2e751b355ffb56d9b1f8c6a Correct spelling mistakes Correct spelling mistakes 2020-03-27T21:25:54Z Edward Betts edward@4angle.com 2020-03-27T21:25:54Z urn:sha1:94710b2803780ab16fb30b79010f8e27cf115512 datacite: nameIdentifier corner case 2020-03-26T21:09:15Z Bryan Newbold bnewbold@robocracy.org 2020-03-26T20:58:32Z urn:sha1:ec82404f0d0ad6b92491a1cb90a823d421857348 Works around a bug in production: AttributeError: 'NoneType' object has no attribute 'replace' (datacite.py:724) NOTE: there are no tests for this code path