fatcat/python, branch v0.3.2 [no description] https://git.bnewbold.net/fatcat/atom?h=v0.3.2 2020-04-08T18:47:33+00:00 ingest: configurable ES index 2020-04-08T18:47:33+00:00 Bryan Newbold bnewbold@robocracy.org 2020-04-08T18:47:33+00:00 urn:sha1:d842983d55fd13b4a006a3caa384e68c70ce998c Merge branch 'bnewbold-pubmed-get_text' into 'master' 2020-04-01T22:03:19+00:00 bnewbold bnewbold@archive.org 2020-04-01T22:03:19+00:00 urn:sha1:32f195cec41459045f3d3453dad7a97b38d4e288 beautifulsoup XML parsing: .string vs. .get_text() See merge request webgroup/fatcat!40 pubmed: use untranslated title if translated not available 2020-04-01T19:02:45+00:00 Bryan Newbold bnewbold@robocracy.org 2020-04-01T19:02:43+00:00 urn:sha1:938d2c5366d80618b839c83baadc9b5c62d10dce The primary motivation for this change is that fatcat *requires* a non-empty title for each release entity. Pubmed/Medline occasionally indexes just a VenacularTitle with no ArticleTitle for foreign publications, and currently those records don't end up in fatcat at all. importers: replace newlines in get_text() strings 2020-04-01T19:02:20+00:00 Bryan Newbold bnewbold@robocracy.org 2020-04-01T19:02:20+00:00 urn:sha1:f77a553350238c8ccc9c3bc0edcf47fb9dd067b3 crossref: switch from index-date to update-date 2020-03-31T04:23:11+00:00 Bryan Newbold bnewbold@robocracy.org 2020-03-31T03:56:04+00:00 urn:sha1:851c40143d44a73a92ff2c9556b3a63f29668c2d This goes against what the API docs recommend, but we are currently far behind on updates and need to catch up. Other than what the docs say, this seems to be consistent with the behavior we want. crossref: longer comment about crossref API date fields 2020-03-31T03:55:44+00:00 Bryan Newbold bnewbold@robocracy.org 2020-03-31T03:55:44+00:00 urn:sha1:98933a068ec3d918deb0e7dff30aed517ca515d9 web: small corrections to subtitle/original_name 2020-03-29T06:14:25+00:00 Bryan Newbold bnewbold@robocracy.org 2020-03-29T06:14:25+00:00 urn:sha1:48cc4c85008bb3fa2751c042112467c7e60a96aa Merge branch 'bnewbold-translation-view' 2020-03-29T05:23:05+00:00 Bryan Newbold bnewbold@robocracy.org 2020-03-29T05:23:05+00:00 urn:sha1:4d484c18add7d6ac05a28e9fb0ca01298381ed41 web: use more idiomatic type check 2020-03-29T05:19:57+00:00 Bryan Newbold bnewbold@robocracy.org 2020-03-29T05:19:50+00:00 urn:sha1:49891b9b306fcab27b0e55c1979269aa88580323 Thanks to Martin for suggestion importers: more string/get_text swaps 2020-03-29T03:12:58+00:00 Bryan Newbold bnewbold@robocracy.org 2020-03-29T03:12:54+00:00 urn:sha1:6681500eeffe39b7d029a0e0d6b2ed83729f555f See previous pubmed commit for details.