fatcat/python/fatcat_tools/harvest, branch bnewbold-rust-gen-v5[no description]https://git.bnewbold.net/fatcat/atom?h=bnewbold-rust-gen-v52020-03-31T04:23:11Zcrossref: switch from index-date to update-date2020-03-31T04:23:11ZBryan Newboldbnewbold@robocracy.org2020-03-31T03:56:04Zurn:sha1:851c40143d44a73a92ff2c9556b3a63f29668c2d
This goes against what the API docs recommend, but we are currently far
behind on updates and need to catch up. Other than what the docs say,
this seems to be consistent with the behavior we want.
crossref: longer comment about crossref API date fields2020-03-31T03:55:44ZBryan Newboldbnewbold@robocracy.org2020-03-31T03:55:44Zurn:sha1:98933a068ec3d918deb0e7dff30aed517ca515d9Merge pull request #53 from EdwardBetts/spelling2020-03-27T23:50:08Zbnewboldbnewbold@archive.org2020-03-27T23:50:08Zurn:sha1:98abe2e751187aa7c2e751b355ffb56d9b1f8c6a
Correct spelling mistakesCorrect spelling mistakes2020-03-27T21:25:54ZEdward Bettsedward@4angle.com2020-03-27T21:25:54Zurn:sha1:94710b2803780ab16fb30b79010f8e27cf115512pubmed: log to stderr2020-03-10T11:52:42ZMartin Czyganmartin.czygan@gmail.com2020-03-10T11:52:42Zurn:sha1:4fcdc6d60260ca79693fd7d1ce2ae03065d5ef0cpubmed: move mapping generation out of fetch_date2020-03-10T11:51:11ZMartin Czyganmartin.czygan@gmail.com2020-03-10T11:51:11Zurn:sha1:db8892f2d960379525a4182b884c1d51c0c70186
* fetch_date will fail on missing mapping
* adjust tests (test will require access to pubmed ftp)
harvest: fix imports from HarvestPubmedWorker cleanup2020-03-10T11:50:21ZMartin Czyganmartin.czygan@gmail.com2020-03-10T11:50:21Zurn:sha1:34a18cd1821d09ac0beee8959407ec51cf397337pubmed: citations is a bit more precise2020-03-09T19:12:37ZMartin Czyganmartin.czygan@gmail.com2020-03-09T19:12:37Zurn:sha1:6f5ead85169c71a7a010a9e2d54d4c41489c607b
> Each day, NLM produces update files that include new, revised and
deleted citations. -- ftp://ftp.ncbi.nlm.nih.gov/pubmed/updatefiles/README.txt
pubmed: we sync from FTP2020-03-09T19:09:05ZMartin Czyganmartin.czygan@gmail.com2020-03-09T19:09:05Zurn:sha1:4a1aa8b28dde887524b294d33566583baf24db74oaipmh: HarvestPubmedWorker obsoleted by PubmedFTPWorker2020-03-09T19:07:30ZMartin Czyganmartin.czygan@gmail.com2020-03-09T19:07:30Zurn:sha1:c6b29c17eeea4c067dcc391fe6d9bdaec3f657b3