aboutsummaryrefslogtreecommitdiffstats
path: root/python/fatcat_tools
Commit message (Expand)AuthorAgeFilesLines
* ingest: default to crawl protocols.io DOIsBryan Newbold2020-09-101-0/+2
* datacite: handle case of empty-string versionBryan Newbold2020-09-101-1/+1
* remove spurious print statementBryan Newbold2020-09-031-1/+0
* generic file entity clean-ups as part of file_meta importerBryan Newbold2020-09-022-0/+50
* fix comment typo (thanks martin)Bryan Newbold2020-08-271-1/+1
* fixes and test coverage for file_meta importerBryan Newbold2020-08-211-5/+10
* initial implementation of file_meta importerBryan Newbold2020-08-212-0/+71
* entity updater: handle doi=None case betterBryan Newbold2020-08-141-1/+1
* entity updater: es['publisher_type'] not always setBryan Newbold2020-08-141-1/+1
* Merge branch 'bnewbold-ingest-improvements' into 'master'Martin Czygan2020-08-132-33/+114
|\
| * entity update: change big5 ingest behaviorBryan Newbold2020-08-111-9/+15
| * entity update: default to ingest non-OA worksBryan Newbold2020-08-111-9/+10
| * entity update: skip ingest of figshare+zenodo 'group' DOIsBryan Newbold2020-08-111-0/+15
| * datacite import: figshare-specific hacksBryan Newbold2020-08-111-3/+3
| * datacite import: refactor release_type detection into static methodBryan Newbold2020-08-111-14/+51
| * datacite import: refactor publisher-specific hacks into static methodBryan Newbold2020-08-111-15/+29
| * update crawl blocklist for SPNv2 requests which mostly failBryan Newbold2020-08-101-2/+10
* | harvest: datacite API yields HTTP 200 with broken JSONMartin Czygan2020-08-101-1/+8
|/
* release ES transform tweaksBryan Newbold2020-08-071-3/+5
* chocula import update tweaksBryan Newbold2020-08-041-10/+14
* more update keys and cases for chocula importerBryan Newbold2020-08-041-5/+11
* fix key name mismatch in chocula importerBryan Newbold2020-08-041-1/+1
* basic toml transform helperBryan Newbold2020-07-302-4/+20
* Merge branch 'bnewbold-more-lint-fixes' into 'master'Martin Czygan2020-07-246-25/+18
|\
| * fix issnl typo in pubmedBryan Newbold2020-07-231-1/+1
| * remove isascii() work around definition in importers/datacite.pyBryan Newbold2020-07-231-7/+1
| * simple lint (flake8) fixes over python codebaseBryan Newbold2020-07-235-17/+16
* | simplify in_kbart check statementBryan Newbold2020-07-231-1/+1
* | make in_kbart transform inclusive of last yearBryan Newbold2020-07-231-0/+9
|/
* Merge branch 'martin-datacite-duplicated-author-gh-59' into 'master'bnewbold2020-07-111-6/+60
|\
| * datacite: resolve formatting issues in testsMartin Czygan2020-07-1033-133/+51
| |\
| * | datacite: there should be no index gapsMartin Czygan2020-07-101-2/+8
| * | datacite: document contributor typesMartin Czygan2020-07-101-0/+25
| * | wip: contrib, GH59Martin Czygan2020-07-101-16/+22
| * | datacite: address duplicated contributor issueMartin Czygan2020-07-071-0/+16
* | | Merge branch 'martin-datacite-bugfix-sentry-44035' into 'master'bnewbold2020-07-111-0/+4
|\ \ \ | |_|/ |/| |
| * | datacite: mitigate sentry #44035Martin Czygan2020-07-101-0/+4
* | | Merge branch 'martin-arxiv-fix-http-503' into 'master'bnewbold2020-07-101-1/+1
|\ \ \ | |/ / |/| |
| * | arxiv: do retry five times of HTTP 503Martin Czygan2020-07-101-1/+1
* | | datacite: fix attribute errorMartin Czygan2020-07-071-1/+1
|/ /
* | lint (flake8) tool python filesBryan Newbold2020-07-0133-130/+46
* | reviewer: fix bugs in common code found by mypyBryan Newbold2020-07-011-2/+3
|/
* add new license mappingsBryan Newbold2020-06-302-0/+27
* datacite: improve license mappingMartin Czygan2020-06-301-9/+15
* datacite: hard cast possible date value to stringMartin Czygan2020-06-291-1/+1
* disallow a specific unicode character from DOIsBryan Newbold2020-06-261-0/+6
* ES schema: add best_url to file schemaBryan Newbold2020-06-041-0/+12
* harvest: fail on HTTP 400Martin Czygan2020-05-291-4/+0
* Merge branch 'bnewbold-ingest-stage' into 'master'Martin Czygan2020-05-281-0/+5
|\
| * ingest importer: check that stage is consistent with releaseBryan Newbold2020-05-261-0/+5