aboutsummaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
* more metadata cleanup task notesBryan Newbold2020-10-011-0/+7
|
* Merge branch 'bnewbold-202009-polish' into 'master'Martin Czygan2020-09-2910-124/+159
|\ | | | | | | | | fatcat.wiki 2020-09 polish See merge request webgroup/fatcat!84
| * coverage: handle the case of hits, but none with yearsBryan Newbold2020-09-171-4/+5
| |
| * web: handle unknown CSL style as a cleaner 400 pageBryan Newbold2020-09-172-1/+7
| |
| * web: update sub-resource integrity and pre-loadingBryan Newbold2020-09-171-0/+13
| | | | | | | | For security/integrity and performance
| * lint cleanupsBryan Newbold2020-09-172-3/+0
| |
| * web: route constraints on fcids and UUIDsBryan Newbold2020-09-172-101/+103
| | | | | | | | | | | | | | | | | | | | | | Instead of accepting any string for these parameters and throwing a 400 error if not the correct type, implement better route matching at the framework level and return more 404s. This resolves several outstanding sentry exceptions. The "flask-uuid" was imported and seems to have been configured for this purpose previously, but I guess I never finished configuring it.
| * container view: only show OA indicator when knownBryan Newbold2020-09-171-5/+1
| | | | | | | | | | The "is_oa:False" could be that we just don't know; aren't actually distinguishing between false and blank.
| * web container view: hide preservation when no releasesBryan Newbold2020-09-171-8/+6
| |
| * web toml editing: remove sub-entities from TOMLBryan Newbold2020-09-171-0/+4
| |
| * coverage search: pretty display for ES query errorsBryan Newbold2020-09-172-1/+19
| |
| * coverage: clarify available/accessible terminologyBryan Newbold2020-09-171-1/+1
| |
* | update keepers links to keepers.issn.orgBryan Newbold2020-09-282-8/+8
| |
* | Merge branch 'martin-datacite-spammy-title' into 'master'Martin Czygan2020-09-222-0/+25
|\ \ | |/ |/| | | | | address spammy datacite titles See merge request webgroup/fatcat!85
| * address spammy datacite titlesMartin Czygan2020-09-232-0/+25
|/ | | | | | | | | seemingly from zenodo: * https://fatcat.wiki/release/rzcpjwukobd4pj36ipla22cnoi * https://doi.org/10.5281/zenodo.4041777 About 3400 records with "FULL MOVIE" in title, currently.
* homepage: small grammar tweaks (The/the)Bryan Newbold2020-09-111-3/+3
|
* ingest: default to crawl protocols.io DOIsBryan Newbold2020-09-101-0/+2
|
* Merge branch 'bnewbold-datacite-not-empty-version' into 'master'bnewbold2020-09-113-2/+3
|\ | | | | | | | | datacite: handle case of empty-string version See merge request webgroup/fatcat!83
| * datacite: handle case of empty-string versionBryan Newbold2020-09-103-2/+3
|/ | | | | Includes a tiny tweak to the datacite import sample file to test this code path.
* file_meta import notesBryan Newbold2020-09-041-0/+75
|
* update stats snapshotBryan Newbold2020-09-032-0/+47
|
* remove spurious print statementBryan Newbold2020-09-031-1/+0
|
* Merge branch 'bnewbold-file-meta-cleanups' into 'master'Martin Czygan2020-09-033-0/+149
|\ | | | | | | | | generic file entity clean-ups as part of file_meta importer See merge request webgroup/fatcat!82
| * generic file entity clean-ups as part of file_meta importerBryan Newbold2020-09-023-0/+149
|/
* Merge branch 'bnewbold-filemeta'Bryan Newbold2020-08-275-0/+162
|\
| * fix comment typo (thanks martin)Bryan Newbold2020-08-271-1/+1
| |
| * fixes and test coverage for file_meta importerBryan Newbold2020-08-214-6/+82
| |
| * initial implementation of file_meta importerBryan Newbold2020-08-213-0/+86
| |
* | Merge branch 'bnewbold-meta-tags' into 'master'Martin Czygan2020-08-251-2/+1
|\ \ | |/ |/| | | | | meta tags See merge request webgroup/fatcat!81
| * remove typo (isbn:) from metadata DC.language fieldBryan Newbold2020-08-211-1/+1
| |
| * remove placeholder description meta tagBryan Newbold2020-08-201-1/+0
|/
* Merge branch 'bnewbold-sitemap' into 'master'bnewbold2020-08-2010-7/+206
|\ | | | | | | | | basic sitemap setup See merge request webgroup/fatcat!79
| * fix SearchAction nesting in WebSite (schema.org)Bryan Newbold2020-08-201-5/+2
| | | | | | | | | | This is not related to sitemap changes, but I was reminded in google search tools when validating site.
| * sitemap fixes from testingBryan Newbold2020-08-194-9/+20
| |
| * update robots.txt and sitemap.xmlBryan Newbold2020-08-194-2/+52
| | | | | | | | | | | | - show minimal robots/sitemap if not in prod environment - default to allow all in robots.txt; link to sitemap index files - basic sitemap.xml without entity-level links
| * iterate on sitemap generationBryan Newbold2020-08-196-7/+119
| |
| * initial sitemap.xml notes/templateBryan Newbold2020-08-192-0/+29
|/
* bulk edit log: add notes on recent chocula importBryan Newbold2020-08-171-0/+17
|
* entity updater: handle doi=None case betterBryan Newbold2020-08-141-1/+1
|
* entity updater: es['publisher_type'] not always setBryan Newbold2020-08-141-1/+1
| | | | This is a small bugfix for a production issue.
* Merge branch 'bnewbold-ingest-improvements' into 'master'Martin Czygan2020-08-138-38/+120
|\ | | | | | | | | ingest behavior changes; some datacite metadata tweaks See merge request webgroup/fatcat!78
| * entity update: change big5 ingest behaviorBryan Newbold2020-08-111-9/+15
| | | | | | | | | | | | | | | | | | In addition to changing the OA default, this was the main intended behavior change in this group of commits: want to ingest fewer attempts that we *expect* to fail, but default to ingest/crawl attempt if we are uncertain. This is because there is a long tail of journals that register DOIs and are defacto OA (fulltext is available), but we don't have metadata indicating them as such.
| * datacite importer: update test cases for 'Additional file' as component, not ↵Bryan Newbold2020-08-115-5/+5
| | | | | | | | stub
| * entity update: default to ingest non-OA worksBryan Newbold2020-08-111-9/+10
| |
| * entity update: skip ingest of figshare+zenodo 'group' DOIsBryan Newbold2020-08-111-0/+15
| |
| * datacite import: figshare-specific hacksBryan Newbold2020-08-112-3/+4
| |
| * datacite import: refactor release_type detection into static methodBryan Newbold2020-08-111-14/+51
| |
| * datacite import: refactor publisher-specific hacks into static methodBryan Newbold2020-08-111-15/+29
| | | | | | | | Also tweak title/publisher detection to use DOI prefixes
| * update crawl blocklist for SPNv2 requests which mostly failBryan Newbold2020-08-101-2/+10
| |
* | Merge branch 'martin-datacite-json-decode-err-sentry-38625' into 'master'bnewbold2020-08-101-1/+8
|\ \ | |/ |/| | | | | harvest: datacite API yields HTTP 200 with broken JSON See merge request webgroup/fatcat!77
generated by cgit v1.2.3 (git 2.39.1) at 2024-07-06 13:42:32 +0000