Commit message (Collapse) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
| * | initial implementation of file_meta importer | Bryan Newbold | 2020-08-21 | 3 | -0/+86 | |
| | | ||||||
* | | remove typo (isbn:) from metadata DC.language field | Bryan Newbold | 2020-08-21 | 1 | -1/+1 | |
| | | ||||||
* | | remove placeholder description meta tag | Bryan Newbold | 2020-08-20 | 1 | -1/+0 | |
|/ | ||||||
* | fix SearchAction nesting in WebSite (schema.org) | Bryan Newbold | 2020-08-20 | 1 | -5/+2 | |
| | | | | | This is not related to sitemap changes, but I was reminded in google search tools when validating site. | |||||
* | sitemap fixes from testing | Bryan Newbold | 2020-08-19 | 1 | -5/+5 | |
| | ||||||
* | update robots.txt and sitemap.xml | Bryan Newbold | 2020-08-19 | 4 | -2/+52 | |
| | | | | | | - show minimal robots/sitemap if not in prod environment - default to allow all in robots.txt; link to sitemap index files - basic sitemap.xml without entity-level links | |||||
* | entity updater: handle doi=None case better | Bryan Newbold | 2020-08-14 | 1 | -1/+1 | |
| | ||||||
* | entity updater: es['publisher_type'] not always set | Bryan Newbold | 2020-08-14 | 1 | -1/+1 | |
| | | | | This is a small bugfix for a production issue. | |||||
* | Merge branch 'bnewbold-ingest-improvements' into 'master' | Martin Czygan | 2020-08-13 | 8 | -38/+120 | |
|\ | | | | | | | | | ingest behavior changes; some datacite metadata tweaks See merge request webgroup/fatcat!78 | |||||
| * | entity update: change big5 ingest behavior | Bryan Newbold | 2020-08-11 | 1 | -9/+15 | |
| | | | | | | | | | | | | | | | | | | In addition to changing the OA default, this was the main intended behavior change in this group of commits: want to ingest fewer attempts that we *expect* to fail, but default to ingest/crawl attempt if we are uncertain. This is because there is a long tail of journals that register DOIs and are defacto OA (fulltext is available), but we don't have metadata indicating them as such. | |||||
| * | datacite importer: update test cases for 'Additional file' as component, not ↵ | Bryan Newbold | 2020-08-11 | 5 | -5/+5 | |
| | | | | | | | | stub | |||||
| * | entity update: default to ingest non-OA works | Bryan Newbold | 2020-08-11 | 1 | -9/+10 | |
| | | ||||||
| * | entity update: skip ingest of figshare+zenodo 'group' DOIs | Bryan Newbold | 2020-08-11 | 1 | -0/+15 | |
| | | ||||||
| * | datacite import: figshare-specific hacks | Bryan Newbold | 2020-08-11 | 2 | -3/+4 | |
| | | ||||||
| * | datacite import: refactor release_type detection into static method | Bryan Newbold | 2020-08-11 | 1 | -14/+51 | |
| | | ||||||
| * | datacite import: refactor publisher-specific hacks into static method | Bryan Newbold | 2020-08-11 | 1 | -15/+29 | |
| | | | | | | | | Also tweak title/publisher detection to use DOI prefixes | |||||
| * | update crawl blocklist for SPNv2 requests which mostly fail | Bryan Newbold | 2020-08-10 | 1 | -2/+10 | |
| | | ||||||
* | | harvest: datacite API yields HTTP 200 with broken JSON | Martin Czygan | 2020-08-10 | 1 | -1/+8 | |
|/ | | | | As a first step: log response body for debugging. | |||||
* | release ES transform tweaks | Bryan Newbold | 2020-08-07 | 1 | -3/+5 | |
| | | | | | | | | pass-through publisher_type from container extra metadata (ES field already existed; this is from newer chocula metadata) count arxiv and PMCID papers which haven't been crawled (by IA) as "dark", not "bright" | |||||
* | chocula import update tweaks | Bryan Newbold | 2020-08-04 | 1 | -10/+14 | |
| | ||||||
* | more update keys and cases for chocula importer | Bryan Newbold | 2020-08-04 | 1 | -5/+11 | |
| | ||||||
* | fix key name mismatch in chocula importer | Bryan Newbold | 2020-08-04 | 1 | -1/+1 | |
| | | | | chocula 'export-fatcat' uses 'ident', not 'fatcat_ident' | |||||
* | web: add links to deletion pages from edit pages | Bryan Newbold | 2020-07-31 | 4 | -0/+13 | |
| | ||||||
* | editing: withdrawn_status, release_year | Bryan Newbold | 2020-07-31 | 2 | -24/+44 | |
| | ||||||
* | release form validators and tweak labels | Bryan Newbold | 2020-07-31 | 1 | -8/+37 | |
| | ||||||
* | fix typo bug resulting in lost/bad ext_id web edits | Bryan Newbold | 2020-07-31 | 2 | -2/+16 | |
| | ||||||
* | implement webface entity deletion | Bryan Newbold | 2020-07-31 | 3 | -27/+308 | |
| | ||||||
* | routes: handle case of viewing deleted entity in editgroup context | Bryan Newbold | 2020-07-30 | 4 | -8/+35 | |
| | | | | | | Eg, consider deleting an entity. When viewing the editgroup, want to be able to click the deleted entity and see the "deleted entity" page instead of a generic 404. | |||||
* | remove some meta-fields from TOML form (all entities) | Bryan Newbold | 2020-07-30 | 1 | -1/+5 | |
| | ||||||
* | fix search redirect codes in new tests | Bryan Newbold | 2020-07-30 | 1 | -4/+4 | |
| | ||||||
* | wire up new TOML views | Bryan Newbold | 2020-07-30 | 14 | -83/+256 | |
| | ||||||
* | generic HTML views for TOML editing | Bryan Newbold | 2020-07-30 | 4 | -0/+80 | |
| | ||||||
* | editing: more 'raise' status instead of 'abort()' | Bryan Newbold | 2020-07-30 | 1 | -1/+1 | |
| | ||||||
* | generic helpers for TOML editing routes | Bryan Newbold | 2020-07-30 | 2 | -10/+201 | |
| | ||||||
* | basic toml transform helper | Bryan Newbold | 2020-07-30 | 3 | -4/+42 | |
| | ||||||
* | pipenv: lock pycountry to 19.10 version | Bryan Newbold | 2020-07-30 | 2 | -7/+7 | |
| | | | | datacite importer had errors otherwise | |||||
* | pipenv: add toml library (and update lock) | Bryan Newbold | 2020-07-30 | 2 | -276/+327 | |
| | ||||||
* | lock loginpass version to prevent conflicting authlib version | Bryan Newbold | 2020-07-30 | 1 | -1/+1 | |
| | | | | | May be possible to upgrade both of these libraries together, but that isn't the purpose of current development. | |||||
* | simple search route increased coverage | Bryan Newbold | 2020-07-30 | 1 | -0/+27 | |
| | ||||||
* | comments documenting tuple/dict types in graphics.py | Bryan Newbold | 2020-07-30 | 1 | -0/+11 | |
| | ||||||
* | minor lint fixes | Bryan Newbold | 2020-07-30 | 2 | -3/+1 | |
| | ||||||
* | control shadow preservation display with a flag | Bryan Newbold | 2020-07-30 | 5 | -19/+80 | |
| | ||||||
* | coverage search: 'recent' endpoint test (minimal) | Bryan Newbold | 2020-07-30 | 1 | -1/+32 | |
| | ||||||
* | release search: fix fulltext_only checkbox (from query object) | Bryan Newbold | 2020-07-30 | 2 | -1/+2 | |
| | ||||||
* | search: 'recent' mode for coverage search | Bryan Newbold | 2020-07-30 | 4 | -7/+134 | |
| | ||||||
* | expand test coverage of new preservation views | Bryan Newbold | 2020-07-30 | 1 | -15/+122 | |
| | ||||||
* | first iteration of flexible search coverage | Bryan Newbold | 2020-07-30 | 5 | -2/+148 | |
| | ||||||
* | make some ES agg methods work on general queries | Bryan Newbold | 2020-07-30 | 2 | -32/+58 | |
| | | | | | | | Eg, instead of container-specific year histogram, have the histogram fetch function take a ReleaseQuery. This is in preparation for more generic coverage visualization pages. | |||||
* | refactor coverage tests/mocks | Bryan Newbold | 2020-07-30 | 5 | -39/+80 | |
| | ||||||
* | move container _stats enrichment to routes | Bryan Newbold | 2020-07-30 | 2 | -9/+4 | |
| | | | | | These were being added to many views which didn't need them (eg, metadata, editing views) |