Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | entity update: change big5 ingest behavior | Bryan Newbold | 2020-08-11 | 1 | -9/+15 |
| | | | | | | | | | In addition to changing the OA default, this was the main intended behavior change in this group of commits: want to ingest fewer attempts that we *expect* to fail, but default to ingest/crawl attempt if we are uncertain. This is because there is a long tail of journals that register DOIs and are defacto OA (fulltext is available), but we don't have metadata indicating them as such. | ||||
* | datacite importer: update test cases for 'Additional file' as component, not ↵ | Bryan Newbold | 2020-08-11 | 5 | -5/+5 |
| | | | | stub | ||||
* | entity update: default to ingest non-OA works | Bryan Newbold | 2020-08-11 | 1 | -9/+10 |
| | |||||
* | entity update: skip ingest of figshare+zenodo 'group' DOIs | Bryan Newbold | 2020-08-11 | 1 | -0/+15 |
| | |||||
* | datacite import: figshare-specific hacks | Bryan Newbold | 2020-08-11 | 2 | -3/+4 |
| | |||||
* | datacite import: refactor release_type detection into static method | Bryan Newbold | 2020-08-11 | 1 | -14/+51 |
| | |||||
* | datacite import: refactor publisher-specific hacks into static method | Bryan Newbold | 2020-08-11 | 1 | -15/+29 |
| | | | | Also tweak title/publisher detection to use DOI prefixes | ||||
* | update crawl blocklist for SPNv2 requests which mostly fail | Bryan Newbold | 2020-08-10 | 1 | -2/+10 |
| | |||||
* | release ES transform tweaks | Bryan Newbold | 2020-08-07 | 1 | -3/+5 |
| | | | | | | | | pass-through publisher_type from container extra metadata (ES field already existed; this is from newer chocula metadata) count arxiv and PMCID papers which haven't been crawled (by IA) as "dark", not "bright" | ||||
* | chocula import update tweaks | Bryan Newbold | 2020-08-04 | 1 | -10/+14 |
| | |||||
* | more update keys and cases for chocula importer | Bryan Newbold | 2020-08-04 | 1 | -5/+11 |
| | |||||
* | fix key name mismatch in chocula importer | Bryan Newbold | 2020-08-04 | 1 | -1/+1 |
| | | | | chocula 'export-fatcat' uses 'ident', not 'fatcat_ident' | ||||
* | web: add links to deletion pages from edit pages | Bryan Newbold | 2020-07-31 | 4 | -0/+13 |
| | |||||
* | editing: withdrawn_status, release_year | Bryan Newbold | 2020-07-31 | 2 | -24/+44 |
| | |||||
* | release form validators and tweak labels | Bryan Newbold | 2020-07-31 | 1 | -8/+37 |
| | |||||
* | fix typo bug resulting in lost/bad ext_id web edits | Bryan Newbold | 2020-07-31 | 2 | -2/+16 |
| | |||||
* | implement webface entity deletion | Bryan Newbold | 2020-07-31 | 3 | -27/+308 |
| | |||||
* | routes: handle case of viewing deleted entity in editgroup context | Bryan Newbold | 2020-07-30 | 4 | -8/+35 |
| | | | | | | Eg, consider deleting an entity. When viewing the editgroup, want to be able to click the deleted entity and see the "deleted entity" page instead of a generic 404. | ||||
* | remove some meta-fields from TOML form (all entities) | Bryan Newbold | 2020-07-30 | 1 | -1/+5 |
| | |||||
* | fix search redirect codes in new tests | Bryan Newbold | 2020-07-30 | 1 | -4/+4 |
| | |||||
* | wire up new TOML views | Bryan Newbold | 2020-07-30 | 14 | -83/+256 |
| | |||||
* | generic HTML views for TOML editing | Bryan Newbold | 2020-07-30 | 4 | -0/+80 |
| | |||||
* | editing: more 'raise' status instead of 'abort()' | Bryan Newbold | 2020-07-30 | 1 | -1/+1 |
| | |||||
* | generic helpers for TOML editing routes | Bryan Newbold | 2020-07-30 | 2 | -10/+201 |
| | |||||
* | basic toml transform helper | Bryan Newbold | 2020-07-30 | 3 | -4/+42 |
| | |||||
* | pipenv: lock pycountry to 19.10 version | Bryan Newbold | 2020-07-30 | 2 | -7/+7 |
| | | | | datacite importer had errors otherwise | ||||
* | pipenv: add toml library (and update lock) | Bryan Newbold | 2020-07-30 | 2 | -276/+327 |
| | |||||
* | lock loginpass version to prevent conflicting authlib version | Bryan Newbold | 2020-07-30 | 1 | -1/+1 |
| | | | | | May be possible to upgrade both of these libraries together, but that isn't the purpose of current development. | ||||
* | simple search route increased coverage | Bryan Newbold | 2020-07-30 | 1 | -0/+27 |
| | |||||
* | comments documenting tuple/dict types in graphics.py | Bryan Newbold | 2020-07-30 | 1 | -0/+11 |
| | |||||
* | minor lint fixes | Bryan Newbold | 2020-07-30 | 2 | -3/+1 |
| | |||||
* | control shadow preservation display with a flag | Bryan Newbold | 2020-07-30 | 5 | -19/+80 |
| | |||||
* | coverage search: 'recent' endpoint test (minimal) | Bryan Newbold | 2020-07-30 | 1 | -1/+32 |
| | |||||
* | release search: fix fulltext_only checkbox (from query object) | Bryan Newbold | 2020-07-30 | 2 | -1/+2 |
| | |||||
* | search: 'recent' mode for coverage search | Bryan Newbold | 2020-07-30 | 4 | -7/+134 |
| | |||||
* | expand test coverage of new preservation views | Bryan Newbold | 2020-07-30 | 1 | -15/+122 |
| | |||||
* | first iteration of flexible search coverage | Bryan Newbold | 2020-07-30 | 5 | -2/+148 |
| | |||||
* | make some ES agg methods work on general queries | Bryan Newbold | 2020-07-30 | 2 | -32/+58 |
| | | | | | | | Eg, instead of container-specific year histogram, have the histogram fetch function take a ReleaseQuery. This is in preparation for more generic coverage visualization pages. | ||||
* | refactor coverage tests/mocks | Bryan Newbold | 2020-07-30 | 5 | -39/+80 |
| | |||||
* | move container _stats enrichment to routes | Bryan Newbold | 2020-07-30 | 2 | -9/+4 |
| | | | | | These were being added to many views which didn't need them (eg, metadata, editing views) | ||||
* | coverage test mock fixes | Bryan Newbold | 2020-07-30 | 1 | -14/+51 |
| | |||||
* | web: move random article enrichment to special case | Bryan Newbold | 2020-07-30 | 2 | -6/+5 |
| | | | | | Instead of always enriching container entities with random articles, only do so for the primary container view. | ||||
* | lint coverage changes (so far) | Bryan Newbold | 2020-07-30 | 3 | -16/+4 |
| | |||||
* | update container view stats | Bryan Newbold | 2020-07-30 | 5 | -85/+158 |
| | | | | | | - show release type counts - new-style preservation status (single bar) - show release_type preservation break down on coverage page | ||||
* | preservation coverage updates (first round) | Bryan Newbold | 2020-07-30 | 4 | -32/+326 |
| | | | | | | | | | | - new by-year chart with stacked histograms of all 4 preservation statuses - new-style single progress bar showing overall preservation status - new by-volume query and chart Old endpoints are left as-is, with the intention of having them "deprecated" for some time span until entirely removing them. | ||||
* | experimentally update semantic-ui to fomantic-ui 2.8.6 | Bryan Newbold | 2020-07-30 | 1 | -4/+4 |
| | | | | | | | | | | fomatic-ui is a "community fork" which has had more active recent feature additions, though i'm not sure whether the quality has been as good as the main semantic-ui project. the proximal motivation to upgrade/switch is to get multi-bar progress bars, to display overall preservation status in a single bar as a fraction. | ||||
* | include new-style preservation+release_type aggs in container stats | Bryan Newbold | 2020-07-30 | 2 | -5/+47 |
| | |||||
* | graphics: handle empty coverage years | Bryan Newbold | 2020-07-30 | 1 | -7/+8 |
| | |||||
* | add regression test for broken container coverage | Bryan Newbold | 2020-07-30 | 2 | -57/+98 |
| | | | | also shuffle around search/coverage test files | ||||
* | update front-page counts | Bryan Newbold | 2020-07-28 | 1 | -3/+3 |
| |