aboutsummaryrefslogtreecommitdiffstats
path: root/python
Commit message (Collapse)AuthorAgeFilesLines
...
* entity updater: es['publisher_type'] not always setBryan Newbold2020-08-141-1/+1
| | | | This is a small bugfix for a production issue.
* Merge branch 'bnewbold-ingest-improvements' into 'master'Martin Czygan2020-08-138-38/+120
|\ | | | | | | | | ingest behavior changes; some datacite metadata tweaks See merge request webgroup/fatcat!78
| * entity update: change big5 ingest behaviorBryan Newbold2020-08-111-9/+15
| | | | | | | | | | | | | | | | | | In addition to changing the OA default, this was the main intended behavior change in this group of commits: want to ingest fewer attempts that we *expect* to fail, but default to ingest/crawl attempt if we are uncertain. This is because there is a long tail of journals that register DOIs and are defacto OA (fulltext is available), but we don't have metadata indicating them as such.
| * datacite importer: update test cases for 'Additional file' as component, not ↵Bryan Newbold2020-08-115-5/+5
| | | | | | | | stub
| * entity update: default to ingest non-OA worksBryan Newbold2020-08-111-9/+10
| |
| * entity update: skip ingest of figshare+zenodo 'group' DOIsBryan Newbold2020-08-111-0/+15
| |
| * datacite import: figshare-specific hacksBryan Newbold2020-08-112-3/+4
| |
| * datacite import: refactor release_type detection into static methodBryan Newbold2020-08-111-14/+51
| |
| * datacite import: refactor publisher-specific hacks into static methodBryan Newbold2020-08-111-15/+29
| | | | | | | | Also tweak title/publisher detection to use DOI prefixes
| * update crawl blocklist for SPNv2 requests which mostly failBryan Newbold2020-08-101-2/+10
| |
* | harvest: datacite API yields HTTP 200 with broken JSONMartin Czygan2020-08-101-1/+8
|/ | | | As a first step: log response body for debugging.
* release ES transform tweaksBryan Newbold2020-08-071-3/+5
| | | | | | | | pass-through publisher_type from container extra metadata (ES field already existed; this is from newer chocula metadata) count arxiv and PMCID papers which haven't been crawled (by IA) as "dark", not "bright"
* chocula import update tweaksBryan Newbold2020-08-041-10/+14
|
* more update keys and cases for chocula importerBryan Newbold2020-08-041-5/+11
|
* fix key name mismatch in chocula importerBryan Newbold2020-08-041-1/+1
| | | | chocula 'export-fatcat' uses 'ident', not 'fatcat_ident'
* web: add links to deletion pages from edit pagesBryan Newbold2020-07-314-0/+13
|
* editing: withdrawn_status, release_yearBryan Newbold2020-07-312-24/+44
|
* release form validators and tweak labelsBryan Newbold2020-07-311-8/+37
|
* fix typo bug resulting in lost/bad ext_id web editsBryan Newbold2020-07-312-2/+16
|
* implement webface entity deletionBryan Newbold2020-07-313-27/+308
|
* routes: handle case of viewing deleted entity in editgroup contextBryan Newbold2020-07-304-8/+35
| | | | | | Eg, consider deleting an entity. When viewing the editgroup, want to be able to click the deleted entity and see the "deleted entity" page instead of a generic 404.
* remove some meta-fields from TOML form (all entities)Bryan Newbold2020-07-301-1/+5
|
* fix search redirect codes in new testsBryan Newbold2020-07-301-4/+4
|
* wire up new TOML viewsBryan Newbold2020-07-3014-83/+256
|
* generic HTML views for TOML editingBryan Newbold2020-07-304-0/+80
|
* editing: more 'raise' status instead of 'abort()'Bryan Newbold2020-07-301-1/+1
|
* generic helpers for TOML editing routesBryan Newbold2020-07-302-10/+201
|
* basic toml transform helperBryan Newbold2020-07-303-4/+42
|
* pipenv: lock pycountry to 19.10 versionBryan Newbold2020-07-302-7/+7
| | | | datacite importer had errors otherwise
* pipenv: add toml library (and update lock)Bryan Newbold2020-07-302-276/+327
|
* lock loginpass version to prevent conflicting authlib versionBryan Newbold2020-07-301-1/+1
| | | | | May be possible to upgrade both of these libraries together, but that isn't the purpose of current development.
* simple search route increased coverageBryan Newbold2020-07-301-0/+27
|
* comments documenting tuple/dict types in graphics.pyBryan Newbold2020-07-301-0/+11
|
* minor lint fixesBryan Newbold2020-07-302-3/+1
|
* control shadow preservation display with a flagBryan Newbold2020-07-305-19/+80
|
* coverage search: 'recent' endpoint test (minimal)Bryan Newbold2020-07-301-1/+32
|
* release search: fix fulltext_only checkbox (from query object)Bryan Newbold2020-07-302-1/+2
|
* search: 'recent' mode for coverage searchBryan Newbold2020-07-304-7/+134
|
* expand test coverage of new preservation viewsBryan Newbold2020-07-301-15/+122
|
* first iteration of flexible search coverageBryan Newbold2020-07-305-2/+148
|
* make some ES agg methods work on general queriesBryan Newbold2020-07-302-32/+58
| | | | | | | Eg, instead of container-specific year histogram, have the histogram fetch function take a ReleaseQuery. This is in preparation for more generic coverage visualization pages.
* refactor coverage tests/mocksBryan Newbold2020-07-305-39/+80
|
* move container _stats enrichment to routesBryan Newbold2020-07-302-9/+4
| | | | | These were being added to many views which didn't need them (eg, metadata, editing views)
* coverage test mock fixesBryan Newbold2020-07-301-14/+51
|
* web: move random article enrichment to special caseBryan Newbold2020-07-302-6/+5
| | | | | Instead of always enriching container entities with random articles, only do so for the primary container view.
* lint coverage changes (so far)Bryan Newbold2020-07-303-16/+4
|
* update container view statsBryan Newbold2020-07-305-85/+158
| | | | | | - show release type counts - new-style preservation status (single bar) - show release_type preservation break down on coverage page
* preservation coverage updates (first round)Bryan Newbold2020-07-304-32/+326
| | | | | | | | | | - new by-year chart with stacked histograms of all 4 preservation statuses - new-style single progress bar showing overall preservation status - new by-volume query and chart Old endpoints are left as-is, with the intention of having them "deprecated" for some time span until entirely removing them.
* experimentally update semantic-ui to fomantic-ui 2.8.6Bryan Newbold2020-07-301-4/+4
| | | | | | | | | | fomatic-ui is a "community fork" which has had more active recent feature additions, though i'm not sure whether the quality has been as good as the main semantic-ui project. the proximal motivation to upgrade/switch is to get multi-bar progress bars, to display overall preservation status in a single bar as a fraction.
* include new-style preservation+release_type aggs in container statsBryan Newbold2020-07-302-5/+47
|
generated by cgit v1.2.3 (git 2.39.1) at 2024-11-28 21:58:38 +0000