Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | editing: more 'raise' status instead of 'abort()' | Bryan Newbold | 2020-07-30 | 1 | -1/+1 |
| | |||||
* | generic helpers for TOML editing routes | Bryan Newbold | 2020-07-30 | 2 | -10/+201 |
| | |||||
* | basic toml transform helper | Bryan Newbold | 2020-07-30 | 3 | -4/+42 |
| | |||||
* | pipenv: lock pycountry to 19.10 version | Bryan Newbold | 2020-07-30 | 2 | -7/+7 |
| | | | | datacite importer had errors otherwise | ||||
* | pipenv: add toml library (and update lock) | Bryan Newbold | 2020-07-30 | 2 | -276/+327 |
| | |||||
* | lock loginpass version to prevent conflicting authlib version | Bryan Newbold | 2020-07-30 | 1 | -1/+1 |
| | | | | | May be possible to upgrade both of these libraries together, but that isn't the purpose of current development. | ||||
* | simple search route increased coverage | Bryan Newbold | 2020-07-30 | 1 | -0/+27 |
| | |||||
* | comments documenting tuple/dict types in graphics.py | Bryan Newbold | 2020-07-30 | 1 | -0/+11 |
| | |||||
* | minor lint fixes | Bryan Newbold | 2020-07-30 | 2 | -3/+1 |
| | |||||
* | control shadow preservation display with a flag | Bryan Newbold | 2020-07-30 | 5 | -19/+80 |
| | |||||
* | coverage search: 'recent' endpoint test (minimal) | Bryan Newbold | 2020-07-30 | 1 | -1/+32 |
| | |||||
* | release search: fix fulltext_only checkbox (from query object) | Bryan Newbold | 2020-07-30 | 2 | -1/+2 |
| | |||||
* | search: 'recent' mode for coverage search | Bryan Newbold | 2020-07-30 | 4 | -7/+134 |
| | |||||
* | expand test coverage of new preservation views | Bryan Newbold | 2020-07-30 | 1 | -15/+122 |
| | |||||
* | first iteration of flexible search coverage | Bryan Newbold | 2020-07-30 | 5 | -2/+148 |
| | |||||
* | make some ES agg methods work on general queries | Bryan Newbold | 2020-07-30 | 2 | -32/+58 |
| | | | | | | | Eg, instead of container-specific year histogram, have the histogram fetch function take a ReleaseQuery. This is in preparation for more generic coverage visualization pages. | ||||
* | refactor coverage tests/mocks | Bryan Newbold | 2020-07-30 | 5 | -39/+80 |
| | |||||
* | move container _stats enrichment to routes | Bryan Newbold | 2020-07-30 | 2 | -9/+4 |
| | | | | | These were being added to many views which didn't need them (eg, metadata, editing views) | ||||
* | coverage test mock fixes | Bryan Newbold | 2020-07-30 | 1 | -14/+51 |
| | |||||
* | web: move random article enrichment to special case | Bryan Newbold | 2020-07-30 | 2 | -6/+5 |
| | | | | | Instead of always enriching container entities with random articles, only do so for the primary container view. | ||||
* | lint coverage changes (so far) | Bryan Newbold | 2020-07-30 | 3 | -16/+4 |
| | |||||
* | update container view stats | Bryan Newbold | 2020-07-30 | 5 | -85/+158 |
| | | | | | | - show release type counts - new-style preservation status (single bar) - show release_type preservation break down on coverage page | ||||
* | preservation coverage updates (first round) | Bryan Newbold | 2020-07-30 | 4 | -32/+326 |
| | | | | | | | | | | - new by-year chart with stacked histograms of all 4 preservation statuses - new-style single progress bar showing overall preservation status - new by-volume query and chart Old endpoints are left as-is, with the intention of having them "deprecated" for some time span until entirely removing them. | ||||
* | experimentally update semantic-ui to fomantic-ui 2.8.6 | Bryan Newbold | 2020-07-30 | 1 | -4/+4 |
| | | | | | | | | | | fomatic-ui is a "community fork" which has had more active recent feature additions, though i'm not sure whether the quality has been as good as the main semantic-ui project. the proximal motivation to upgrade/switch is to get multi-bar progress bars, to display overall preservation status in a single bar as a fraction. | ||||
* | include new-style preservation+release_type aggs in container stats | Bryan Newbold | 2020-07-30 | 2 | -5/+47 |
| | |||||
* | graphics: handle empty coverage years | Bryan Newbold | 2020-07-30 | 1 | -7/+8 |
| | |||||
* | add regression test for broken container coverage | Bryan Newbold | 2020-07-30 | 2 | -57/+98 |
| | | | | also shuffle around search/coverage test files | ||||
* | update front-page counts | Bryan Newbold | 2020-07-28 | 1 | -3/+3 |
| | |||||
* | switch SERP stage coloring to brown uppercase | Bryan Newbold | 2020-07-28 | 1 | -13/+11 |
| | | | | To match fatcat-scholor, where this scheme has been successful. | ||||
* | error handling: use 400 page with error passed instead of flash() | Bryan Newbold | 2020-07-28 | 3 | -21/+23 |
| | |||||
* | remove some spurious print statements | Bryan Newbold | 2020-07-28 | 2 | -4/+1 |
| | |||||
* | convert some API errors from abort() to raise | Bryan Newbold | 2020-07-28 | 2 | -14/+14 |
| | |||||
* | generic API error page | Bryan Newbold | 2020-07-28 | 2 | -0/+50 |
| | | | | | | | | | | This error handler and view page currently works much better than the "flash()" infrastructure built-in to flask, which uses cookies and mostly does not work with our views and layouts. Would like to gradually migrate almost all API errors in the web interface to just raising errors that get rendered on an error page, instead of calling `abort(ae.status)`. | ||||
* | search: catch ES errors and display better | Bryan Newbold | 2020-07-28 | 5 | -20/+46 |
| | |||||
* | refactor search macros into new file | Bryan Newbold | 2020-07-28 | 4 | -45/+72 |
| | |||||
* | include container_id as a query boost term | Bryan Newbold | 2020-07-28 | 1 | -0/+1 |
| | |||||
* | re-order search params to satisfy pylint | Bryan Newbold | 2020-07-24 | 1 | -6/+6 |
| | | | | | | Moved all the request_cache=True param calls to just before ES request exectuation. The former ordering "just worked", but pylint didn't like it, and I suspose it was not as idiomatic as it should have been. | ||||
* | small lint fixes | Bryan Newbold | 2020-07-24 | 2 | -3/+1 |
| | |||||
* | finish backend refactoring of search code | Bryan Newbold | 2020-07-24 | 2 | -135/+185 |
| | |||||
* | update web_search tests to mock ES client | Bryan Newbold | 2020-07-24 | 2 | -45/+47 |
| | | | | | | Instead of using 'responses' mock of 'requests' library. Tried using 'elasticmock' helper but it didn't work. | ||||
* | refactor release and container search | Bryan Newbold | 2020-07-24 | 6 | -136/+235 |
| | | | | | | | | | | Based on fatcat-scholar refactoring. This doesn't include refactoring of stats, aggregates, or histograms yet, just the direct queries. Don't have any test coverage yet; intend to try elasticmock or figuring out how to ingest mock JSON results directly. | ||||
* | web search: fix pylint error | Bryan Newbold | 2020-07-24 | 1 | -2/+2 |
| | |||||
* | WIP: refactoring search to use elasticsearch-dsl | Bryan Newbold | 2020-07-24 | 2 | -153/+137 |
| | |||||
* | Merge branch 'bnewbold-more-lint-fixes' into 'master' | Martin Czygan | 2020-07-24 | 14 | -34/+26 |
|\ | | | | | | | | | more lint fixes See merge request webgroup/fatcat!69 | ||||
| * | fix issnl typo in pubmed | Bryan Newbold | 2020-07-23 | 1 | -1/+1 |
| | | | | | | | | | | | | | | | | | | | | Oh no! This bug may actually have had significant negative impact on metadata in fatcat, in terms of missing container_id associations with pubmed entities. There are about 500k release entities with a PMID but no container_id. Of those, 89k have at least a container_name. Unclear how many would have matched to ISSN-L and thus to a container. | ||||
| * | remove isascii() work around definition in importers/datacite.py | Bryan Newbold | 2020-07-23 | 1 | -7/+1 |
| | | | | | | | | We are python3.7 now, so this isn't needed. | ||||
| * | simple lint (flake8) fixes over python codebase | Bryan Newbold | 2020-07-23 | 7 | -19/+18 |
| | | | | | | | | | | | | These should not have any behavior changes, though a number of exception catches are now more general, and there may be long-tail exceptions getting thrown in these statements. | ||||
| * | fix actual typo in tests (caught by lint) | Bryan Newbold | 2020-07-23 | 1 | -2/+2 |
| | | |||||
| * | simple lint (flake8) fixes in tests | Bryan Newbold | 2020-07-23 | 5 | -5/+4 |
| | | | | | | | | | | | | The pytest fixture syntax interacts weirdly with flake8 tests, so ignore the "redefinition" and "unused variable" errors more carefully for .py files under ./tests/ | ||||
* | | simplify in_kbart check statement | Bryan Newbold | 2020-07-23 | 1 | -1/+1 |
| | | | | | | | | Thanks @martin |