Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | datacite: more careful title string access; fixes sentry #88350 | Martin Czygan | 2021-06-11 | 4 | -2/+97 |
| | | | | | Caused by a partial "title entry without title" coming *first* (e.g. just holding, e.g. a language, like: {'lang': 'da'} | ||||
* | clean_doi() should lower-case returned DOI | Bryan Newbold | 2021-06-07 | 1 | -1/+4 |
| | | | | | | | | | | Code in a number of places (including Pubmed importer) assumed that this was already lower-casing DOIs, resulting in some broken metadata getting created. See also: https://github.com/internetarchive/fatcat/issues/83 This is just the first step of mitigation. | ||||
* | web: fix DOAJ article links (remove trailing slash) | Bryan Newbold | 2021-06-04 | 1 | -1/+1 |
| | |||||
* | dblp tests: skip redundant seek(0) | Bryan Newbold | 2021-06-03 | 1 | -6/+1 |
| | |||||
* | ingest: swap ingest and file checks, to result in clearer stats/counts of ↵ | Bryan Newbold | 2021-06-03 | 1 | -2/+2 |
| | | | | skipping | ||||
* | ingest: don't accept mag and s2 URLs | Bryan Newbold | 2021-06-03 | 1 | -4/+4 |
| | |||||
* | bump fuzzycat dependency to 0.1.21 | Bryan Newbold | 2021-06-02 | 2 | -20/+18 |
| | |||||
* | web: fix spacing for doaj/dblp identifiers in SERP | Bryan Newbold | 2021-05-31 | 1 | -1/+1 |
| | |||||
* | ingest: don't 'track_total_hits' for ES 7.x count() | Bryan Newbold | 2021-05-31 | 1 | -1/+1 |
| | |||||
* | web: bugfix dblp vs. doaj display logic | Bryan Newbold | 2021-05-31 | 1 | -1/+1 |
| | |||||
* | update fuzzycat to 0.1.20 | Bryan Newbold | 2021-05-31 | 2 | -31/+94 |
| | |||||
* | makefile: add pylint -E invocation to 'make lint', to match CI | Bryan Newbold | 2021-05-25 | 1 | -0/+1 |
| | |||||
* | skip pylint on 'assigning-non-slot' warnings in Flask 2.0 | Bryan Newbold | 2021-05-25 | 1 | -2/+2 |
| | | | | | | | | | | | | | | The 'permanent' field is still valid to set to a boolean in Flask 2.0; not sure why pylint is unhappy in CI (causing test failures). Don't see any problem running test suite locally. Flask API docs: https://flask.palletsprojects.com/en/2.0.x/api/?highlight=permanent#flask.session.permanent And code (recent master branch): https://github.com/pallets/flask/blob/4240ace59710d86c478111affd4ad6fb4c8cad9e/src/flask/sessions.py#L20 | ||||
* | changelog worker: fix file/fileset typo, caught by lint | Bryan Newbold | 2021-05-25 | 1 | -1/+1 |
| | | | | | This would have been resulting in some releases not getting re-indexed into search. | ||||
* | small python lint fixes (no behavior change) | Bryan Newbold | 2021-05-25 | 5 | -6/+4 |
| | |||||
* | bump Flask to 2.x; other deps upgraded automatically | Bryan Newbold | 2021-05-21 | 2 | -152/+167 |
| | |||||
* | ingest: add per-container ingest type overrides | Bryan Newbold | 2021-05-21 | 2 | -1/+23 |
| | |||||
* | fix arabesque sqlite3 examples to have 14-digit timestamps | Bryan Newbold | 2021-05-21 | 1 | -0/+0 |
| | |||||
* | arabesque importer: ensure full 14-digit timestamps | Bryan Newbold | 2021-05-21 | 1 | -1/+3 |
| | |||||
* | Andrew W. Mellon Foundation | Bryan Newbold | 2021-05-18 | 2 | -3/+3 |
| | |||||
* | Merge branch 'bnewbold-pipenv-cleanup' into 'master' | bnewbold | 2021-04-23 | 2 | -327/+277 |
|\ | | | | | | | | | pipenv cleanup See merge request webgroup/fatcat!104 | ||||
| * | pipenv: re-lock project | Bryan Newbold | 2021-04-19 | 1 | -301/+253 |
| | | |||||
| * | pipenv: constrain most package versions to at least major | Bryan Newbold | 2021-04-19 | 1 | -24/+24 |
| | | | | | | | | | | | | | | | | | | Don't have a complete policy with this change, just locking things down a bit more so small package additions and updates don't end up upgrading some small dependency to a major new backwards-incompatible version. Also, correct bs4 -> beautifulsoup4 (bs4 is the import name, not the package name) | ||||
| * | pipenv: remove unused pg-view and pykafka libraries | Bryan Newbold | 2021-04-19 | 1 | -2/+0 |
| | | |||||
* | | web: fix edit form style guide links | Bryan Newbold | 2021-04-20 | 2 | -4/+4 |
|/ | |||||
* | transforms: fix 'display_ame' typo | Bryan Newbold | 2021-04-19 | 1 | -2/+2 |
| | |||||
* | web: expand release creators in more situations | Bryan Newbold | 2021-04-19 | 2 | -2/+2 |
| | |||||
* | fix public API links | Bryan Newbold | 2021-04-15 | 1 | -2/+2 |
| | |||||
* | fix 'colected' typos | Bryan Newbold | 2021-04-13 | 1 | -1/+1 |
| | | | | Thanks for the catch martin | ||||
* | prefer contrib.creator.display_name over contrib.raw_name | Bryan Newbold | 2021-04-12 | 4 | -9/+17 |
| | | | | | | | | These will be getting updates from ORCID and are usually more complete and more correct for display, attribution, and search purposes. Might need to tweak fuzzycat code to handle multiple names at the verification stage. | ||||
* | make dblp tests more robust | Bryan Newbold | 2021-04-12 | 1 | -2/+11 |
| | | | | | | These were causing a lot of spurious errors in local development. Not sure these tweaks will entirely fix the problem. | ||||
* | web: show file size not known, when it isn't | Bryan Newbold | 2021-04-12 | 1 | -0/+2 |
| | | | | This is mostly to prevent showing an empty metadata box | ||||
* | web: better logic for showing 'save-paper-now' link | Bryan Newbold | 2021-04-12 | 1 | -0/+2 |
| | |||||
* | web: include DOI in share-your-paper URL, when possible | Bryan Newbold | 2021-04-12 | 1 | -2/+8 |
| | |||||
* | web: consistent public API URLs | Bryan Newbold | 2021-04-12 | 6 | -14/+9 |
| | |||||
* | web: improve preservation holdings display for containers | Bryan Newbold | 2021-04-12 | 1 | -10/+22 |
| | |||||
* | web: improve access button HTML | Bryan Newbold | 2021-04-12 | 2 | -3/+2 |
| | |||||
* | web: add goatcounter analytics | Bryan Newbold | 2021-04-12 | 3 | -0/+16 |
| | | | | Same setup as scholar.archive.org | ||||
* | es worker: ensure kafka messages get cleared | Bryan Newbold | 2021-04-12 | 1 | -0/+2 |
| | |||||
* | es indexing: more 'wip' fixes | Bryan Newbold | 2021-04-12 | 1 | -1/+5 |
| | |||||
* | ES indexing: skip 'wip' entities with a warning | Bryan Newbold | 2021-04-12 | 1 | -11/+16 |
| | |||||
* | fatcat_ingest: fix recent lint failure | Bryan Newbold | 2021-04-09 | 1 | -1/+1 |
| | |||||
* | search: more ES 7.x changes (track total counts) | Bryan Newbold | 2021-04-09 | 2 | -0/+12 |
| | |||||
* | container ES index worker: support for querying status | Bryan Newbold | 2021-04-06 | 2 | -5/+37 |
| | |||||
* | transform tool: container transform stats lookup support | Bryan Newbold | 2021-04-06 | 2 | -2/+27 |
| | |||||
* | ES schema updates: doc_index_ts as a str, not datetime | Bryan Newbold | 2021-04-06 | 1 | -4/+4 |
| | | | | | The schema is a timestamp, but python needs to serialize as JSON, and doesn't do datetime automatically. | ||||
* | web infra: log to stderr | Bryan Newbold | 2021-04-06 | 1 | -2/+4 |
| | |||||
* | search container stats: changes to be called from index code path | Bryan Newbold | 2021-04-06 | 2 | -3/+20 |
| | | | | Eg, allowing injection of more config values | ||||
* | container search schema: preservation stats, new fields | Bryan Newbold | 2021-04-06 | 2 | -7/+60 |
| | | | | Includes transform code updates and partial test coverage. | ||||
* | release ES: add discipline field | Bryan Newbold | 2021-04-06 | 1 | -0/+2 |
| |