Commit message (Collapse) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
* | | Merge branch 'bnewbold-match-get' | Bryan Newbold | 2021-11-02 | 4 | -9/+60 | |
|\ \ | ||||||
| * | | match: fix access_options in return | Bryan Newbold | 2021-10-18 | 1 | -3/+7 | |
| | | | ||||||
| * | | access: populate thumbnail_url for PDFs | Bryan Newbold | 2021-10-18 | 1 | -3/+9 | |
| | | | ||||||
| * | | add GET w/ query params to reference match endpoint (and JSON version) | Bryan Newbold | 2021-10-18 | 3 | -6/+47 | |
| |/ | ||||||
* / | pubmed: switch default http site to retrieve update files | Martin Czygan | 2021-10-15 | 1 | -2/+4 | |
|/ | | | | | | | Proxy started to throw: "dial tcp: lookup ftp.ncbi.nlm.nih.gov on [::1]:53: read udp [::1]:45178->[::1]:53: read: connection refused" NIH has a http version on it's own, try to use that. | |||||
* | web: minor typo correction | Bryan Newbold | 2021-10-13 | 1 | -1/+1 | |
| | ||||||
* | web: editor username /u/<username> helper | Bryan Newbold | 2021-10-13 | 2 | -0/+16 | |
| | ||||||
* | web: container lookup and display features | Bryan Newbold | 2021-10-13 | 3 | -7/+13 | |
| | ||||||
* | python: additional test coverage for v0.4 changes | Bryan Newbold | 2021-10-13 | 2 | -2/+19 | |
| | ||||||
* | dblp import: basic support for handles as identifiers | Bryan Newbold | 2021-10-13 | 1 | -1/+5 | |
| | ||||||
* | python: normalization/validation support for handle identifiers (hdl) | Bryan Newbold | 2021-10-13 | 1 | -0/+33 | |
| | ||||||
* | dblp import: fix typos in identifier parsing | Bryan Newbold | 2021-10-13 | 1 | -2/+1 | |
| | ||||||
* | python: partial importer utilization of new schema changes | Bryan Newbold | 2021-10-13 | 3 | -6/+18 | |
| | ||||||
* | python: test coverage of rust schema changes | Bryan Newbold | 2021-10-13 | 4 | -2/+59 | |
| | ||||||
* | python: implement ES schema changes | Bryan Newbold | 2021-10-13 | 1 | -4/+17 | |
| | ||||||
* | web: implement new schema changes | Bryan Newbold | 2021-10-13 | 6 | -11/+45 | |
| | ||||||
* | Merge branch 'bnewbold-ingest-tweaks' into 'master' | bnewbold | 2021-10-02 | 4 | -39/+139 | |
|\ | | | | | | | | | ingest importer behavior tweaks See merge request webgroup/fatcat!120 | |||||
| * | kafka import: optional 'force-flush' mode for some importers | Bryan Newbold | 2021-10-01 | 2 | -0/+16 | |
| | | | | | | | | Behavior and motivation described in the kafka json import comment. | |||||
| * | new SPN web (html) importer | Bryan Newbold | 2021-10-01 | 3 | -27/+111 | |
| | | ||||||
| * | ingest importer behavior tweaks | Bryan Newbold | 2021-10-01 | 1 | -8/+8 | |
| | | | | | | | | | | - change order of 'want()' checks, so that result counts are clearer - don't require GROBID success for file imports with SPN | |||||
| * | importer common: more verbose logging (with counts) | Bryan Newbold | 2021-10-01 | 1 | -4/+4 | |
| | | ||||||
* | | datacite: skip empty abstracts | Martin Czygan | 2021-10-01 | 4 | -2/+95 | |
|/ | | | | | Do not add abstracts where `clean` results in the empty string - this violates a constraint: `either abstract_sha1 or content is required` | |||||
* | default ingest request topic now '-daily'; configurable for ingest_tool.py | Bryan Newbold | 2021-09-30 | 4 | -4/+9 | |
| | ||||||
* | Merge branch 'martin-pubmed-ftp-extramuros' into 'master' | Martin Czygan | 2021-09-09 | 1 | -24/+21 | |
|\ | | | | | | | | | pubmed: workaround a networking issue See merge request webgroup/fatcat!118 | |||||
| * | pubmed: workaround a networking issue | Martin Czygan | 2021-09-09 | 1 | -24/+21 | |
| | | | | | | | | | | | | use an http proxy (https://github.com/miku/ftpup) to fetch files from FTP, keep some retry logic; also, hardcoding the proxy path as this should be a temporary workaround | |||||
* | | trivial blank line lint | Bryan Newbold | 2021-09-08 | 1 | -1/+0 | |
|/ | ||||||
* | pubmed: add option to ftp download with lftp | Martin Czygan | 2021-09-08 | 1 | -2/+31 | |
| | | | | | lftp is a classic command line ftp client, and we hope that its retry capabilities are enough of a workaround for the current networking issue | |||||
* | pubmed harvester: add basic retry logic | Martin Czygan | 2021-08-20 | 1 | -8/+21 | |
| | | | | | | | | Related to a previous issue with seemingly random EOFError from FTP connections, this patch wrap "ftpretr" helper function with a basic retry. Refs: fatcat-workers/issues/92151, fatcat-workers/issues/91102 | |||||
* | web: fix stats rowspan (oops) | Bryan Newbold | 2021-08-12 | 1 | -1/+1 | |
| | ||||||
* | web: remove confusing 'references' row from stats table | Bryan Newbold | 2021-08-12 | 1 | -3/+0 | |
| | | | | Now that we have refcat, which is a different number | |||||
* | refs: default to *not* consolidating works | Bryan Newbold | 2021-08-06 | 1 | -1/+1 | |
| | | | | | | | We don't handle counts for consolidated refs yet, so just don't consolidate. This should fix, eg, "Showing 1-18 of 19" type UX confusion, with the trade-off that some works will be duplicated in inbound ref tables. | |||||
* | web: update front-page static stats | Bryan Newbold | 2021-08-06 | 1 | -3/+3 | |
| | ||||||
* | refs: format (commas) large refs hit counts | Bryan Newbold | 2021-08-06 | 1 | -1/+1 | |
| | ||||||
* | refs web: correct URL to refs section of guide | Bryan Newbold | 2021-08-04 | 1 | -1/+1 | |
| | ||||||
* | refs: web UI tweaks for iterated CSL schema | Bryan Newbold | 2021-08-03 | 2 | -6/+26 | |
| | ||||||
* | refs: fix typo preventing CSL from rendering in refs output | Bryan Newbold | 2021-07-27 | 1 | -1/+1 | |
| | ||||||
* | refs: start the most basic/minimal web refs test coverage ('integration' level) | Bryan Newbold | 2021-07-27 | 4 | -0/+1094 | |
| | ||||||
* | refs: revert fatcat-pubmed -> pubmed truncation | Bryan Newbold | 2021-07-27 | 1 | -4/+1 | |
| | | | | This was just going to be confusing | |||||
* | refs: lint fixes | Bryan Newbold | 2021-07-27 | 2 | -2/+3 | |
| | ||||||
* | refs: several small improvements to web UI | Bryan Newbold | 2021-07-27 | 5 | -35/+71 | |
| | ||||||
* | refs: slightly better match form (will change) | Bryan Newbold | 2021-07-27 | 1 | -42/+46 | |
| | ||||||
* | refs: show up to 8 authors in summary tables | Bryan Newbold | 2021-07-27 | 1 | -4/+4 | |
| | ||||||
* | refs: support for wikipedia outbound refs, and display in tables | Bryan Newbold | 2021-07-27 | 4 | -8/+69 | |
| | ||||||
* | refs: fix offset/limit bug | Bryan Newbold | 2021-07-27 | 1 | -1/+1 | |
| | ||||||
* | refs: generalize web endpoints; JSON content negotiation; openlibrary ↵ | Bryan Newbold | 2021-07-23 | 4 | -41/+166 | |
| | | | | inbound view; etc | |||||
* | refs: change mind about URL structure again | Bryan Newbold | 2021-07-23 | 1 | -2/+2 | |
| | ||||||
* | web: refactor refs table into separate refs_macros file | Bryan Newbold | 2021-07-23 | 3 | -74/+127 | |
| | ||||||
* | refs: small refactors/tweaks | Bryan Newbold | 2021-07-23 | 1 | -11/+17 | |
| | ||||||
* | remove unused imports (lint) | Bryan Newbold | 2021-07-23 | 3 | -8/+4 | |
| | ||||||
* | web: always log upstream errors (may be redundant) | Bryan Newbold | 2021-07-23 | 1 | -0/+2 | |
| |