Commit message (Expand) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
| * | | pubmed ftp: fix url | Martin Czygan | 2020-02-19 | 1 | -4/+6 | |
| * | | pubmed ftp harvest and KafkaBs4XmlPusher | Martin Czygan | 2020-02-19 | 6 | -21/+307 | |
* | | | add --force-crawl flag to ingest tool | Bryan Newbold | 2020-03-02 | 1 | -0/+5 | |
| |/ |/| | ||||||
* | | pipenv: lock authlib to less than v0.13; rebuild lock file | Bryan Newbold | 2020-02-28 | 2 | -112/+109 | |
* | | ES README: really need to limit to 1k esbulk batches | Bryan Newbold | 2020-02-26 | 1 | -3/+3 | |
* | | Merge branch 'bnewbold-elastic-v03b' | Bryan Newbold | 2020-02-26 | 16 | -257/+674 | |
|\ \ | ||||||
| * | | improve is_oa flag accuracy | Bryan Newbold | 2020-02-26 | 2 | -10/+6 | |
| * | | update ES transform README | Bryan Newbold | 2020-02-26 | 1 | -2/+3 | |
| * | | fix fatcat_transform state filters | Bryan Newbold | 2020-02-26 | 1 | -4/+4 | |
| * | | bulk ES transform: skip non-active entities | Bryan Newbold | 2020-02-26 | 1 | -0/+8 | |
| * | | ES container last tweaks | Bryan Newbold | 2020-02-26 | 2 | -3/+7 | |
| * | | ES release: last minor tweaks | Bryan Newbold | 2020-02-26 | 2 | -5/+7 | |
| * | | ES updates: fix tests to accept archive.org in host/domain | Bryan Newbold | 2020-02-14 | 1 | -2/+3 | |
| * | | release schema: do doc_value on DOIs | Bryan Newbold | 2020-02-13 | 1 | -1/+1 | |
| * | | ES files: don't remove archive.org domains/hosts | Bryan Newbold | 2020-02-07 | 1 | -5/+0 | |
| * | | ES release: actually do want doc_values for work_id | Bryan Newbold | 2020-02-05 | 1 | -1/+1 | |
| * | | fix axiv/arxiv typo in release schema | Bryan Newbold | 2020-02-04 | 1 | -1/+1 | |
| * | | ES release schema: fix typo | Bryan Newbold | 2020-01-31 | 1 | -1/+1 | |
| * | | ES releases: host/domain fixes | Bryan Newbold | 2020-01-31 | 2 | -2/+5 | |
| * | | pipenv: lock zipp version to work around python3.6 requirement | Bryan Newbold | 2020-01-30 | 2 | -7/+20 | |
| * | | fix release es transform missing 'issue' | Bryan Newbold | 2020-01-30 | 1 | -0/+1 | |
| * | | fix json typos in changelog schema | Bryan Newbold | 2020-01-30 | 1 | -2/+2 | |
| * | | add upper-case work-around from kibana map join | Bryan Newbold | 2020-01-30 | 2 | -0/+2 | |
| * | | JSON typo in release mapping | Bryan Newbold | 2020-01-30 | 1 | -1/+0 | |
| * | | ES schemas: make keywords case-insensitive by default | Bryan Newbold | 2020-01-30 | 4 | -66/+115 | |
| * | | tweak file ES archive.org domain tracking | Bryan Newbold | 2020-01-30 | 2 | -0/+7 | |
| * | | implement host+domain parsing for file ES transform | Bryan Newbold | 2020-01-30 | 2 | -13/+8 | |
| * | | pipenv: add tldextract (url parser) and update deps | Bryan Newbold | 2020-01-30 | 2 | -136/+159 | |
| * | | fix ES file schema plural field names | Bryan Newbold | 2020-01-29 | 2 | -5/+4 | |
| * | | new biblio-only general search | Bryan Newbold | 2020-01-29 | 1 | -2/+2 | |
| * | | elastic schema fixes | Bryan Newbold | 2020-01-29 | 3 | -7/+12 | |
| * | | add country to v03b release schema | Bryan Newbold | 2020-01-29 | 2 | -0/+3 | |
| * | | update ES docs and proposal | Bryan Newbold | 2020-01-29 | 2 | -4/+6 | |
| * | | actually implement changelog transform | Bryan Newbold | 2020-01-29 | 3 | -19/+78 | |
| * | | fix some transform bugs, add some tests | Bryan Newbold | 2020-01-29 | 6 | -13/+48 | |
| * | | ES release schema updates | Bryan Newbold | 2020-01-29 | 2 | -28/+122 | |
| * | | container ES schema changes | Bryan Newbold | 2020-01-29 | 2 | -29/+38 | |
| * | | first implementation of ES file schema | Bryan Newbold | 2020-01-29 | 4 | -3/+115 | |
* | | | Merge branch 'bnewbold-more-ingest' into 'master' | bnewbold | 2020-02-25 | 1 | -1/+37 | |
|\ \ \ | ||||||
| * | | | entity worker: ingest more releases | Bryan Newbold | 2020-02-22 | 1 | -1/+37 | |
* | | | | add some more domain/rel URL mappings | Bryan Newbold | 2020-02-22 | 1 | -0/+9 | |
|/ / / | ||||||
* | | | table size snapshots | Bryan Newbold | 2020-02-19 | 2 | -0/+47 | |
* | | | Merge branch 'bnewbold-shadow-import' | Bryan Newbold | 2020-02-19 | 7 | -2/+289 | |
|\ \ \ | ||||||
| * | | | remove arabesque short wayback URL hack | Bryan Newbold | 2020-02-14 | 1 | -6/+0 | |
| * | | | clarify shadow filter code | Bryan Newbold | 2020-02-13 | 1 | -1/+1 | |
| * | | | filter out shadows-only files in webface | Bryan Newbold | 2020-02-13 | 2 | -2/+7 | |
| * | | | improve shadow import file url cleanup path | Bryan Newbold | 2020-02-13 | 1 | -2/+12 | |
| * | | | shadow import fixes from QA testing | Bryan Newbold | 2020-02-13 | 2 | -1/+7 | |
| * | | | shadow import: more filtering of file_meta fields | Bryan Newbold | 2020-02-13 | 3 | -18/+28 | |
| * | | | basic shadow importer | Bryan Newbold | 2020-02-13 | 5 | -0/+262 |