| Commit message (Collapse) | Author | Age | Files | Lines | |
|---|---|---|---|---|---|
| * | ES README: really need to limit to 1k esbulk batches | Bryan Newbold | 2020-02-26 | 1 | -3/+3 |
| | | |||||
| * | update ES transform README | Bryan Newbold | 2020-02-26 | 1 | -2/+3 |
| | | | | | | - smaller batch sizes to prevent esbulk errors - file transform/index | ||||
| * | ES container last tweaks | Bryan Newbold | 2020-02-26 | 1 | -3/+4 |
| | | |||||
| * | ES release: last minor tweaks | Bryan Newbold | 2020-02-26 | 1 | -3/+5 |
| | | |||||
| * | release schema: do doc_value on DOIs | Bryan Newbold | 2020-02-13 | 1 | -1/+1 |
| | | | | | | | Because DOIs are pseudo-structured (prefix, and often structure within the publisher-controlled area), I suspect we will in fact be wanting to do analytics over these strings. | ||||
| * | ES release: actually do want doc_values for work_id | Bryan Newbold | 2020-02-05 | 1 | -1/+1 |
| | | | | | Eg, for fast "unique count" | ||||
| * | fix axiv/arxiv typo in release schema | Bryan Newbold | 2020-02-04 | 1 | -1/+1 |
| | | |||||
| * | ES release schema: fix typo | Bryan Newbold | 2020-01-31 | 1 | -1/+1 |
| | | |||||
| * | fix json typos in changelog schema | Bryan Newbold | 2020-01-30 | 1 | -2/+2 |
| | | |||||
| * | add upper-case work-around from kibana map join | Bryan Newbold | 2020-01-30 | 1 | -0/+1 |
| | | |||||
| * | JSON typo in release mapping | Bryan Newbold | 2020-01-30 | 1 | -1/+0 |
| | | |||||
| * | ES schemas: make keywords case-insensitive by default | Bryan Newbold | 2020-01-30 | 4 | -66/+115 |
| | | | | | But not applying asciifolding; don't see any need to do so? | ||||
| * | tweak file ES archive.org domain tracking | Bryan Newbold | 2020-01-30 | 1 | -0/+1 |
| | | |||||
| * | elastic schema fixes | Bryan Newbold | 2020-01-29 | 2 | -7/+7 |
| | | |||||
| * | add country to v03b release schema | Bryan Newbold | 2020-01-29 | 1 | -0/+1 |
| | | |||||
| * | update ES docs and proposal | Bryan Newbold | 2020-01-29 | 1 | -0/+2 |
| | | |||||
| * | actually implement changelog transform | Bryan Newbold | 2020-01-29 | 1 | -1/+10 |
| | | |||||
| * | ES release schema updates | Bryan Newbold | 2020-01-29 | 1 | -23/+46 |
| | | |||||
| * | container ES schema changes | Bryan Newbold | 2020-01-29 | 1 | -13/+20 |
| | | |||||
| * | first implementation of ES file schema | Bryan Newbold | 2020-01-29 | 1 | -0/+46 |
| | | | | | | Includes a trivial test and transform, but not any workers or doc updates. | ||||
| * | elasticsearch index alias howto | Bryan Newbold | 2019-06-06 | 1 | -1/+16 |
| | | |||||
| * | add work-in-progress elastic index notes | Bryan Newbold | 2019-05-30 | 1 | -0/+11 |
| | | |||||
| * | add 'superceded' release extra flag to elastic schema | Bryan Newbold | 2019-05-23 | 1 | -0/+1 |
| | | |||||
| * | also track work_id in release elasticsearch table | Bryan Newbold | 2019-05-22 | 1 | -0/+1 |
| | | |||||
| * | count linked refs (not just raw refs) in elasticsearch | Bryan Newbold | 2019-05-22 | 1 | -0/+1 |
| | | |||||
| * | include creator_ids in release elastic schema | Bryan Newbold | 2019-05-20 | 1 | -0/+1 |
| | | | | | Intent is to allow fast creator search/lookup | ||||
| * | elastic release schema update | Bryan Newbold | 2019-05-20 | 1 | -1/+6 |
| | | |||||
| * | faster elasticsearch imports | Bryan Newbold | 2019-04-30 | 1 | -1/+1 |
| | | |||||
| * | fix wild elastic schema typo | Bryan Newbold | 2019-04-12 | 1 | -1/+1 |
| | | |||||
| * | more integration of transform refactor | Bryan Newbold | 2019-03-11 | 1 | -2/+2 |
| | | |||||
| * | elastic schema indentation | Bryan Newbold | 2019-03-06 | 1 | -6/+6 |
| | | |||||
| * | include container_id in release ES schema | Bryan Newbold | 2019-02-22 | 1 | -0/+1 |
| | | |||||
| * | minor typo in esbulk container import | Bryan Newbold | 2019-01-28 | 1 | -1/+1 |
| | | |||||
| * | more ES index name updates | Bryan Newbold | 2019-01-28 | 1 | -2/+3 |
| | | |||||
| * | transform and import fixes/tweaks | Bryan Newbold | 2019-01-25 | 3 | -8/+122 |
| | | |||||
| * | tweak elastic schemas (again) | Bryan Newbold | 2019-01-25 | 2 | -6/+4 |
| | | |||||
| * | initial changelog and container ES schemas | Bryan Newbold | 2019-01-23 | 2 | -0/+113 |
| | | |||||
| * | start changes to release ES schema | Bryan Newbold | 2019-01-23 | 1 | -22/+39 |
| | | |||||
| * | state in elasticsearch (and deleted/redirects) | Bryan Newbold | 2019-01-18 | 1 | -0/+1 |
| | | |||||
| * | remove redundant transform_release.py ES script | Bryan Newbold | 2018-12-24 | 2 | -88/+1 |
| | | |||||
| * | implement release_year (and rustfmt) | Bryan Newbold | 2018-12-24 | 1 | -0/+2 |
| | | |||||
| * | updated docker for elastic (with plugin) | Bryan Newbold | 2018-11-07 | 3 | -44/+10 |
| | | | | | Still need to install the maps (aka, schemas) manually. | ||||
| * | note elastic plugin needed | Bryan Newbold | 2018-11-07 | 2 | -0/+52 |
| | | |||||
| * | for now, store is_longtail_oa in container_is_longtail_oa | Bryan Newbold | 2018-10-12 | 1 | -0/+2 |
| | | |||||
| * | document need to LC_ALL=C.UTF-8 for ES import | Bryan Newbold | 2018-09-28 | 1 | -1/+2 |
| | | |||||
| * | fix typo in elastic load script | Bryan Newbold | 2018-09-26 | 1 | -1/+1 |
| | | |||||
| * | ignore more files | Bryan Newbold | 2018-09-25 | 1 | -0/+1 |
| | | |||||
| * | fix typos in es/transform script | Bryan Newbold | 2018-09-25 | 1 | -3/+3 |
| | | |||||
| * | script for partitioning dumps (needs test) | Bryan Newbold | 2018-09-24 | 1 | -0/+1 |
| | | |||||
| * | fix typo/error in elastic schema | Bryan Newbold | 2018-09-24 | 1 | -1/+0 |
| | | |||||
 |
index : fatcat | |
| [no description] |
| aboutsummaryrefslogtreecommitdiffstats |