aboutsummaryrefslogtreecommitdiffstats
path: root/sql
Commit message (Collapse)AuthorAgeFilesLines
* new 'daily' and 'priority' ingest request topicsBryan Newbold2021-09-302-2/+2
| | | | | | | | | The old ingest request queue was always getting lopsided, suspect because it was scaled up (additional partitions) at some point in the past, hoping new topics will fix this. New '-priority' queue is like '-bulk', but for smaller-volume SPN-like requests. Eg, interactive mode.
* reingest: skip spn2 'unknown' errorsBryan Newbold2021-07-212-0/+2
|
* crossref DB proposal, and include in SQL schemaBryan Newbold2021-06-021-0/+7
|
* sql: do periodically retry spn2-wayback-errorBryan Newbold2021-04-272-2/+0
|
* reingest scripts to run as sandcrawlerBryan Newbold2021-04-092-12/+12
|
* sql: notes on sql restoreBryan Newbold2021-04-091-0/+9
|
* sql: update paths to work with svc506 machineBryan Newbold2021-04-0912-49/+49
|
* sql: before/after pg13 table size statsBryan Newbold2021-04-092-1/+43
|
* sql: update periodic retry/reingest scriptsBryan Newbold2021-04-094-6/+14
|
* SQL snapshot doc updateBryan Newbold2021-04-071-2/+5
|
* 2021-04-07 sandcrawler DB statsBryan Newbold2021-04-071-0/+428
|
* SQL: more ingest monitoringBryan Newbold2020-11-163-1/+660
|
* tweak html_meta SQL schemaBryan Newbold2020-11-031-2/+2
|
* SQL: unmatched glutton query (old)Bryan Newbold2020-11-031-0/+19
|
* monitoring: past-7-days summary queryBryan Newbold2020-11-031-0/+26
|
* html: start on SQL tableBryan Newbold2020-11-031-0/+15
|
* SQL: update weekly/quarterly ingest retry scriptsBryan Newbold2020-10-215-18/+119
|
* sql stats: larger limits (more complete lists)Bryan Newbold2020-10-211-8/+8
|
* update SQL ingest monitoring commands to be past-month by defaultBryan Newbold2020-10-171-5/+5
|
* dump_file_meta helperBryan Newbold2020-10-011-0/+12
|
* updated sandcrawler-db statsBryan Newbold2020-09-152-6/+346
|
* WIP weekly re-ingest scriptBryan Newbold2020-08-172-0/+97
|
* grobid+pdftext missing catch-up commandsBryan Newbold2020-08-054-10/+49
|
* commit stats from a couple weeks backBryan Newbold2020-08-051-0/+347
|
* sql stats commands updatesBryan Newbold2020-08-051-2/+2
|
* commented special modes for dump_unextracted_pdf.sqlBryan Newbold2020-06-251-1/+4
|
* pdftrio SQL queriesBryan Newbold2020-06-251-0/+65
|
* SQL commands for re-trying PDF ingestsBryan Newbold2020-06-251-0/+158
|
* unextracted PDF job dump commandBryan Newbold2020-06-251-0/+16
|
* tweak pdf_meta SQL schemaBryan Newbold2020-06-171-0/+26
|
* update sandcrawler stats for early mayBryan Newbold2020-05-041-0/+418
|
* more monitoring queriesBryan Newbold2020-03-301-5/+29
|
* make monitoring commands ingest_request local, not ingest_file_resultBryan Newbold2020-03-171-2/+2
|
* DOI prefix example queries (SQL)Bryan Newbold2020-03-101-3/+17
|
* helpful daily/weekly monitoring SQL queriesBryan Newbold2020-03-101-0/+94
|
* sandcrawler schema: add MD5 indexBryan Newbold2020-03-051-0/+1
|
* more SQL queriesBryan Newbold2020-03-021-0/+57
|
* recent sandcrawler-db / ingest stats (interesting)Bryan Newbold2020-02-242-0/+488
|
* dump_regrobid_pdf_petabox.sql scriptBryan Newbold2020-02-121-0/+15
|
* sandcrawler-db extra statsBryan Newbold2020-02-121-0/+42
|
* pdftrio proposal and start on schema+kafkaBryan Newbold2020-02-121-0/+13
|
* more random sandcrawler-db queriesBryan Newbold2020-02-032-32/+62
|
* more SQL commandsBryan Newbold2020-02-021-0/+15
|
* sql stats: typo fixBryan Newbold2020-01-281-1/+1
|
* sql howto: database dumpsBryan Newbold2020-01-281-0/+7
|
* clarify ingest result schema and semanticsBryan Newbold2020-01-151-0/+16
|
* database statsBryan Newbold2020-01-142-0/+289
|
* sql: more cool random queriesBryan Newbold2020-01-021-0/+5
|
* SQL docs update for diesel changeBryan Newbold2020-01-022-0/+48
|
* move SQL schema to diesel migration patternBryan Newbold2020-01-025-70/+157
|
generated by cgit v1.2.3 (git 2.39.1) at 2024-11-25 20:07:06 +0000