sandcrawler/sql, branch master [no description] https://git.bnewbold.net/sandcrawler/atom?h=master 2022-12-23T23:22:53+00:00 commit 2022-11-23 table sizes 2022-12-23T23:22:53+00:00 Bryan Newbold bnewbold@archive.org 2022-12-23T23:22:53+00:00 urn:sha1:c490144b8ab446c66544251a880dcacfee50a2d7 sql: Makefile for SQL dumps/uploads 2022-11-24T00:18:34+00:00 Bryan Newbold bnewbold@archive.org 2022-11-24T00:18:34+00:00 urn:sha1:a0608ea4e2e28a95be82857b7957cc4ee0e59a43 reingests: update scripts and SQL 2022-10-03T17:16:26+00:00 Bryan Newbold bnewbold@archive.org 2022-10-03T17:16:26+00:00 urn:sha1:54e14814080d9a706ff6f15694b3b54918200169 sandcrawler SQL-based status (sept 2022) 2022-09-08T00:53:50+00:00 Bryan Newbold bnewbold@archive.org 2022-09-08T00:53:50+00:00 urn:sha1:4589f574ae8fb29d959ff60e99a15098fee8a15a stats: may 2022 ingest-by-domain stats 2022-07-07T20:19:12+00:00 Bryan Newbold bnewbold@archive.org 2022-07-07T20:19:12+00:00 urn:sha1:bf1826f8e8d203f732cbdda008e0c5944cbdae60 some weekly crawl numbers (not very helpful) 2022-05-04T00:13:30+00:00 Bryan Newbold bnewbold@archive.org 2022-05-04T00:13:30+00:00 urn:sha1:6dd9bc8d3312107796344341e43044907677bf85 switch default kafka-broker host from wbgrp-svc263 to wbgrp-svc350 2022-05-04T00:12:48+00:00 Bryan Newbold bnewbold@archive.org 2022-05-04T00:12:48+00:00 urn:sha1:00ae74378413e87f230c88113ff8163a6f969d63 April 2022 sandcrawler DB stats 2022-04-27T18:55:41+00:00 Bryan Newbold bnewbold@archive.org 2022-04-27T18:55:41+00:00 urn:sha1:ef0421567dd67a248d0f92f32ad4e14ae0776920 sql: add source/created index on ingest_request table 2022-04-04T22:52:02+00:00 Bryan Newbold bnewbold@archive.org 2022-04-04T22:52:02+00:00 urn:sha1:dadb26935c4d255c5a662f1e758bcf53864f7f95 sql: fix reingest query missing type on LEFT JOIN; wrap in read-only transaction 2022-04-04T22:27:02+00:00 Bryan Newbold bnewbold@archive.org 2022-04-04T22:27:02+00:00 urn:sha1:c4caeaedc63c2bb2f9bb9f6be6826480aefc9caf