sandcrawler, branch bnewbold-refactor-loggging
[no description]
https://git.bnewbold.net/sandcrawler/atom?h=bnewbold-refactor-loggging
2022-07-12T22:03:29Z
WIP: refactor logging calls in ingest pipelines
2022-07-12T22:03:29Z
Bryan Newbold
bnewbold@archive.org
2022-07-12T22:03:29Z
urn:sha1:c15432c0ce52c48efabcd7e3221a5d625ef3e9d0
ingest: targeted 2022-04 notes
2022-07-07T20:19:40Z
Bryan Newbold
bnewbold@archive.org
2022-07-07T20:19:40Z
urn:sha1:8f85ab294eae50e31efa9e31bb0bca1bca76cf8b
stats: may 2022 ingest-by-domain stats
2022-07-07T20:19:12Z
Bryan Newbold
bnewbold@archive.org
2022-07-07T20:19:12Z
urn:sha1:bf1826f8e8d203f732cbdda008e0c5944cbdae60
ingest: IEEE domain is blocking us
2022-07-07T20:17:49Z
Bryan Newbold
bnewbold@archive.org
2022-07-07T20:17:49Z
urn:sha1:695a80a64f02f4c23bb938ecfffeef146344841f
ingest: catch more ConnectionErrors (SPN, replay fetch, GROBID)
2022-05-16T22:02:02Z
Bryan Newbold
bnewbold@archive.org
2022-05-16T22:02:02Z
urn:sha1:fcc5a1648d2e49e7002ca569ed668d3318a75584
ingest: skip arxiv.org DOIs, we already direct-ingest
2022-05-11T19:19:48Z
Bryan Newbold
bnewbold@archive.org
2022-05-11T19:19:48Z
urn:sha1:1534ff4d05c6fca460e82b5707fe3fbdc3504e50
python make fmt
2022-05-05T18:21:35Z
Bryan Newbold
bnewbold@archive.org
2022-05-05T18:21:35Z
urn:sha1:a0214959c10a5ecb794d78b189a767ac01c0af48
ingest spn2: fix tests
2022-05-05T18:21:29Z
Bryan Newbold
bnewbold@archive.org
2022-05-05T18:21:29Z
urn:sha1:21ad5cd9942044939c8203dd076ea080b6d55a61
ingest: more loginwall patterns
2022-05-05T18:08:52Z
Bryan Newbold
bnewbold@archive.org
2022-05-05T18:08:52Z
urn:sha1:1f9ca570bd168154a72adcd2454b992dbc7e8d0a
ingest_tool: fix arg parsing
2022-05-04T00:35:52Z
Bryan Newbold
bnewbold@archive.org
2022-05-04T00:35:52Z
urn:sha1:1ec661af75f37b3ae5031851f6c452039e08503c