diff options
| author | Bryan Newbold <bnewbold@archive.org> | 2022-07-15 12:55:45 -0700 |
|---|---|---|
| committer | Bryan Newbold <bnewbold@archive.org> | 2022-07-15 12:55:48 -0700 |
| commit | 7d8d9a8bcc827b136b4dc148f6a2c8c4dd2bbd8b (patch) | |
| tree | 551e4a997a2b447e7c4b8e08cbaffd479165dafd /notes/ingest/2021-09-03_patch_crawl.md | |
| parent | f51f7d888d1b30ea874c9656d5cacc84ec7ab8d2 (diff) | |
| download | sandcrawler-7d8d9a8bcc827b136b4dc148f6a2c8c4dd2bbd8b.tar.gz sandcrawler-7d8d9a8bcc827b136b4dc148f6a2c8c4dd2bbd8b.zip | |
ingest: another form of cookie block URL
This still doesn't short-cut CDX lookup chain, because that is all pure
redirects happening in ia.py.
Diffstat (limited to 'notes/ingest/2021-09-03_patch_crawl.md')
0 files changed, 0 insertions, 0 deletions