diff options
| author | Bryan Newbold <bnewbold@archive.org> | 2020-02-24 10:46:49 -0800 |
|---|---|---|
| committer | Bryan Newbold <bnewbold@archive.org> | 2020-02-24 10:46:51 -0800 |
| commit | 9ca0c0bc13082aa061eee3da6b057fbacb4052e9 (patch) | |
| tree | 8e83eef83c8bf494da6fb5ab7f01fb38fc1d05aa /python/sandcrawler/html.py | |
| parent | 15fbaa45003937db9414be729fda9615b960dbe1 (diff) | |
| download | sandcrawler-9ca0c0bc13082aa061eee3da6b057fbacb4052e9.tar.gz sandcrawler-9ca0c0bc13082aa061eee3da6b057fbacb4052e9.zip | |
fetch_petabox_body: allow non-200 status code fetches
But only if it matches what the revisit record indicated.
This is mostly to enable better revisit fetching.
Diffstat (limited to 'python/sandcrawler/html.py')
0 files changed, 0 insertions, 0 deletions