diff options
author | Bryan Newbold <bnewbold@archive.org> | 2020-02-24 10:46:49 -0800 |
---|---|---|
committer | Bryan Newbold <bnewbold@archive.org> | 2020-02-24 10:46:51 -0800 |
commit | 9ca0c0bc13082aa061eee3da6b057fbacb4052e9 (patch) | |
tree | 8e83eef83c8bf494da6fb5ab7f01fb38fc1d05aa /kafka | |
parent | 15fbaa45003937db9414be729fda9615b960dbe1 (diff) | |
download | sandcrawler-9ca0c0bc13082aa061eee3da6b057fbacb4052e9.tar.gz sandcrawler-9ca0c0bc13082aa061eee3da6b057fbacb4052e9.zip |
fetch_petabox_body: allow non-200 status code fetches
But only if it matches what the revisit record indicated.
This is mostly to enable better revisit fetching.
Diffstat (limited to 'kafka')
0 files changed, 0 insertions, 0 deletions