diff options
| author | Bryan Newbold <bnewbold@archive.org> | 2020-01-10 16:10:05 -0800 |
|---|---|---|
| committer | Bryan Newbold <bnewbold@archive.org> | 2020-01-10 16:10:07 -0800 |
| commit | 867d71bbfd89be44fedf5955a60cb1e8b774b390 (patch) | |
| tree | dd16bd1f831fba0eb2d54e3d565195e9471bf15c /pig/tests/files/papers_url_words.cdx | |
| parent | 2536282cc635ce605c0bfd63cf7a9c0e10ef883c (diff) | |
| download | sandcrawler-867d71bbfd89be44fedf5955a60cb1e8b774b390.tar.gz sandcrawler-867d71bbfd89be44fedf5955a60cb1e8b774b390.zip | |
handle SPNv2-then-CDX lookup failures
- use a 10 second delay if CDX result isn't immediately available.
blech.
- if there is a lookup failure, call it a wayback-error and move on
Diffstat (limited to 'pig/tests/files/papers_url_words.cdx')
0 files changed, 0 insertions, 0 deletions