aboutsummaryrefslogtreecommitdiffstats
path: root/notes/ingest
diff options
context:
space:
mode:
authorBryan Newbold <bnewbold@archive.org>2022-03-22 15:57:12 -0700
committerBryan Newbold <bnewbold@archive.org>2022-03-22 16:01:29 -0700
commitfd6dc7f36aecb6a303513476825cfe681500f02d (patch)
treeb5d7dc242d5c5cef0df300f78379ceb13dd35c63 /notes/ingest
parent257f41b174e04957aecf298b3ecdaae0ab44a1d2 (diff)
downloadsandcrawler-fd6dc7f36aecb6a303513476825cfe681500f02d.tar.gz
sandcrawler-fd6dc7f36aecb6a303513476825cfe681500f02d.zip
file ingest: don't 'backoff' on spn2 backoff error
The intent of this is to try and get through the daily ingest requests faster, so we can loop and retry if needed. A 200 second delay, usually resulting in a kafka topic reshuffle, really slows things down. This will presumably result in a bunch of spn2-backoff status requests, but we can just retry those.
Diffstat (limited to 'notes/ingest')
0 files changed, 0 insertions, 0 deletions