From e323b390bf6790edfd8a4d0683642a480e62c743 Mon Sep 17 00:00:00 2001
From: Bryan Newbold <bnewbold@archive.org>
Date: Tue, 16 Nov 2021 00:24:13 -0800
Subject: SPNv2: make 'resources' optional

This was always present previously. A change was made to SPNv2 API
recently that borked it a bit, though in theory should be present on new
captures. I'm not seeing it for some captures, so pushing this work
around. It seems like we don't actually use this field anyways, at least
for ingest pipeline.
---
 python/sandcrawler/ia.py | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

(limited to 'python')

diff --git a/python/sandcrawler/ia.py b/python/sandcrawler/ia.py
index d334d24..dc9aae5 100644
--- a/python/sandcrawler/ia.py
+++ b/python/sandcrawler/ia.py
@@ -1101,7 +1101,7 @@ class SavePageNowClient:
                 request_url,
                 final_json["original_url"],
                 final_json["timestamp"],
-                final_json["resources"],
+                final_json.get("resources") or None,
             )
         else:
             if final_json["status"] == "pending":
-- 
cgit v1.2.3