diff options
author | Bryan Newbold <bnewbold@archive.org> | 2019-12-26 12:03:27 -0800 |
---|---|---|
committer | Bryan Newbold <bnewbold@archive.org> | 2019-12-26 12:03:27 -0800 |
commit | 9185e69f70a1085045d6e91295be73595b55291c (patch) | |
tree | 4cba7a9e55179d48f142db38df86a43b4c9d014a /README.md | |
parent | 88751285e1759e8e415d4e2e9784b54051cf1fbb (diff) | |
download | chocula-9185e69f70a1085045d6e91295be73595b55291c.tar.gz chocula-9185e69f70a1085045d6e91295be73595b55291c.zip |
add check to container stat fetch to ensure valid JSON returned
Diffstat (limited to 'README.md')
-rw-r--r-- | README.md | 2 |
1 files changed, 1 insertions, 1 deletions
@@ -118,7 +118,7 @@ transformer takes a subset/combination of Generate a list of ISSN-L identifiers, fetch each from fatcat web peudo-API, and write to JSON. cat container_export.json | jq .issnl -r | sort -u > container_issnl.tsv - cat container_issnl.tsv | parallel -j10 curl -s 'https://fatcat.wiki/container/issnl/{}/stats.json' > container_stats.json + cat container_issnl.tsv | parallel -j10 curl -s 'https://fatcat.wiki/container/issnl/{}/stats.json' | jq -c . > container_stats.json Then load in to chocula and recaculate stats: |