From 34f8d3d32845774d7fc8690350084eabff54e44f Mon Sep 17 00:00:00 2001 From: Bryan Newbold Date: Thu, 2 Jan 2020 18:10:41 -0800 Subject: TODO: check out python ratelimit library --- python/TODO | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/python/TODO b/python/TODO index 89cec83..58a463f 100644 --- a/python/TODO +++ b/python/TODO @@ -4,4 +4,4 @@ ingest crawler: - remove most SPNv1/v2 path selection - landing page + fulltext hops only (short recursion depth) - use wayback client library instead of requests to fetch content - +- https://pypi.org/project/ratelimit/ -- cgit v1.2.3