path: root/python/TODO

ingest crawler:
- SPNv2 only
    - remove most SPNv1/v2 path selection
- landing page + fulltext hops only (short recursion depth)
- use wayback client library instead of requests to fetch content