diff options
| author | Bryan Newbold <bnewbold@archive.org> | 2020-08-11 17:37:03 -0700 |
|---|---|---|
| committer | Bryan Newbold <bnewbold@archive.org> | 2020-08-11 17:37:09 -0700 |
| commit | 644e412c38c8897e171e3aa1244f1aa6955d8e65 (patch) | |
| tree | 7fef947fcd882cdb1ed7776dabcafe351278391d /python/sandcrawler/ia.py | |
| parent | 7e8ff96fb90ddd1c853418a6c405d97afbc45355 (diff) | |
| download | sandcrawler-644e412c38c8897e171e3aa1244f1aa6955d8e65.tar.gz sandcrawler-644e412c38c8897e171e3aa1244f1aa6955d8e65.zip | |
ingest: actually use force_get flag with SPN
The code path was there, but wasn't actually flagging in our most
popular daily domains yet. Hopefully will make a big difference in SPN
throughput.
Diffstat (limited to 'python/sandcrawler/ia.py')
0 files changed, 0 insertions, 0 deletions