diff options
| author | Bryan Newbold <bnewbold@robocracy.org> | 2021-06-03 10:57:35 -0700 |
|---|---|---|
| committer | Bryan Newbold <bnewbold@robocracy.org> | 2021-06-03 10:57:35 -0700 |
| commit | 85579a9a5205e86e39cf4e63ddb6970c928bec56 (patch) | |
| tree | de6253380a764c18cfa7391fe4463fa37f2f603f /python/fatcat_web/static/robots.deny_all.txt | |
| parent | 038b3a318440798df8ff8498454dbd251c571ff6 (diff) | |
| download | fatcat-85579a9a5205e86e39cf4e63ddb6970c928bec56.tar.gz fatcat-85579a9a5205e86e39cf4e63ddb6970c928bec56.zip | |
ingest: don't accept mag and s2 URLs
Diffstat (limited to 'python/fatcat_web/static/robots.deny_all.txt')
0 files changed, 0 insertions, 0 deletions