diff options
author | Bryan Newbold <bnewbold@archive.org> | 2021-05-19 16:57:19 -0700 |
---|---|---|
committer | Bryan Newbold <bnewbold@archive.org> | 2021-05-19 16:57:19 -0700 |
commit | 42da448ea610afa980b5d893ce5982b98507fe3c (patch) | |
tree | 972097402dbddf0f1164c6c06632f50c333d0bc1 /extra/www_placeholder/robots.txt | |
parent | 4e452afae432ac718482b62d276bee42adc1e660 (diff) | |
download | fatcat-scholar-42da448ea610afa980b5d893ce5982b98507fe3c.tar.gz fatcat-scholar-42da448ea610afa980b5d893ce5982b98507fe3c.zip |
sitemaps: filter out 12-digit wayback timestamp access URLs, for now
Diffstat (limited to 'extra/www_placeholder/robots.txt')
0 files changed, 0 insertions, 0 deletions