diff options
| author | Bryan Newbold <bnewbold@archive.org> | 2021-04-30 14:18:18 -0700 |
|---|---|---|
| committer | Bryan Newbold <bnewbold@archive.org> | 2021-04-30 14:18:18 -0700 |
| commit | 2e75c11c093a690297c323e869e2edb9e53b3564 (patch) | |
| tree | d199c0b00b714357ec41d5d637ca43d4a2c4ceb6 /fatcat_scholar/static/robots.allow.txt | |
| parent | c367d54fe47cf71ada73fa9ad16495824e07abfc (diff) | |
| download | fatcat-scholar-2e75c11c093a690297c323e869e2edb9e53b3564.tar.gz fatcat-scholar-2e75c11c093a690297c323e869e2edb9e53b3564.zip | |
web: use absolute URLs to sitemaps and in citation_pdf_url
Diffstat (limited to 'fatcat_scholar/static/robots.allow.txt')
| -rw-r--r-- | fatcat_scholar/static/robots.allow.txt | 4 |
1 files changed, 2 insertions, 2 deletions
diff --git a/fatcat_scholar/static/robots.allow.txt b/fatcat_scholar/static/robots.allow.txt index 35f13a3..fb0c251 100644 --- a/fatcat_scholar/static/robots.allow.txt +++ b/fatcat_scholar/static/robots.allow.txt @@ -13,5 +13,5 @@ User-agent: * Allow: /search Crawl-delay: 5 -Sitemap: /sitemap.xml -Sitemap: /sitemap-index-works.xml +Sitemap: https://scholar.archive.org/sitemap.xml +Sitemap: https://scholar.archive.org/sitemap-index-works.xml |