diff options
| author | Bryan Newbold <bnewbold@robocracy.org> | 2020-08-19 23:00:34 -0700 |
|---|---|---|
| committer | Bryan Newbold <bnewbold@robocracy.org> | 2020-08-19 23:00:36 -0700 |
| commit | c6b33542398c933a6272586e6280f7026b63a124 (patch) | |
| tree | f95b5eb848ea3eceff910cd44b172e86f0332c1b /notes/bulk_edits/2020-03-19_arxiv_pubmed.md | |
| parent | 5f282a6267182214080ca36bcec4da1755589b46 (diff) | |
| download | fatcat-c6b33542398c933a6272586e6280f7026b63a124.tar.gz fatcat-c6b33542398c933a6272586e6280f7026b63a124.zip | |
update robots.txt and sitemap.xml
- show minimal robots/sitemap if not in prod environment
- default to allow all in robots.txt; link to sitemap index files
- basic sitemap.xml without entity-level links
Diffstat (limited to 'notes/bulk_edits/2020-03-19_arxiv_pubmed.md')
0 files changed, 0 insertions, 0 deletions