summaryrefslogtreecommitdiffstats
path: root/python/fatcat_web/static/robots.txt
Commit message (Collapse)AuthorAgeFilesLines
* update robots.txt and sitemap.xmlBryan Newbold2020-08-191-0/+19
| | | | | | - show minimal robots/sitemap if not in prod environment - default to allow all in robots.txt; link to sitemap index files - basic sitemap.xml without entity-level links
* refactor python modulesBryan Newbold2018-11-121-0/+1