## HOWTO: Update Requires [fatcat-cli](https://gitlab.com/bnewbold/fatcat-cli) and `jq` installed. Run these commands on a production machine. cd /srv/fatcat_scholar/sitemap /srv/fatcat_scholar/src/extra/sitemap/work_urls_query.sh /srv/fatcat_scholar/src/extra/sitemap/pdf_urls_query.sh /srv/fatcat_scholar/src/extra/sitemap/generate_sitemap_indices.py ## Background Google has a limit of 50k lines / 10 MByte for text sitemap files, and 50K lines / 50 MByte for XML site map files. Google Scholar has indicated a smaller 20k URL / 5 MB limit. ## Resources Google sitemap verifier: https://support.google.com/webmasters/answer/7451001