blob: 1a246200d52358fc43ef59fabd3df645e300c3c0 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
|
## HOWTO: Update
Requires [fatcat-cli](https://gitlab.com/bnewbold/fatcat-cli) and `jq`
installed. Run these commands on a production machine.
cd /srv/fatcat_scholar/sitemap
/srv/fatcat_scholar/src/extra/sitemap/work_urls_query.sh
/srv/fatcat_scholar/src/extra/sitemap/pdf_urls_query.sh
/srv/fatcat_scholar/src/extra/sitemap/generate_sitemap_indices.py
## Background
Google has a limit of 50k lines / 10 MByte for text sitemap files, and 50K
lines / 50 MByte for XML site map files. Google Scholar has indicated a smaller
20k URL / 5 MB limit.
## Resources
Google sitemap verifier: https://support.google.com/webmasters/answer/7451001
|