blob: 61ade0f8ba3ab6aa96092b9437db1cddeb031eeb (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
|
## HOWTO: Update
Requires [fatcat-cli](https://gitlab.com/bnewbold/fatcat-cli) and `jq`
installed. Run these commands on a production machine.
cd /srv/fatcat_scholar/sitemap
/srv/fatcat_scholar/src/extra/sitemap/work_urls_query.sh
/srv/fatcat_scholar/src/extra/sitemap/access_urls_query.sh
/srv/fatcat_scholar/src/extra/sitemap/generate_sitemap_indices.py
Then copy to alternate/replica machine:
scp *.txt *.xml $SCHOLARREPLICAHOST:/srv/fatcat_scholar/sitemap
## Background
Google has a limit of 50k lines / 10 MByte for text sitemap files, and 50K
lines / 50 MByte for XML site map files. Google Scholar has indicated a smaller
20k URL / 5 MB limit.
## Resources
Google sitemap verifier: https://support.google.com/webmasters/answer/7451001
|
