diff options
| author | Bryan Newbold <bnewbold@robocracy.org> | 2020-08-19 23:57:31 -0700 |
|---|---|---|
| committer | Bryan Newbold <bnewbold@robocracy.org> | 2020-08-19 23:57:31 -0700 |
| commit | c15cbf3568f7d91774e1cb82a39474c0ff874616 (patch) | |
| tree | be5dffb5f735ab497c9affe155fd82267ed4b412 /extra/sitemap/README.md | |
| parent | c6b33542398c933a6272586e6280f7026b63a124 (diff) | |
| download | fatcat-c15cbf3568f7d91774e1cb82a39474c0ff874616.tar.gz fatcat-c15cbf3568f7d91774e1cb82a39474c0ff874616.zip | |
sitemap fixes from testing
Diffstat (limited to 'extra/sitemap/README.md')
| -rw-r--r-- | extra/sitemap/README.md | 11 |
1 files changed, 11 insertions, 0 deletions
diff --git a/extra/sitemap/README.md b/extra/sitemap/README.md index 735ac925..f72893cd 100644 --- a/extra/sitemap/README.md +++ b/extra/sitemap/README.md @@ -1,4 +1,15 @@ +## HOWTO: Update + +After a container dump, as `fatcat` user on prod server: + + cd /srv/fatcat/sitemap + export DATE=`date --iso-8601` # or whatever + /srv/fatcat/src/extra/sitemap/container_url_lists.sh $DATE /srv/fatcat/snapshots/container_export.json.gz + /srv/fatcat/src/extra/sitemap/release_url_lists.sh $DATE /srv/fatcat/snapshots/release_export_expanded.json.gz + # delete old sitemap url lists + /srv/fatcat/src/extra/sitemap/generate_sitemap_indices.py + ## Background Google has a limit of 50k lines / 10 MByte for text sitemap files, and 50K |