diff options
| author | Bryan Newbold <bnewbold@archive.org> | 2021-04-30 14:17:12 -0700 |
|---|---|---|
| committer | Bryan Newbold <bnewbold@archive.org> | 2021-04-30 14:17:12 -0700 |
| commit | c367d54fe47cf71ada73fa9ad16495824e07abfc (patch) | |
| tree | dd07d6ec55b06c85a75f0f7e2663598ca2d57a66 /extra/sitemap/work_urls_query.sh | |
| parent | 0b453b0f74cc88507a7176ec5d749e9bbeb49176 (diff) | |
| download | fatcat-scholar-c367d54fe47cf71ada73fa9ad16495824e07abfc.tar.gz fatcat-scholar-c367d54fe47cf71ada73fa9ad16495824e07abfc.zip | |
sitemaps: not gzip compressed
Diffstat (limited to 'extra/sitemap/work_urls_query.sh')
| -rwxr-xr-x | extra/sitemap/work_urls_query.sh | 2 |
1 files changed, 0 insertions, 2 deletions
diff --git a/extra/sitemap/work_urls_query.sh b/extra/sitemap/work_urls_query.sh index 2971f47..98475ff 100755 --- a/extra/sitemap/work_urls_query.sh +++ b/extra/sitemap/work_urls_query.sh @@ -16,5 +16,3 @@ fatcat-cli search scholar 'doc_type:work (fulltext.access_type:ia_file OR fullte | tr '_' '/' \ | awk '{print "https://scholar.archive.org/" $1}' \ | split --lines 20000 - sitemap-works-$DATE- -d -a 5 --additional-suffix .txt - -gzip sitemap-works-*.txt |