aboutsummaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
* web: sitemap.xml servingBryan Newbold2021-04-293-2/+27
|
* sitemap generationBryan Newbold2021-04-294-0/+71
|
* proposal for landing pages, access redirects, and sitemapsBryan Newbold2021-04-281-0/+106
|
* iterate on access redirects and landing page implementationBryan Newbold2021-04-275-23/+150
| | | | Small code refactors and minimal test coverage
* web: initial implementation of work landing page and citation_pdf_url access ↵Bryan Newbold2021-04-234-4/+176
| | | | | | | | | | | | redirect The initial intent is to have something that can be used by indexing services to pull the citation_pdf_url meta tag and bounce to a direct IA PDF access URL. For now the landing page stubs are just formatted as SERP results. Presumbably these will get re-styled at some point and include citation graph links, etc.
* base template: typoBryan Newbold2021-04-231-1/+1
|
* indexing: defer to creator.display_name over contrib.raw_nameBryan Newbold2021-04-121-1/+3
|
* search: more aggressively skip fuzzy match exceptionsBryan Newbold2021-04-121-5/+5
|
* bump fuzzycat to v0.0.19 (for ES 7.x compatibility)Bryan Newbold2021-04-122-191/+196
|
* update sandcrawler-db hostBryan Newbold2021-04-091-1/+1
|
* small lint fixBryan Newbold2021-04-071-1/+1
|
* Translated using Weblate (German)nautilusx2021-04-062-3/+3
| | | | | | | Currently translated at 100.0% (178 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/de/
* Translated using Weblate (Portuguese)Bryan Newbold2021-04-062-14/+4
| | | | | | | Currently translated at 100.0% (178 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/pt/
* Translated using Weblate (Dutch)Bryan Newbold2021-04-062-14/+4
| | | | | | | Currently translated at 100.0% (178 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/nl/
* Translated using Weblate (Italian)Bryan Newbold2021-04-062-17/+7
| | | | | | | Currently translated at 100.0% (178 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/it/
* Translated using Weblate (Persian)Bryan Newbold2021-04-062-13/+3
| | | | | | | Currently translated at 100.0% (178 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/fa/
* Translated using Weblate (Croatian)Bryan Newbold2021-04-062-14/+4
| | | | | | | Currently translated at 100.0% (178 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/hr/
* Translated using Weblate (French)Bryan Newbold2021-04-062-14/+4
| | | | | | | Currently translated at 100.0% (178 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/fr/
* Translated using Weblate (Russian)Bryan Newbold2021-04-062-14/+4
| | | | | | | Currently translated at 100.0% (178 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/ru/
* Translated using Weblate (Spanish)Bryan Newbold2021-04-062-14/+4
| | | | | | | Currently translated at 100.0% (178 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/es/
* Translated using Weblate (Arabic)Bryan Newbold2021-04-062-13/+3
| | | | | | | Currently translated at 100.0% (178 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/ar/
* Translated using Weblate (Chinese (Simplified))Bryan Newbold2021-04-062-19/+6
| | | | | | | Currently translated at 100.0% (178 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/zh_Hans/
* Translated using Weblate (German)Bryan Newbold2021-04-062-13/+3
| | | | | | | Currently translated at 99.4% (177 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/de/
* Update translation filesHosted Weblate2021-04-0614-964/+1045
| | | | | | | Updated by "Update PO files to match POT (msgmerge)" hook in Weblate. Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/
* health check: use /<index>/_count endpoint; verify shardsBryan Newbold2021-04-061-7/+12
| | | | | In actual production verification, the /_mapping endpoint didn't seem to work.
* change health check from .exists(index) to .mapping(index)Bryan Newbold2021-04-062-6/+15
| | | | | | | | | | | | In cases where the cluser leader node is unavilable, the health check was returning false even when the local node had full shard replicas and could return requests. A refinement of this change would be to use the /<index>/_count API endpoint to ensure that the "failed" and "skipped" shard numbers are 0 (aka, "successful == total"). However, not sure where that endpoint is exposed in the elasticsearch-py API. the CatClient method doesn't seem right.
* prod config: point to local elasticsearch instanceBryan Newbold2021-04-061-1/+1
|
* make fmtBryan Newbold2021-03-293-3/+12
|
* don't use async endpoints for sync implementationsBryan Newbold2021-03-291-3/+3
| | | | | | | | | | Embarassingly, I didn't know this was an option in FastAPI! Knew that running `await` on a function that was internally doing blocking calls was really bad, but didn't know the framework had such a simple way to avoid the problem. This significantly resolves operational concerns with the current service.
* web and API health check endpointBryan Newbold2021-03-292-4/+20
| | | | | | Because scholar is primarily a search service, the endpoint does a pass-through health check to the elasticsearch backend (aka, es-public-proxy).
* web: small typosBryan Newbold2021-03-253-30/+42
| | | | Thanks for catching these gio
* Translated using Weblate (Croatian)Milo Ivir2021-03-252-7/+48
| | | | | | | Currently translated at 100.0% (178 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/hr/
* Translated using Weblate (Italian)gio2021-03-252-145/+139
| | | | | | | Currently translated at 100.0% (178 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/it/
* Translated using Weblate (Greek)Bryan Newbold2021-03-252-12/+14
| | | | | | | Currently translated at 3.3% (6 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/el/
* Translated using Weblate (Italian)Alessandro Mandelli2021-03-251-2/+2
| | | | | | | Currently translated at 97.7% (174 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/it/
* Translated using Weblate (Italian)gio2021-03-252-22/+25
| | | | | | | Currently translated at 97.7% (174 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/it/
* Translated using Weblate (Italian)Alessandro Mandelli2021-03-251-2/+2
| | | | | | | Currently translated at 99.4% (177 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/it/
* Translated using Weblate (Italian)gio2021-03-252-5/+5
| | | | | | | Currently translated at 99.4% (177 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/it/
* Translated using Weblate (Italian)Alessandro Mandelli2021-03-251-4/+2
| | | | | | | Currently translated at 100.0% (178 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/it/
* Translated using Weblate (Italian)gio2021-03-252-2/+2
| | | | | | | Currently translated at 100.0% (178 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/it/
* Translated using Weblate (Italian)Alessandro Mandelli2021-03-251-7/+5
| | | | | | | Currently translated at 98.3% (175 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/it/
* Translated using Weblate (Italian)gio2021-03-252-3/+5
| | | | | | | Currently translated at 98.3% (175 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/it/
* Translated using Weblate (Italian)gio2021-03-251-3/+5
| | | | | | | Currently translated at 98.8% (176 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/it/
* Translated using Weblate (Italian)Alessandro Mandelli2021-03-252-5/+4
| | | | | | | Currently translated at 98.8% (176 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/it/
* Translated using Weblate (Italian)gio2021-03-251-1/+2
| | | | | | | Currently translated at 99.4% (177 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/it/
* Translated using Weblate (Italian)Alessandro Mandelli2021-03-252-3/+1
| | | | | | | Currently translated at 99.4% (177 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/it/
* Translated using Weblate (Italian)Alessandro Mandelli2021-03-251-11/+7
| | | | | | | Currently translated at 98.8% (176 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/it/
* Translated using Weblate (Italian)gio2021-03-252-5/+7
| | | | | | | Currently translated at 98.8% (176 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/it/
* Translated using Weblate (Italian)Alessandro Mandelli2021-03-251-23/+17
| | | | | | | Currently translated at 97.1% (173 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/it/
* Translated using Weblate (Italian)gio2021-03-252-21/+22
| | | | | | | Currently translated at 97.1% (173 of 178 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/it/