aboutsummaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
* add requests session around postgrest fetchesBryan Newbold2021-12-072-30/+34
| | | | | This is expected to drastically improve throughput of intermediate bundle generation, and reduce load on postgrest itself.
* final notes on this SIM pipeline iterationBryan Newbold2021-12-071-0/+4
|
* refs: include GROBID-parsed crossref refsBryan Newbold2021-12-062-4/+53
| | | | | | This takes advantage of Crossref 'unstructured' refs which have been parsed using GROBID and stored in the sandcrawler database, as part of the sandcrawler crossref metadata pipeline.
* fetch GROBID-parsed refs along with crossref metadataBryan Newbold2021-12-063-4/+8
|
* notes on 2021-12 SIM pipeline update (still running)Bryan Newbold2021-12-061-0/+319
|
* work pipeline: add hack to enrich releases with some crossref metadataBryan Newbold2021-12-061-12/+43
|
* fmt and commentsBryan Newbold2021-12-062-15/+32
|
* SIM pipeline: improve exception handlingBryan Newbold2021-12-062-11/+12
|
* SIM pipeline: fix bug w/r/t issues with no fatcat coverage at allBryan Newbold2021-12-061-2/+2
|
* SIM pipeline: improve issue skipping (based on suffix)Bryan Newbold2021-12-061-11/+21
|
* SIM pipeline: retain only one ulrichs recordBryan Newbold2021-12-061-0/+1
|
* issue-db: use new any-issn lookup endpointBryan Newbold2021-12-021-1/+1
|
* issue-db: fixes to schemaBryan Newbold2021-12-022-9/+6
| | | | | | | The primary key on release_counts was resulting in only one row per pubid. Also the 'year_in_sim' column was never being used.
* issue-db build process: tweak archive.org filters; increase parallelismBryan Newbold2021-12-021-4/+4
|
* schema: use container redirect as ident if definedBryan Newbold2021-11-302-3/+3
| | | | | | This is to handle containers which have been merged (redirected), but the release entities have not be updated to point to the new "primary" container yet.
* Merge branch 'master' of github.com:internetarchive/fatcat-scholarBryan Newbold2021-11-294-17/+29
|\
| * Translated using Weblate (Italian)Alfonso Scarpino2021-11-292-13/+25
| | | | | | | | | | | | | | Currently translated at 100.0% (192 of 192 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/it/
| * Translated using Weblate (Russian)Artem2021-11-172-4/+4
| | | | | | | | | | | | | | Currently translated at 95.3% (183 of 192 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/ru/
* | codespell fixesBryan Newbold2021-11-245-6/+6
|/
* Translated using Weblate (Portuguese)Bryan Newbold2021-11-152-8/+8
| | | | | | | Currently translated at 93.2% (179 of 192 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/pt/
* Translated using Weblate (Persian)Bryan Newbold2021-11-152-4/+4
| | | | | | | Currently translated at 93.2% (179 of 192 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/fa/
* Translated using Weblate (Greek)Bryan Newbold2021-11-152-32/+106
| | | | | | | Currently translated at 48.4% (93 of 192 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/el/
* Translated using Weblate (Croatian)Bryan Newbold2021-11-152-10/+5
| | | | | | | Currently translated at 100.0% (192 of 192 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/hr/
* Translated using Weblate (Norwegian Bokmål)Bryan Newbold2021-11-152-6/+5
| | | | | | | Currently translated at 52.6% (101 of 192 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/nb_NO/
* Translated using Weblate (French)Bryan Newbold2021-11-152-10/+6
| | | | | | | Currently translated at 93.7% (180 of 192 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/fr/
* Translated using Weblate (Russian)Bryan Newbold2021-11-152-10/+6
| | | | | | | Currently translated at 94.2% (181 of 192 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/ru/
* Translated using Weblate (Arabic)Bryan Newbold2021-11-152-7/+8
| | | | | | | Currently translated at 95.3% (183 of 192 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/ar/
* Translated using Weblate (German)Bryan Newbold2021-11-152-10/+6
| | | | | | | Currently translated at 93.7% (180 of 192 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/de/
* Translated using Weblate (Chinese (Simplified))Eric2021-11-152-10/+4
| | | | | | | Currently translated at 100.0% (192 of 192 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/zh_Hans/
* Update translation filesHosted Weblate2021-11-1514-50/+45
| | | | | | | Updated by "Update PO files to match POT (msgmerge)" hook in Weblate. Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/
* update .potBryan Newbold2021-11-121-3/+2
|
* web: remove spurious whitespace from another i18n stringBryan Newbold2021-11-121-2/+2
|
* Translated using Weblate (Croatian)Milo Ivir2021-11-122-17/+10
| | | | | | | Currently translated at 100.0% (192 of 192 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/hr/
* Translated using Weblate (Chinese (Simplified))Eric2021-11-122-13/+5
| | | | | | | Currently translated at 100.0% (192 of 192 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/zh_Hans/
* Revert "pull GROBID refs along with crossref records into bundles"Bryan Newbold2021-11-103-6/+2
| | | | | | This reverts commit c164970449a392b5165d903d213c2bb51f2a187f. Didn't mean to merge this to master just yet.
* Update translation filesHosted Weblate2021-11-1014-59/+57
| | | | | | | Updated by "Update PO files to match POT (msgmerge)" hook in Weblate. Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/
* Translated using Weblate (Chinese (Simplified))Eric2021-11-102-5/+5
| | | | | | | Currently translated at 100.0% (192 of 192 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/zh_Hans/
* lint: disallow 'import *' even in testsBryan Newbold2021-11-103-5/+15
|
* pull GROBID refs along with crossref records into bundlesBryan Newbold2021-11-103-2/+6
|
* try tweaking 'Support and Acknowledgements' title on about page, to fix i18nBryan Newbold2021-11-102-7/+4
|
* Update translation filesHosted Weblate2021-11-1014-626/+740
| | | | | | | Updated by "Update PO files to match POT (msgmerge)" hook in Weblate. Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/
* Translated using Weblate (Croatian)Milo Ivir2021-11-102-3/+3
| | | | | | | Currently translated at 100.0% (190 of 190 strings) Translation: Internet Archive/Archive Scholar (web interface) Translate-URL: https://hosted.weblate.org/projects/internetarchive/fatcat-scholar/hr/
* update i18n pot fileBryan Newbold2021-11-101-44/+52
|
* add some missing trans blocks on <h3> tagsBryan Newbold2021-11-101-2/+2
| | | | Thanks to milotype for noticing!
* pylint: ignore pydantic errorBryan Newbold2021-11-101-0/+2
|
* grobid: switch to more ergonomic parse_citation_xml()Bryan Newbold2021-10-281-12/+4
|
* pipenv: bump grobid_tei_xml versionBryan Newbold2021-10-282-12/+12
|
* changelog: document grobid_tei_xml changeBryan Newbold2021-10-271-0/+1
|
* refactor use of grobid_tei_xmlBryan Newbold2021-10-275-75/+102
|
* replace grobid2json with grobid_tei_xmlBryan Newbold2021-10-275-252/+21
| | | | | This first iteration uses the .to_legacy_dict() helpers for backwards compatibility