summaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
* more python normalizers, and move from importer commonBryan Newbold2020-11-192-154/+326
| | | | | | | | | | | | Moved several normalizer helpers out of fatcat_tools.importers.common to fatcat_tools.normal. Copied language name and country name parser helpers from chocula repository (built on existing pycountry helper library). Have not gone through and refactored other importers to point to these helpers yet; that should be a separate PR when this branch is merged. Current changes are backwards compatible via re-imports.
* initial implementation of DOAJ importerBryan Newbold2020-11-194-0/+387
| | | | Several things to finish implementing and polish.
* python API client: resolve warning about '\d' in stringBryan Newbold2020-11-191-2/+2
|
* rustfmtBryan Newbold2020-11-195-87/+138
|
* rust: fatcatd changes for DOAJ+dblp identifiersBryan Newbold2020-11-196-949/+1062
|
* codegen rust crate for v0.3.3Bryan Newbold2020-11-198-227/+244
|
* codegen python client library for v0.3.3Bryan Newbold2020-11-197-16/+80
|
* schema: DOAJ+dblp ext_ids; bump to v0.3.3Bryan Newbold2020-11-192-1/+25
|
* ingest and proposal updatesBryan Newbold2020-11-192-0/+45
|
* Merge branch 'bnewbold-xml-html-ingest' into 'master'Martin Czygan2020-11-1910-66/+409
|\ | | | | | | | | HTML webcapture ingest (and XML file ingest) See merge request webgroup/fatcat!88
| * html ingest: actual xhtml mimetypeBryan Newbold2020-11-161-2/+2
| |
| * ingest tool: support for setting ingest typeBryan Newbold2020-11-062-6/+10
| |
| * html ingest: remaining implementationBryan Newbold2020-11-061-22/+19
| |
| * ingest: fix XML ingest test fileBryan Newbold2020-11-051-1/+1
| |
| * ingest: progress on HTML ingestBryan Newbold2020-11-053-16/+74
| |
| * ingest: initial 'web' worker implementationBryan Newbold2020-11-053-67/+301
| |
| * refactor: white/black -> allow/blockBryan Newbold2020-11-051-4/+4
| |
| * ingest: whitelist -> allowlistBryan Newbold2020-11-052-6/+6
| |
| * ingest: tests for basic XML ingestBryan Newbold2020-11-052-0/+18
| |
| * ingest: basic checks for ingest_typeBryan Newbold2020-11-053-4/+36
|/
* normalizer: filter out a specific non-ASCII character in DOIBryan Newbold2020-11-041-1/+3
|
* entity updates: don't ingest JSTOR DOI prefixesBryan Newbold2020-10-231-0/+2
|
* Merge branch 'bnewbold-scholar-pipeline' into 'master'bnewbold2020-10-202-2/+26
|\ | | | | | | | | entity updater: new work update feed (ident and changelog metadata only) See merge request webgroup/fatcat!87
| * entity updater: new work update feed (ident and changelog metadata only)Bryan Newbold2020-10-162-2/+26
|/
* bulk citation graph workflow proposalBryan Newbold2020-10-151-0/+160
|
* Merge branch 'bnewbold-web-tweaks-20201013' into 'master'Martin Czygan2020-10-144-12/+19
|\ | | | | | | | | web coverage tweaks 20201013 See merge request webgroup/fatcat!86
| * container coverage: add keeper link and KBART holdings listBryan Newbold2020-10-131-0/+11
| |
| * release view: remove abiguous OA status indicatorBryan Newbold2020-10-131-4/+0
| |
| * container view: fix non-OA empty boxBryan Newbold2020-10-131-3/+3
| |
| * coverage: show counts and fraction in tooltip of coverage barsBryan Newbold2020-10-131-5/+5
|/
* update database/table statsBryan Newbold2020-10-122-0/+48
|
* chocula importer: small tweaks to update behaviorBryan Newbold2020-10-081-8/+6
|
* elastic transform: more preservation keepersBryan Newbold2020-10-081-1/+2
|
* update 'contributing' page in guideBryan Newbold2020-10-025-17/+176
|
* update READMEBryan Newbold2020-10-011-41/+51
|
* updates to CHANGELOGBryan Newbold2020-10-011-0/+19
|
* more metadata cleanup task notesBryan Newbold2020-10-011-0/+7
|
* Merge branch 'bnewbold-202009-polish' into 'master'Martin Czygan2020-09-2910-124/+159
|\ | | | | | | | | fatcat.wiki 2020-09 polish See merge request webgroup/fatcat!84
| * coverage: handle the case of hits, but none with yearsBryan Newbold2020-09-171-4/+5
| |
| * web: handle unknown CSL style as a cleaner 400 pageBryan Newbold2020-09-172-1/+7
| |
| * web: update sub-resource integrity and pre-loadingBryan Newbold2020-09-171-0/+13
| | | | | | | | For security/integrity and performance
| * lint cleanupsBryan Newbold2020-09-172-3/+0
| |
| * web: route constraints on fcids and UUIDsBryan Newbold2020-09-172-101/+103
| | | | | | | | | | | | | | | | | | | | | | Instead of accepting any string for these parameters and throwing a 400 error if not the correct type, implement better route matching at the framework level and return more 404s. This resolves several outstanding sentry exceptions. The "flask-uuid" was imported and seems to have been configured for this purpose previously, but I guess I never finished configuring it.
| * container view: only show OA indicator when knownBryan Newbold2020-09-171-5/+1
| | | | | | | | | | The "is_oa:False" could be that we just don't know; aren't actually distinguishing between false and blank.
| * web container view: hide preservation when no releasesBryan Newbold2020-09-171-8/+6
| |
| * web toml editing: remove sub-entities from TOMLBryan Newbold2020-09-171-0/+4
| |
| * coverage search: pretty display for ES query errorsBryan Newbold2020-09-172-1/+19
| |
| * coverage: clarify available/accessible terminologyBryan Newbold2020-09-171-1/+1
| |
* | update keepers links to keepers.issn.orgBryan Newbold2020-09-282-8/+8
| |
* | Merge branch 'martin-datacite-spammy-title' into 'master'Martin Czygan2020-09-222-0/+25
|\ \ | |/ |/| | | | | address spammy datacite titles See merge request webgroup/fatcat!85
generated by cgit v1.2.3 (git 2.39.1) at 2024-11-30 20:41:16 +0000