summaryrefslogtreecommitdiffstats
path: root/python/fatcat_tools/importers
Commit message (Collapse)AuthorAgeFilesLines
* clean up JALC importer a tiny bitBryan Newbold2019-05-211-8/+3
|
* initial JSTOR importerBryan Newbold2019-05-212-0/+271
|
* initial flesh out of JALC parserBryan Newbold2019-05-213-1/+348
|
* include structured contrib names in CDL/dash importerBryan Newbold2019-05-201-2/+2
|
* fix default mimetype (impacted pre-1923 files)Bryan Newbold2019-05-152-4/+9
|
* python implBryan Newbold2019-05-149-32/+38
|
* python implBryan Newbold2019-05-146-16/+16
|
* python: impl size_bytes -> sizeBryan Newbold2019-05-131-1/+1
|
* importer code updatesBryan Newbold2019-05-134-3/+18
|
* partial python impl of ext_id and release_stage refactorsBryan Newbold2019-05-133-15/+20
|
* add limits to match importersBryan Newbold2019-04-233-2/+27
|
* archive.org isn't really a repositoryBryan Newbold2019-04-221-1/+3
|
* editgroup description overrideBryan Newbold2019-04-221-2/+2
|
* arabesque importer does require timestamp/waybackBryan Newbold2019-04-221-0/+3
|
* matched importer shouldn't require waybackBryan Newbold2019-04-221-5/+7
|
* handle API 400 in arabesque import (invalid extid)Bryan Newbold2019-04-191-7/+14
|
* fix arabesque importer crawl_id None bugBryan Newbold2019-04-181-1/+1
|
* mechanism to not double-update entitiesBryan Newbold2019-04-182-1/+9
|
* minor arabesque tweaksBryan Newbold2019-04-181-0/+2
|
* update URL rel listBryan Newbold2019-04-181-1/+10
|
* arabesque importer does fewer updatesBryan Newbold2019-04-181-1/+8
|
* arabesque importerBryan Newbold2019-04-181-0/+165
|
* early version of arabesque importerBryan Newbold2019-04-121-0/+1
|
* add SqlitePusher importer optionBryan Newbold2019-04-122-1/+21
|
* fix cdl_dash_dat license_slugBryan Newbold2019-03-191-7/+3
|
* importer for CDL/DASH dat pilot dweb datasetsBryan Newbold2019-03-192-0/+200
|
* new importer: wayback_staticBryan Newbold2019-03-192-0/+237
|
* bunch of lint/whitespace cleanupsBryan Newbold2019-02-223-5/+3
|
* better/additional crossref license lookupsBryan Newbold2019-02-141-20/+58
|
* crossref: import subtitle as str, not list[str]Bryan Newbold2019-02-141-0/+2
|
* don't print missing DOIs, just countBryan Newbold2019-02-051-1/+3
|
* add some missing LICENSE_SLUG_MAPBryan Newbold2019-02-051-1/+4
|
* yet another required field bugBryan Newbold2019-01-291-4/+5
|
* fix null name for container (required)Bryan Newbold2019-01-291-1/+5
|
* tweaks to GROBID metadata importBryan Newbold2019-01-291-3/+2
|
* crossref import tweaks/fixesBryan Newbold2019-01-291-7/+9
| | | | | - refs: article-title not title; save unstructured; authors not author - save 'language' field (already an ISO code)
* fix bug in clean() resulting in many consistency check failsBryan Newbold2019-01-292-12/+12
|
* fix refs extra ordering bugBryan Newbold2019-01-291-6/+6
|
* pass through kwargs (fixes bezerk imports)Bryan Newbold2019-01-295-5/+10
|
* ensure raw_name is not stubBryan Newbold2019-01-291-1/+4
|
* ensure abstracts aren't stubsBryan Newbold2019-01-291-2/+3
|
* add stub parse_record() to make pylint happyBryan Newbold2019-01-281-0/+4
|
* fix title length checks in crossrefBryan Newbold2019-01-281-2/+2
|
* fix rel/url order swapBryan Newbold2019-01-281-1/+1
|
* don't allow empty or single-character clean stringsBryan Newbold2019-01-281-1/+1
|
* filter short/stub original_titleBryan Newbold2019-01-281-3/+7
|
* many fixes in GROBID importerBryan Newbold2019-01-281-14/+10
|
* fix GROBID null/short abstract additionsBryan Newbold2019-01-281-1/+2
|
* enforce title len>1 for release importsBryan Newbold2019-01-282-1/+8
|
* drop creators with no display name at allBryan Newbold2019-01-281-3/+3
|
generated by cgit v1.2.3 (git 2.39.1) at 2024-12-11 08:16:19 +0000