summaryrefslogtreecommitdiffstats
path: root/python/fatcat_tools/importers
Commit message (Expand)AuthorAgeFilesLines
* initial arxivraw importer (from parser)Bryan Newbold2019-05-212-0/+299
* clean up JALC importer a tiny bitBryan Newbold2019-05-211-8/+3
* initial JSTOR importerBryan Newbold2019-05-212-0/+271
* initial flesh out of JALC parserBryan Newbold2019-05-213-1/+348
* include structured contrib names in CDL/dash importerBryan Newbold2019-05-201-2/+2
* fix default mimetype (impacted pre-1923 files)Bryan Newbold2019-05-152-4/+9
* python implBryan Newbold2019-05-149-32/+38
* python implBryan Newbold2019-05-146-16/+16
* python: impl size_bytes -> sizeBryan Newbold2019-05-131-1/+1
* importer code updatesBryan Newbold2019-05-134-3/+18
* partial python impl of ext_id and release_stage refactorsBryan Newbold2019-05-133-15/+20
* add limits to match importersBryan Newbold2019-04-233-2/+27
* archive.org isn't really a repositoryBryan Newbold2019-04-221-1/+3
* editgroup description overrideBryan Newbold2019-04-221-2/+2
* arabesque importer does require timestamp/waybackBryan Newbold2019-04-221-0/+3
* matched importer shouldn't require waybackBryan Newbold2019-04-221-5/+7
* handle API 400 in arabesque import (invalid extid)Bryan Newbold2019-04-191-7/+14
* fix arabesque importer crawl_id None bugBryan Newbold2019-04-181-1/+1
* mechanism to not double-update entitiesBryan Newbold2019-04-182-1/+9
* minor arabesque tweaksBryan Newbold2019-04-181-0/+2
* update URL rel listBryan Newbold2019-04-181-1/+10
* arabesque importer does fewer updatesBryan Newbold2019-04-181-1/+8
* arabesque importerBryan Newbold2019-04-181-0/+165
* early version of arabesque importerBryan Newbold2019-04-121-0/+1
* add SqlitePusher importer optionBryan Newbold2019-04-122-1/+21
* fix cdl_dash_dat license_slugBryan Newbold2019-03-191-7/+3
* importer for CDL/DASH dat pilot dweb datasetsBryan Newbold2019-03-192-0/+200
* new importer: wayback_staticBryan Newbold2019-03-192-0/+237
* bunch of lint/whitespace cleanupsBryan Newbold2019-02-223-5/+3
* better/additional crossref license lookupsBryan Newbold2019-02-141-20/+58
* crossref: import subtitle as str, not list[str]Bryan Newbold2019-02-141-0/+2
* don't print missing DOIs, just countBryan Newbold2019-02-051-1/+3
* add some missing LICENSE_SLUG_MAPBryan Newbold2019-02-051-1/+4
* yet another required field bugBryan Newbold2019-01-291-4/+5
* fix null name for container (required)Bryan Newbold2019-01-291-1/+5
* tweaks to GROBID metadata importBryan Newbold2019-01-291-3/+2
* crossref import tweaks/fixesBryan Newbold2019-01-291-7/+9
* fix bug in clean() resulting in many consistency check failsBryan Newbold2019-01-292-12/+12
* fix refs extra ordering bugBryan Newbold2019-01-291-6/+6
* pass through kwargs (fixes bezerk imports)Bryan Newbold2019-01-295-5/+10
* ensure raw_name is not stubBryan Newbold2019-01-291-1/+4
* ensure abstracts aren't stubsBryan Newbold2019-01-291-2/+3
* add stub parse_record() to make pylint happyBryan Newbold2019-01-281-0/+4
* fix title length checks in crossrefBryan Newbold2019-01-281-2/+2
* fix rel/url order swapBryan Newbold2019-01-281-1/+1
* don't allow empty or single-character clean stringsBryan Newbold2019-01-281-1/+1
* filter short/stub original_titleBryan Newbold2019-01-281-3/+7
* many fixes in GROBID importerBryan Newbold2019-01-281-14/+10
* fix GROBID null/short abstract additionsBryan Newbold2019-01-281-1/+2
* enforce title len>1 for release importsBryan Newbold2019-01-282-1/+8