aboutsummaryrefslogtreecommitdiffstats
path: root/python/sandcrawler/fileset_platforms.py
Commit message (Collapse)AuthorAgeFilesLines
* filesets: handle unknown file sizes (mypy lint fix)Bryan Newbold2022-09-281-1/+1
|
* filesets: more figshare URL patternsBryan Newbold2022-01-131-0/+13
|
* filesets: handle weird figshare link-only case betterBryan Newbold2021-12-161-1/+4
|
* lint ('not in')Bryan Newbold2021-12-151-2/+2
|
* more fileset ingest tweaksBryan Newbold2021-12-151-0/+2
|
* fileset ingest: more requests timeouts, sessionsBryan Newbold2021-12-151-9/+12
|
* make fmt (black 21.9b0)Bryan Newbold2021-10-271-201/+262
|
* fileset: refactor out tables of helpersBryan Newbold2021-10-271-8/+0
| | | | | | | Having these objects invoked in tables resulted in a whole bunch of objects (including children) getting initialized, which seems like the wrong thing to do. Defer this until the actual ingest fileset worker is initialized.
* update 'XXX' notes from fileset ingest developmentBryan Newbold2021-10-261-8/+5
|
* lint collection membership (last lint for now)Bryan Newbold2021-10-261-2/+2
|
* more progress on type annotations and lintingBryan Newbold2021-10-261-3/+4
|
* flake8 clean (with current settings)Bryan Newbold2021-10-261-4/+4
|
* start handling trivial lint cleanups: unused imports, 'is None', etcBryan Newbold2021-10-261-16/+4
|
* make fmtBryan Newbold2021-10-261-70/+99
|
* python: isort all importsBryan Newbold2021-10-261-5/+5
|
* more small fileset ingest tweaksBryan Newbold2021-10-261-4/+14
|
* more fileset iterationBryan Newbold2021-10-151-2/+2
|
* filesets: iteration of implementation and docsBryan Newbold2021-10-151-34/+35
|
* fileset ingest: improve platform parsingBryan Newbold2021-10-151-12/+196
|
* fileset ingest: improve error handlingBryan Newbold2021-10-151-37/+45
|
* initial implementation of zenodo platform importBryan Newbold2021-10-151-0/+100
|
* initial figshare platform helperBryan Newbold2021-10-151-0/+95
|
* improvements to platform helpersBryan Newbold2021-10-151-32/+39
|
* progress on web ingest strategyBryan Newbold2021-10-151-9/+12
|
* fileset ingest progress for dataverseBryan Newbold2021-10-151-6/+147
|
* progress on dataset ingestBryan Newbold2021-10-151-8/+163
|
* progress on fileset/dataset ingestBryan Newbold2021-10-151-0/+39