index
:
sandcrawler
bnewbold-args
bnewbold-backfill
bnewbold-persist-grobid-errors
bnewbold-refactor-loggging
master
trawler
[no description]
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
path:
root
/
python
/
sandcrawler
/
fileset_platforms.py
Commit message (
Expand
)
Author
Age
Files
Lines
*
filesets: handle unknown file sizes (mypy lint fix)
Bryan Newbold
2022-09-28
1
-1
/
+1
*
filesets: more figshare URL patterns
Bryan Newbold
2022-01-13
1
-0
/
+13
*
filesets: handle weird figshare link-only case better
Bryan Newbold
2021-12-16
1
-1
/
+4
*
lint ('not in')
Bryan Newbold
2021-12-15
1
-2
/
+2
*
more fileset ingest tweaks
Bryan Newbold
2021-12-15
1
-0
/
+2
*
fileset ingest: more requests timeouts, sessions
Bryan Newbold
2021-12-15
1
-9
/
+12
*
make fmt (black 21.9b0)
Bryan Newbold
2021-10-27
1
-201
/
+262
*
fileset: refactor out tables of helpers
Bryan Newbold
2021-10-27
1
-8
/
+0
*
update 'XXX' notes from fileset ingest development
Bryan Newbold
2021-10-26
1
-8
/
+5
*
lint collection membership (last lint for now)
Bryan Newbold
2021-10-26
1
-2
/
+2
*
more progress on type annotations and linting
Bryan Newbold
2021-10-26
1
-3
/
+4
*
flake8 clean (with current settings)
Bryan Newbold
2021-10-26
1
-4
/
+4
*
start handling trivial lint cleanups: unused imports, 'is None', etc
Bryan Newbold
2021-10-26
1
-16
/
+4
*
make fmt
Bryan Newbold
2021-10-26
1
-70
/
+99
*
python: isort all imports
Bryan Newbold
2021-10-26
1
-5
/
+5
*
more small fileset ingest tweaks
Bryan Newbold
2021-10-26
1
-4
/
+14
*
more fileset iteration
Bryan Newbold
2021-10-15
1
-2
/
+2
*
filesets: iteration of implementation and docs
Bryan Newbold
2021-10-15
1
-34
/
+35
*
fileset ingest: improve platform parsing
Bryan Newbold
2021-10-15
1
-12
/
+196
*
fileset ingest: improve error handling
Bryan Newbold
2021-10-15
1
-37
/
+45
*
initial implementation of zenodo platform import
Bryan Newbold
2021-10-15
1
-0
/
+100
*
initial figshare platform helper
Bryan Newbold
2021-10-15
1
-0
/
+95
*
improvements to platform helpers
Bryan Newbold
2021-10-15
1
-32
/
+39
*
progress on web ingest strategy
Bryan Newbold
2021-10-15
1
-9
/
+12
*
fileset ingest progress for dataverse
Bryan Newbold
2021-10-15
1
-6
/
+147
*
progress on dataset ingest
Bryan Newbold
2021-10-15
1
-8
/
+163
*
progress on fileset/dataset ingest
Bryan Newbold
2021-10-15
1
-0
/
+39