index
:
fatcat
bnewbold-doaj-article-harvest
bnewbold-elastic-extras
bnewbold-openapi-client-generator-v601
bnewbold-pythonclient-types
bnewbold-redoc
bnewbold-rust-gen-v5
bnewbold-sitemap
bnewbold-ubuntu-jammy
cockroach
confluent-kafka
master
preview
x-attic-auth-other-macaroon-lib
x-attic-camp
x-attic-changelog-export
x-attic-chocula
x-attic-cockroach
x-attic-golang
x-attic-more-importers
x-attic-preview
x-attic-python-rust-hacks
[no description]
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
path:
root
/
python
/
fatcat_tools
Commit message (
Expand
)
Author
Age
Files
Lines
*
python: fix api annotations (DefaultApi not ApiClient)
Bryan Newbold
2021-11-23
29
-65
/
+65
*
content_scope: include in file ES schema and transform
Bryan Newbold
2021-11-17
1
-0
/
+1
*
Merge branch 'bnewbold-import-refactors' into 'master'
bnewbold
2021-11-11
18
-1462
/
+811
|
\
|
*
improve lookup_license_slug helper and lookup table
Bryan Newbold
2021-11-10
2
-56
/
+62
|
*
refactor importer metadata tables into separate file; move some helpers around
Bryan Newbold
2021-11-10
10
-702
/
+682
|
*
importers: refactor imports of clean() and other normalization helpers
Bryan Newbold
2021-11-10
12
-95
/
+104
|
*
remove cdl_dash_dat and wayback_static importers
Bryan Newbold
2021-11-10
3
-510
/
+0
|
*
datacite import: store less subject metadata
Bryan Newbold
2021-11-10
1
-1
/
+7
|
*
importers: use clean_doi() in many more (all?) importers
Bryan Newbold
2021-11-09
6
-12
/
+29
|
*
clean_doi: stop mutating double-slash DOIs, except for 10.1037 prefix
Bryan Newbold
2021-11-09
1
-1
/
+2
|
*
remove deprecated extid sqlite3 lookup table feature from importers
Bryan Newbold
2021-11-09
3
-160
/
+0
*
|
Merge branch 'bnewbold-cleanups-nov2021' into 'master'
bnewbold
2021-11-11
4
-0
/
+748
|
\
\
|
*
|
file/release bugfix: handle files with multiple edits
Bryan Newbold
2021-11-09
1
-6
/
+6
|
*
|
cleanups: add more state=active checks
Bryan Newbold
2021-11-09
2
-0
/
+8
|
*
|
update link source filters in file/release bugfix
Bryan Newbold
2021-11-09
1
-2
/
+8
|
*
|
initial file/release bugfix cleanup worker and notes
Bryan Newbold
2021-11-09
1
-0
/
+231
|
*
|
updates to lowercase DOI cleanup
Bryan Newbold
2021-11-09
1
-7
/
+15
|
*
|
lowercase DOI lint and check entity status
Bryan Newbold
2021-11-09
1
-4
/
+5
|
*
|
more iteration on short wayback timestamp cleanup
Bryan Newbold
2021-11-09
1
-1
/
+1
|
*
|
cleanups: tweaks to wayback CDX cleanup scripts
Bryan Newbold
2021-11-09
1
-5
/
+13
|
*
|
cleanups: initial lowercase DOI cleanup script
Bryan Newbold
2021-11-09
1
-0
/
+145
|
*
|
wayback short ts: another regression test, and some small fmt/tweaks
Bryan Newbold
2021-11-09
1
-3
/
+38
|
*
|
wayback cleanup: actually update entity
Bryan Newbold
2021-11-09
1
-2
/
+4
|
*
|
imports: generic file cleanup removes exact duplicate URLs
Bryan Newbold
2021-11-09
1
-0
/
+9
|
*
|
wayback short ts: add regression test for dupe URLs
Bryan Newbold
2021-11-09
1
-0
/
+44
|
*
|
short wayback ts: initial cleanup script implementation
Bryan Newbold
2021-11-09
1
-0
/
+251
|
|
/
*
/
pubmed: allow updates if PMCID does not exist yet
Bryan Newbold
2021-11-10
1
-1
/
+6
|
/
*
cleanups: create a separate JsonLinePusher for cleanup workers (distinct base...
Bryan Newbold
2021-11-03
2
-2
/
+19
*
datacite importer: remove unused 'year_only' variable
Bryan Newbold
2021-11-03
1
-2
/
+3
*
pubmed harvester: remove unused variables
Bryan Newbold
2021-11-03
1
-2
/
+2
*
pubmed harvester: explicit assertions to mark unreachable code paths
Bryan Newbold
2021-11-03
1
-0
/
+2
*
typing: add assertions to fatcat_tool code to make type assumptions explicit
Bryan Newbold
2021-11-03
3
-0
/
+3
*
typing: add annotations to remaining fatcat_tools code
Bryan Newbold
2021-11-03
9
-122
/
+186
*
datacite: add comment about potential date parsing bug
Bryan Newbold
2021-11-03
1
-0
/
+1
*
datacite importer: dateparser.date.DateDataParser()
Bryan Newbold
2021-11-03
1
-1
/
+1
*
more involved type wrangling and fixes for importers
Bryan Newbold
2021-11-03
3
-12
/
+14
*
typing: relatively simple type check fixes
Bryan Newbold
2021-11-03
14
-87
/
+82
*
typing: initial annotations on importers
Bryan Newbold
2021-11-03
22
-274
/
+443
*
typing: first batch of python bulk type annotations
Bryan Newbold
2021-11-03
9
-69
/
+129
*
importers: remove unused __main__ routine
Bryan Newbold
2021-11-03
4
-19
/
+0
*
lint: resolve existing mypy type errors
Bryan Newbold
2021-11-02
8
-50
/
+86
*
re-fix some lint issues after big 'fmt'
Bryan Newbold
2021-11-02
2
-4
/
+5
*
fmt (black): fatcat_tools/
Bryan Newbold
2021-11-02
43
-3194
/
+4020
*
python: isort everything
Bryan Newbold
2021-11-02
32
-71
/
+116
*
arabesque import 'hit' field is 1/0, not true/false
Bryan Newbold
2021-11-02
1
-2
/
+2
*
lint: simple, safe inline lint fixes
Bryan Newbold
2021-11-02
18
-83
/
+82
*
lint/fmt: remove all 'import *'
Bryan Newbold
2021-11-02
5
-21
/
+41
*
entity transforms: add basic type annotations
Bryan Newbold
2021-11-02
1
-7
/
+19
*
ftfy 'fix_entities' argument has been renamed
Bryan Newbold
2021-11-02
1
-4
/
+4
*
hacks to work around new pylint false positives
Bryan Newbold
2021-11-02
1
-2
/
+3
[next]