index
:
fatcat
bnewbold-doaj-article-harvest
bnewbold-elastic-extras
bnewbold-openapi-client-generator-v601
bnewbold-pythonclient-types
bnewbold-redoc
bnewbold-rust-gen-v5
bnewbold-sitemap
bnewbold-ubuntu-jammy
cockroach
confluent-kafka
master
preview
x-attic-auth-other-macaroon-lib
x-attic-camp
x-attic-changelog-export
x-attic-chocula
x-attic-cockroach
x-attic-golang
x-attic-more-importers
x-attic-preview
x-attic-python-rust-hacks
[no description]
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
Commit message (
Expand
)
Author
Age
Files
Lines
*
Merge branch 'bnewbold-import-refactors' into 'master'
bnewbold
2021-11-11
27
-1599
/
+874
|
\
|
*
update datacite tests for license slug changes
Bryan Newbold
2021-11-10
2
-8
/
+7
|
*
improve lookup_license_slug helper and lookup table
Bryan Newbold
2021-11-10
2
-56
/
+62
|
*
refactor importer metadata tables into separate file; move some helpers around
Bryan Newbold
2021-11-10
10
-702
/
+682
|
*
importers: refactor imports of clean() and other normalization helpers
Bryan Newbold
2021-11-10
12
-95
/
+104
|
*
remove cdl_dash_dat and wayback_static importers
Bryan Newbold
2021-11-10
4
-596
/
+0
|
*
datacite import: store less subject metadata
Bryan Newbold
2021-11-10
1
-1
/
+7
|
*
add notes about 'double slash in DOI' issue
Bryan Newbold
2021-11-09
1
-0
/
+46
|
*
importers: use clean_doi() in many more (all?) importers
Bryan Newbold
2021-11-09
6
-12
/
+29
|
*
clean_doi: stop mutating double-slash DOIs, except for 10.1037 prefix
Bryan Newbold
2021-11-09
1
-1
/
+2
|
*
remove deprecated extid sqlite3 lookup table feature from importers
Bryan Newbold
2021-11-09
10
-203
/
+10
*
|
Merge branch 'bnewbold-cleanups-nov2021' into 'master'
bnewbold
2021-11-11
9
-1
/
+1504
|
\
\
|
*
|
wayback ts cleanup: one more filter tweak
Bryan Newbold
2021-11-09
1
-1
/
+2
|
*
|
update cleanups notes
Bryan Newbold
2021-11-09
2
-0
/
+72
|
*
|
file/release bugfix: handle files with multiple edits
Bryan Newbold
2021-11-09
1
-6
/
+6
|
*
|
cleanups: add more state=active checks
Bryan Newbold
2021-11-09
2
-0
/
+8
|
*
|
update link source filters in file/release bugfix
Bryan Newbold
2021-11-09
1
-2
/
+8
|
*
|
initial file/release bugfix cleanup worker and notes
Bryan Newbold
2021-11-09
2
-0
/
+375
|
*
|
updates to lowercase DOI cleanup
Bryan Newbold
2021-11-09
2
-7
/
+86
|
*
|
lowercase DOI lint and check entity status
Bryan Newbold
2021-11-09
1
-4
/
+5
|
*
|
more iteration on short wayback timestamp cleanup
Bryan Newbold
2021-11-09
3
-4
/
+129
|
*
|
lint: minor import tweak
Bryan Newbold
2021-11-09
1
-1
/
+1
|
*
|
cleanups: tweaks to wayback CDX cleanup scripts
Bryan Newbold
2021-11-09
2
-6
/
+21
|
*
|
cleanups: initial lowercase DOI cleanup script
Bryan Newbold
2021-11-09
1
-0
/
+145
|
*
|
wayback short ts: another regression test, and some small fmt/tweaks
Bryan Newbold
2021-11-09
1
-3
/
+38
|
*
|
wayback cleanup: actually update entity
Bryan Newbold
2021-11-09
1
-2
/
+4
|
*
|
imports: generic file cleanup removes exact duplicate URLs
Bryan Newbold
2021-11-09
1
-0
/
+9
|
*
|
wayback short ts: add regression test for dupe URLs
Bryan Newbold
2021-11-09
1
-0
/
+44
|
*
|
short wayback ts: initial cleanup script implementation
Bryan Newbold
2021-11-09
1
-0
/
+251
|
*
|
wayback timestamps: updates to handle 4-digit case
Bryan Newbold
2021-11-09
2
-11
/
+108
|
*
|
start work on wayback short-timestamp cleanup
Bryan Newbold
2021-11-09
2
-0
/
+238
|
|
/
*
|
update crawlability docs
Bryan Newbold
2021-11-10
1
-1
/
+9
*
|
sitemap generation improvements
Bryan Newbold
2021-11-10
2
-1
/
+2
*
|
start notes/proposal about 'crawlability' improvements
Bryan Newbold
2021-11-10
1
-0
/
+68
*
|
pubmed: allow updates if PMCID does not exist yet
Bryan Newbold
2021-11-10
1
-1
/
+6
|
/
*
update CHANGELOG for recent development
Bryan Newbold
2021-11-05
1
-0
/
+26
*
python tests: verify array sort order
Bryan Newbold
2021-11-05
4
-20
/
+18
*
api: add SQL 'ORDER BY' to many reads to stabilize API array ordering
Bryan Newbold
2021-11-05
1
-3
/
+14
*
enable type annotation checking with flake8 by default ('make lint')
Bryan Newbold
2021-11-03
1
-4
/
+2
*
cleanups: create a separate JsonLinePusher for cleanup workers (distinct base...
Bryan Newbold
2021-11-03
3
-4
/
+20
*
facat_import.py: work around corner case in run_cdl_dash_dat()
Bryan Newbold
2021-11-03
1
-1
/
+1
*
datacite importer: remove unused 'year_only' variable
Bryan Newbold
2021-11-03
1
-2
/
+3
*
web: work around remaining type annotation issues
Bryan Newbold
2021-11-03
2
-11
/
+15
*
ignore type errors in cors.py (third party code)
Bryan Newbold
2021-11-03
1
-2
/
+2
*
web: fix bytes/text warning logging
Bryan Newbold
2021-11-03
1
-3
/
+3
*
lint: remove unused import
Bryan Newbold
2021-11-03
1
-1
/
+0
*
web config: add helper for coercing env vars into booleans
Bryan Newbold
2021-11-03
1
-3
/
+32
*
web: add type annotations
Bryan Newbold
2021-11-03
12
-297
/
+347
*
introduce 'AnyResponse' type for Flask views
Bryan Newbold
2021-11-03
2
-0
/
+15
*
pubmed harvester: remove unused variables
Bryan Newbold
2021-11-03
1
-2
/
+2
[next]