index
:
fatcat
bnewbold-doaj-article-harvest
bnewbold-elastic-extras
bnewbold-openapi-client-generator-v601
bnewbold-pythonclient-types
bnewbold-redoc
bnewbold-rust-gen-v5
bnewbold-sitemap
bnewbold-ubuntu-jammy
cockroach
confluent-kafka
master
preview
x-attic-auth-other-macaroon-lib
x-attic-camp
x-attic-changelog-export
x-attic-chocula
x-attic-cockroach
x-attic-golang
x-attic-more-importers
x-attic-preview
x-attic-python-rust-hacks
[no description]
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
path:
root
/
python
/
fatcat_tools
Commit message (
Expand
)
Author
Age
Files
Lines
*
ingest fileset fixes, and some test coverage
Bryan Newbold
2022-03-23
2
-13
/
+30
*
dataset ingest: JSON object fixes
Bryan Newbold
2022-03-22
1
-5
/
+5
*
Merge branch 'bnewbold-container-web' into 'master'
bnewbold
2022-03-10
3
-2
/
+185
|
\
|
*
move container_status ES query code from fatcat_web to fatcat_tools
Bryan Newbold
2022-02-09
3
-2
/
+185
*
|
entity updates: don't try to ingest arxiv DOIs (for now)
Bryan Newbold
2022-02-28
1
-0
/
+2
*
|
datacite importer: skip container_id for some repository sources
Bryan Newbold
2022-02-09
1
-0
/
+34
|
/
*
doaj importer: TODO note to skip some larger publishers
Bryan Newbold
2022-02-09
1
-0
/
+4
*
container ES transform: include old extra.issne/p fields
Bryan Newbold
2022-02-03
1
-1
/
+4
*
Merge branch 'bnewbold-file-es' into 'master'
bnewbold
2022-01-21
3
-4
/
+38
|
\
|
*
entity worker: expand creators in release entities
Bryan Newbold
2021-12-15
1
-1
/
+1
|
*
small default config typo fixes for elasticsearch workers
Bryan Newbold
2021-12-15
1
-2
/
+2
|
*
file elasticsearch index worker
Bryan Newbold
2021-12-15
2
-1
/
+35
*
|
crossref importer: skip affiliations lacking 'name'
Bryan Newbold
2021-12-15
1
-0
/
+3
|
/
*
mergers: fix typo in env var name
Bryan Newbold
2021-12-07
3
-3
/
+3
*
ES container schema: add 'sim_pubid' and `ia_sim_collection` fields
Bryan Newbold
2021-12-03
1
-0
/
+2
*
ES transform: remove prototype microfilm links
Bryan Newbold
2021-12-03
1
-20
/
+0
*
chocula importer: handle not-upper-case ISSNs
Bryan Newbold
2021-11-30
1
-2
/
+6
*
chocula importer: handle broken ISSNs in extra metadata
Bryan Newbold
2021-11-30
1
-2
/
+7
*
chocula importer: tweak counting, conditions for doing updates
Bryan Newbold
2021-11-30
1
-15
/
+7
*
chocula importer: move issne/issnp 'extra' to top-level fields if doing updates
Bryan Newbold
2021-11-30
1
-0
/
+6
*
chocula: don't do name cleanups in importer
Bryan Newbold
2021-11-30
1
-8
/
+2
*
container merger: fix bug with filtering by release count
Bryan Newbold
2021-11-30
1
-13
/
+15
*
release merger: same editgroup_id fixes as for file and container mergers
Bryan Newbold
2021-11-24
1
-1
/
+5
*
container merger: fixes from QA testing
Bryan Newbold
2021-11-24
1
-8
/
+13
*
mergers: don't try to accept empty editgroups in dry-run-mode
Bryan Newbold
2021-11-24
1
-2
/
+4
*
ES release transform: handle redirected containers better
Bryan Newbold
2021-11-24
1
-1
/
+1
*
container merger: defer allocation of editgroup_id; and dummy code path
Bryan Newbold
2021-11-24
1
-1
/
+5
*
initial implementation of container merger
Bryan Newbold
2021-11-24
1
-0
/
+237
*
file merger: allocate editgroup id later in 'merge' process
Bryan Newbold
2021-11-24
1
-1
/
+5
*
Merge branch 'bnewbold-mergers' into 'master'
bnewbold
2021-11-25
4
-0
/
+640
|
\
|
*
mergers common: remove inaccurate comment
Bryan Newbold
2021-11-24
1
-2
/
+0
|
*
file merger: add content_scope to list of merged fields
Bryan Newbold
2021-11-24
1
-1
/
+1
|
*
release merger: some progress, but also disable (not complete)
Bryan Newbold
2021-11-23
1
-12
/
+72
|
*
file merges: fixes from testing in QA
Bryan Newbold
2021-11-23
1
-14
/
+23
|
*
mergers: small tweaks
Bryan Newbold
2021-11-23
2
-3
/
+3
|
*
mergers: remove entity mergers from __init__ (to work around warning)
Bryan Newbold
2021-11-23
1
-2
/
+0
|
*
initial file merger, with tests
Bryan Newbold
2021-11-23
1
-0
/
+228
|
*
mergers: fmt, lint, refactors
Bryan Newbold
2021-11-23
3
-96
/
+200
|
*
first iteration of mergers
Bryan Newbold
2021-11-23
3
-0
/
+243
*
|
codespell fixes in python code (comments)
Bryan Newbold
2021-11-24
2
-3
/
+3
|
/
*
content_scope: include in file ES schema and transform
Bryan Newbold
2021-11-17
1
-0
/
+1
*
Merge branch 'bnewbold-import-refactors' into 'master'
bnewbold
2021-11-11
18
-1462
/
+811
|
\
|
*
improve lookup_license_slug helper and lookup table
Bryan Newbold
2021-11-10
2
-56
/
+62
|
*
refactor importer metadata tables into separate file; move some helpers around
Bryan Newbold
2021-11-10
10
-702
/
+682
|
*
importers: refactor imports of clean() and other normalization helpers
Bryan Newbold
2021-11-10
12
-95
/
+104
|
*
remove cdl_dash_dat and wayback_static importers
Bryan Newbold
2021-11-10
3
-510
/
+0
|
*
datacite import: store less subject metadata
Bryan Newbold
2021-11-10
1
-1
/
+7
|
*
importers: use clean_doi() in many more (all?) importers
Bryan Newbold
2021-11-09
6
-12
/
+29
|
*
clean_doi: stop mutating double-slash DOIs, except for 10.1037 prefix
Bryan Newbold
2021-11-09
1
-1
/
+2
|
*
remove deprecated extid sqlite3 lookup table feature from importers
Bryan Newbold
2021-11-09
3
-160
/
+0
[next]