index
:
fatcat
bnewbold-doaj-article-harvest
bnewbold-elastic-extras
bnewbold-openapi-client-generator-v601
bnewbold-pythonclient-types
bnewbold-redoc
bnewbold-rust-gen-v5
bnewbold-sitemap
bnewbold-ubuntu-jammy
cockroach
confluent-kafka
master
preview
x-attic-auth-other-macaroon-lib
x-attic-camp
x-attic-changelog-export
x-attic-chocula
x-attic-cockroach
x-attic-golang
x-attic-more-importers
x-attic-preview
x-attic-python-rust-hacks
[no description]
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
path:
root
/
python
/
fatcat_tools
Commit message (
Expand
)
Author
Age
Files
Lines
...
|
*
fileset ingest small tweaks
Bryan Newbold
2021-10-14
1
-21
/
+36
|
*
initial implementation of fileset ingest importers
Bryan Newbold
2021-10-14
2
-3
/
+224
|
*
ingest: handle datasets, components, other ingest types
Bryan Newbold
2021-10-14
1
-1
/
+15
|
*
generic fileset importer class, with test coverage
Bryan Newbold
2021-10-14
3
-0
/
+88
*
|
Merge branch 'bnewbold-match-get'
Bryan Newbold
2021-11-02
1
-3
/
+9
|
\
\
|
*
|
access: populate thumbnail_url for PDFs
Bryan Newbold
2021-10-18
1
-3
/
+9
|
|
/
*
/
pubmed: switch default http site to retrieve update files
Martin Czygan
2021-10-15
1
-2
/
+4
|
/
*
dblp import: basic support for handles as identifiers
Bryan Newbold
2021-10-13
1
-1
/
+5
*
python: normalization/validation support for handle identifiers (hdl)
Bryan Newbold
2021-10-13
1
-0
/
+33
*
dblp import: fix typos in identifier parsing
Bryan Newbold
2021-10-13
1
-2
/
+1
*
python: partial importer utilization of new schema changes
Bryan Newbold
2021-10-13
3
-6
/
+18
*
python: implement ES schema changes
Bryan Newbold
2021-10-13
1
-4
/
+17
*
Merge branch 'bnewbold-ingest-tweaks' into 'master'
bnewbold
2021-10-02
3
-39
/
+106
|
\
|
*
kafka import: optional 'force-flush' mode for some importers
Bryan Newbold
2021-10-01
1
-0
/
+13
|
*
new SPN web (html) importer
Bryan Newbold
2021-10-01
2
-27
/
+81
|
*
ingest importer behavior tweaks
Bryan Newbold
2021-10-01
1
-8
/
+8
|
*
importer common: more verbose logging (with counts)
Bryan Newbold
2021-10-01
1
-4
/
+4
*
|
datacite: skip empty abstracts
Martin Czygan
2021-10-01
1
-1
/
+4
|
/
*
pubmed: workaround a networking issue
Martin Czygan
2021-09-09
1
-24
/
+21
*
pubmed: add option to ftp download with lftp
Martin Czygan
2021-09-08
1
-2
/
+31
*
pubmed harvester: add basic retry logic
Martin Czygan
2021-08-20
1
-8
/
+21
*
refs: default to *not* consolidating works
Bryan Newbold
2021-08-06
1
-1
/
+1
*
refs: lint fixes
Bryan Newbold
2021-07-27
1
-0
/
+1
*
refs: support for wikipedia outbound refs, and display in tables
Bryan Newbold
2021-07-27
1
-2
/
+2
*
refs: generalize web endpoints; JSON content negotiation; openlibrary inbound...
Bryan Newbold
2021-07-23
2
-22
/
+57
*
refs: small refactors/tweaks
Bryan Newbold
2021-07-23
1
-11
/
+17
*
remove unused imports (lint)
Bryan Newbold
2021-07-23
2
-3
/
+2
*
pylint: skip pydantic import check (dynamic/extensions)
Bryan Newbold
2021-07-23
1
-8
/
+2
*
refs: refactor web paths; enrich refs as generic; remove old refs link
Bryan Newbold
2021-07-23
1
-50
/
+35
*
refs fetch: add some hacks; sort hits
Bryan Newbold
2021-07-23
1
-6
/
+16
*
fixes for newer ref index
Bryan Newbold
2021-07-23
1
-1
/
+1
*
references: refactor to point to access_options transform; comment out CSL fi...
Bryan Newbold
2021-07-23
1
-57
/
+8
*
partial access options transform for releases
Bryan Newbold
2021-07-23
1
-0
/
+58
*
initial inbound/outbound reference query helpers
Bryan Newbold
2021-07-23
1
-0
/
+450
*
pubmed: update docs
Martin Czygan
2021-07-17
1
-2
/
+3
*
pubmed: do not fail when accessing missing file
Martin Czygan
2021-07-17
1
-2
/
+8
*
pubmed: reconnect on error
Martin Czygan
2021-07-16
1
-4
/
+30
*
more consistent and defensive lower-casing of DOIs
Bryan Newbold
2021-06-23
3
-3
/
+8
*
datacite: more careful title string access; fixes sentry #88350
Martin Czygan
2021-06-11
1
-1
/
+1
*
clean_doi() should lower-case returned DOI
Bryan Newbold
2021-06-07
1
-1
/
+4
*
ingest: swap ingest and file checks, to result in clearer stats/counts of ski...
Bryan Newbold
2021-06-03
1
-2
/
+2
*
ingest: don't accept mag and s2 URLs
Bryan Newbold
2021-06-03
1
-4
/
+4
*
changelog worker: fix file/fileset typo, caught by lint
Bryan Newbold
2021-05-25
1
-1
/
+1
*
small python lint fixes (no behavior change)
Bryan Newbold
2021-05-25
3
-4
/
+2
*
ingest: add per-container ingest type overrides
Bryan Newbold
2021-05-21
1
-1
/
+17
*
arabesque importer: ensure full 14-digit timestamps
Bryan Newbold
2021-05-21
1
-1
/
+3
*
transforms: fix 'display_ame' typo
Bryan Newbold
2021-04-19
1
-2
/
+2
*
prefer contrib.creator.display_name over contrib.raw_name
Bryan Newbold
2021-04-12
2
-4
/
+7
*
es worker: ensure kafka messages get cleared
Bryan Newbold
2021-04-12
1
-0
/
+2
*
es indexing: more 'wip' fixes
Bryan Newbold
2021-04-12
1
-1
/
+5
[prev]
[next]