index
:
fatcat
bnewbold-doaj-article-harvest
bnewbold-elastic-extras
bnewbold-openapi-client-generator-v601
bnewbold-pythonclient-types
bnewbold-redoc
bnewbold-rust-gen-v5
bnewbold-sitemap
bnewbold-ubuntu-jammy
cockroach
confluent-kafka
master
preview
x-attic-auth-other-macaroon-lib
x-attic-camp
x-attic-changelog-export
x-attic-chocula
x-attic-cockroach
x-attic-golang
x-attic-more-importers
x-attic-preview
x-attic-python-rust-hacks
[no description]
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
path:
root
/
python
/
fatcat_tools
Commit message (
Expand
)
Author
Age
Files
Lines
...
*
|
ensure importer description arg isn't clobbered
Bryan Newbold
2019-12-12
3
-5
/
+5
*
|
tweaks to ingest-file transform
Bryan Newbold
2019-12-12
1
-13
/
+7
*
|
savepapernow result importer
Bryan Newbold
2019-12-12
2
-4
/
+65
*
|
flush importer editgroups every few minutes
Bryan Newbold
2019-12-12
1
-5
/
+20
*
|
EntityImporter: submit (not accept) mode
Bryan Newbold
2019-12-12
1
-2
/
+14
|
/
*
factor out some basic kafka helpers
Bryan Newbold
2019-12-10
2
-0
/
+23
*
add another ingest request source to whitelist
Bryan Newbold
2019-12-10
1
-2
/
+5
*
refactor kafka producer in crossref harvester
Bryan Newbold
2019-12-06
1
-21
/
+26
*
tweaks to file ingest importer
Bryan Newbold
2019-12-03
1
-3
/
+4
*
crossref is_update isn't what I thought
Bryan Newbold
2019-12-03
1
-6
/
+2
*
re-order ingest want() for better stats
Bryan Newbold
2019-11-15
1
-7
/
+10
*
project -> ingest_request_source
Bryan Newbold
2019-11-15
3
-9
/
+9
*
fix release.pmcid typo
Bryan Newbold
2019-11-15
1
-2
/
+2
*
ingest importer fixes
Bryan Newbold
2019-11-15
1
-3
/
+4
*
more ingest importer comments and counts
Bryan Newbold
2019-11-15
2
-2
/
+29
*
crude support for 'sandcrawler' kafka topics
Bryan Newbold
2019-11-15
1
-2
/
+3
*
ingest file result importer
Bryan Newbold
2019-11-15
2
-2
/
+135
*
add ingest request feature to entity_updates worker
Bryan Newbold
2019-11-15
1
-4
/
+20
*
add ingest request transform (and test)
Bryan Newbold
2019-11-15
2
-0
/
+67
*
crossref: accurate blank title counts
Bryan Newbold
2019-11-05
1
-0
/
+1
*
crossref: component type
Bryan Newbold
2019-11-04
1
-1
/
+3
*
crossref: count why skip happened
Bryan Newbold
2019-11-04
1
-1
/
+7
*
crossref: don't skip on short/null subtitle
Bryan Newbold
2019-11-04
1
-1
/
+1
*
file cleanup tweaks to actually run
Bryan Newbold
2019-10-08
2
-5
/
+4
*
refactor duplicated b32_hex function in importers
Bryan Newbold
2019-10-08
3
-21
/
+11
*
dict wrapper for entity_from_json()
Bryan Newbold
2019-10-08
2
-3
/
+7
*
new cleanup python tool/framework
Bryan Newbold
2019-10-08
4
-0
/
+241
*
review/fix all confluent-kafka produce code
Bryan Newbold
2019-09-20
6
-27
/
+75
*
small fixes to confluent-kafka importers/workers
Bryan Newbold
2019-09-20
6
-24
/
+67
*
convert pipeline workers from pykafka to confluent-kafka
Bryan Newbold
2019-09-20
3
-125
/
+230
*
small kafka tweaks for robustness
Bryan Newbold
2019-09-20
2
-0
/
+5
*
convert importers to confluent-kafka library
Bryan Newbold
2019-09-20
1
-19
/
+71
*
bump max message size to ~20 MBytes
Bryan Newbold
2019-09-20
2
-0
/
+2
*
fixes to confluent-kafka harvesters
Bryan Newbold
2019-09-20
3
-20
/
+21
*
first draft harvesters using confluent-kafka
Bryan Newbold
2019-09-20
3
-48
/
+104
*
handle more external identifiers in python
Bryan Newbold
2019-09-18
1
-14
/
+97
*
refactor all python source for client lib name
Bryan Newbold
2019-09-05
21
-121
/
+121
*
fix Importer editgroup_extra pass-through
Bryan Newbold
2019-09-05
1
-2
/
+1
*
comment clarifying container.ident in ES release transform
Bryan Newbold
2019-09-03
1
-0
/
+2
*
file rel: social -> academicsocial
Bryan Newbold
2019-09-03
1
-2
/
+2
*
fix previous fix (need tests)
Bryan Newbold
2019-09-03
1
-2
/
+2
*
fix typo bug in container ES transform
Bryan Newbold
2019-09-03
1
-2
/
+2
*
last chocula import behavior tweaks
Bryan Newbold
2019-09-03
1
-3
/
+21
*
more careful chocula import counts; don't re-update empty URLs
Bryan Newbold
2019-09-03
1
-2
/
+6
*
better importer 'total' counting
Bryan Newbold
2019-09-03
1
-4
/
+2
*
chocula importer: include DOAJ updates
Bryan Newbold
2019-09-03
1
-2
/
+2
*
use EZB and szczepanski as OA signals (ES)
Bryan Newbold
2019-09-03
1
-0
/
+12
*
improvements to chocula importer
Bryan Newbold
2019-09-03
1
-1
/
+7
*
implement ChoculaImporter
Bryan Newbold
2019-09-03
2
-0
/
+137
*
improvements to wayback_static importer
Bryan Newbold
2019-08-22
1
-6
/
+29
[prev]
[next]