index
:
fatcat
bnewbold-doaj-article-harvest
bnewbold-elastic-extras
bnewbold-openapi-client-generator-v601
bnewbold-pythonclient-types
bnewbold-redoc
bnewbold-rust-gen-v5
bnewbold-sitemap
bnewbold-ubuntu-jammy
cockroach
confluent-kafka
master
preview
x-attic-auth-other-macaroon-lib
x-attic-camp
x-attic-changelog-export
x-attic-chocula
x-attic-cockroach
x-attic-golang
x-attic-more-importers
x-attic-preview
x-attic-python-rust-hacks
[no description]
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
path:
root
/
python
/
fatcat_tools
/
importers
/
common.py
Commit message (
Expand
)
Author
Age
Files
Lines
*
importers: clarify handling of ApiException
Bryan Newbold
2020-05-22
1
-4
/
+8
*
consistently use raw string prefix for regex
Bryan Newbold
2020-04-17
1
-1
/
+1
*
Merge pull request #53 from EdwardBetts/spelling
bnewbold
2020-03-27
1
-1
/
+1
|
\
|
*
Correct spelling mistakes
Edward Betts
2020-03-27
1
-1
/
+1
*
|
Merge branch 'martin-kafka-bs4-import' into 'master'
Martin Czygan
2020-03-10
1
-0
/
+65
|
\
\
|
|
/
|
/
|
|
*
common: use smaller batch size since XML parsing may be slow
Martin Czygan
2020-03-10
1
-1
/
+1
|
*
pubmed ftp harvest and KafkaBs4XmlPusher
Martin Czygan
2020-02-19
1
-0
/
+65
*
|
add some more domain/rel URL mappings
Bryan Newbold
2020-02-22
1
-0
/
+9
|
/
*
fix KafkaError worker reporting for partition errors
Bryan Newbold
2020-01-29
1
-1
/
+1
*
importers: control update behavior with more-standard flag
Bryan Newbold
2020-01-06
1
-0
/
+1
*
write diagnostic messages to stderr
Martin Czygan
2019-12-16
1
-2
/
+2
*
Merge branch 'martin-importers-common-doc-fix' into 'master'
Martin Czygan
2019-12-14
1
-13
/
+10
|
\
|
*
complete parse_record docstring
Martin Czygan
2019-12-14
1
-0
/
+6
|
*
Update EntityImporter docstring.
Martin Czygan
2019-12-13
1
-13
/
+4
*
|
revert accidentally commited test timing
Bryan Newbold
2019-12-13
1
-2
/
+2
*
|
ensure importer description arg isn't clobbered
Bryan Newbold
2019-12-12
1
-1
/
+3
*
|
flush importer editgroups every few minutes
Bryan Newbold
2019-12-12
1
-5
/
+20
*
|
EntityImporter: submit (not accept) mode
Bryan Newbold
2019-12-12
1
-2
/
+14
|
/
*
crude support for 'sandcrawler' kafka topics
Bryan Newbold
2019-11-15
1
-2
/
+3
*
refactor duplicated b32_hex function in importers
Bryan Newbold
2019-10-08
1
-0
/
+9
*
review/fix all confluent-kafka produce code
Bryan Newbold
2019-09-20
1
-1
/
+0
*
small fixes to confluent-kafka importers/workers
Bryan Newbold
2019-09-20
1
-10
/
+24
*
small kafka tweaks for robustness
Bryan Newbold
2019-09-20
1
-0
/
+3
*
convert importers to confluent-kafka library
Bryan Newbold
2019-09-20
1
-19
/
+71
*
refactor all python source for client lib name
Bryan Newbold
2019-09-05
1
-3
/
+3
*
fix Importer editgroup_extra pass-through
Bryan Newbold
2019-09-05
1
-2
/
+1
*
file rel: social -> academicsocial
Bryan Newbold
2019-09-03
1
-2
/
+2
*
better importer 'total' counting
Bryan Newbold
2019-09-03
1
-4
/
+2
*
make importer extid lookups faster by hiding
Bryan Newbold
2019-05-29
1
-2
/
+2
*
is_cjk() handles kanji better
Bryan Newbold
2019-05-29
1
-4
/
+6
*
faster LargeFile XML importer for PubMed
Bryan Newbold
2019-05-29
1
-0
/
+50
*
more MARC languages, and less verbose reporting
Bryan Newbold
2019-05-24
1
-3
/
+14
*
missing MARC/ISO languages
Bryan Newbold
2019-05-22
1
-0
/
+2
*
Gaelic!
Bryan Newbold
2019-05-22
1
-0
/
+3
*
creative importer for bulk JSTOR imports
Bryan Newbold
2019-05-22
1
-0
/
+22
*
bs4 XML parse cleanup
Bryan Newbold
2019-05-22
1
-0
/
+2
*
JALC bulk file importer
Bryan Newbold
2019-05-21
1
-0
/
+20
*
updates to pubmed importer
Bryan Newbold
2019-05-21
1
-1
/
+20
*
tweaks to new imports/tests
Bryan Newbold
2019-05-21
1
-5
/
+78
*
initial flesh out of JALC parser
Bryan Newbold
2019-05-21
1
-0
/
+36
*
python impl
Bryan Newbold
2019-05-14
1
-3
/
+3
*
add limits to match importers
Bryan Newbold
2019-04-23
1
-0
/
+3
*
archive.org isn't really a repository
Bryan Newbold
2019-04-22
1
-1
/
+3
*
mechanism to not double-update entities
Bryan Newbold
2019-04-18
1
-0
/
+3
*
update URL rel list
Bryan Newbold
2019-04-18
1
-1
/
+10
*
add SqlitePusher importer option
Bryan Newbold
2019-04-12
1
-0
/
+20
*
bunch of lint/whitespace cleanups
Bryan Newbold
2019-02-22
1
-2
/
+2
*
fix bug in clean() resulting in many consistency check fails
Bryan Newbold
2019-01-29
1
-2
/
+3
*
add stub parse_record() to make pylint happy
Bryan Newbold
2019-01-28
1
-0
/
+4
*
don't allow empty or single-character clean strings
Bryan Newbold
2019-01-28
1
-1
/
+1
[next]