index
:
fatcat
bnewbold-doaj-article-harvest
bnewbold-elastic-extras
bnewbold-openapi-client-generator-v601
bnewbold-pythonclient-types
bnewbold-redoc
bnewbold-rust-gen-v5
bnewbold-sitemap
bnewbold-ubuntu-jammy
cockroach
confluent-kafka
master
preview
x-attic-auth-other-macaroon-lib
x-attic-camp
x-attic-changelog-export
x-attic-chocula
x-attic-cockroach
x-attic-golang
x-attic-more-importers
x-attic-preview
x-attic-python-rust-hacks
[no description]
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
path:
root
/
python
/
fatcat_import.py
Commit message (
Expand
)
Author
Age
Files
Lines
*
pubmed ftp harvest and KafkaBs4XmlPusher
Martin Czygan
2020-02-19
1
-16
/
+16
*
refactor fatcat_import kafka group names
Bryan Newbold
2020-01-21
1
-13
/
+54
*
fix trivial one-character typo in fatcat_import.py
Bryan Newbold
2020-01-17
1
-1
/
+1
*
actually control pubmed updates with a flag
Bryan Newbold
2020-01-17
1
-0
/
+4
*
add missing sentry/raven tags
Bryan Newbold
2020-01-10
1
-0
/
+6
*
Merge branch 'martin-datacite-import'
Martin Czygan
2020-01-08
1
-0
/
+43
|
\
|
*
datacite: fix typos
Martin Czygan
2020-01-07
1
-1
/
+1
|
*
datacite: remove --lang-detect flag
Martin Czygan
2020-01-03
1
-4
/
+0
|
*
datacite: use specific auth var
Martin Czygan
2019-12-28
1
-1
/
+1
|
*
datacite: add missing --extid-map-file flag
Martin Czygan
2019-12-28
1
-0
/
+4
|
*
improve datacite field mapping and import
Martin Czygan
2019-12-28
1
-1
/
+14
|
*
datacite: importer skeleton
Martin Czygan
2019-12-28
1
-0
/
+30
*
|
importers: control update behavior with more-standard flag
Bryan Newbold
2020-01-06
1
-1
/
+5
|
/
*
savepapernow result importer
Bryan Newbold
2019-12-12
1
-0
/
+24
*
improve argparse usage
Bryan Newbold
2019-12-11
1
-18
/
+30
*
tweaks to file ingest importer
Bryan Newbold
2019-12-03
1
-0
/
+6
*
have ingest-file-results importer operate as crawl-bot
Bryan Newbold
2019-11-15
1
-1
/
+1
*
better ingest-file-results import name
Bryan Newbold
2019-11-15
1
-1
/
+1
*
ingest file result importer
Bryan Newbold
2019-11-15
1
-0
/
+34
*
small fixes to confluent-kafka importers/workers
Bryan Newbold
2019-09-20
1
-1
/
+1
*
convert importers to confluent-kafka library
Bryan Newbold
2019-09-20
1
-2
/
+3
*
start chocula importer
Bryan Newbold
2019-09-03
1
-0
/
+14
*
support extids in matched importer
Bryan Newbold
2019-06-20
1
-0
/
+4
*
faster LargeFile XML importer for PubMed
Bryan Newbold
2019-05-29
1
-1
/
+1
*
make pubmed ref lookups configurable
Bryan Newbold
2019-05-22
1
-1
/
+8
*
creative importer for bulk JSTOR imports
Bryan Newbold
2019-05-22
1
-0
/
+18
*
pubmed importer command and tweaks
Bryan Newbold
2019-05-22
1
-0
/
+25
*
arxiv importer robustification and CLI impl
Bryan Newbold
2019-05-21
1
-0
/
+21
*
JALC bulk file importer
Bryan Newbold
2019-05-21
1
-0
/
+21
*
fix default mimetype (impacted pre-1923 files)
Bryan Newbold
2019-05-15
1
-1
/
+5
*
editgroup description override
Bryan Newbold
2019-04-22
1
-1
/
+11
*
minor arabesque tweaks
Bryan Newbold
2019-04-18
1
-12
/
+22
*
arabesque importer using crawl-bot creds
Bryan Newbold
2019-04-18
1
-1
/
+1
*
arabesque import tweaks
Bryan Newbold
2019-04-18
1
-0
/
+4
*
early version of arabesque importer
Bryan Newbold
2019-04-12
1
-0
/
+28
*
importer for CDL/DASH dat pilot dweb datasets
Bryan Newbold
2019-03-19
1
-1
/
+29
*
new importer: wayback_static
Bryan Newbold
2019-03-19
1
-0
/
+48
*
reduce default import batch size to 50
Bryan Newbold
2019-01-29
1
-1
/
+1
*
batch size as a general import param
Bryan Newbold
2019-01-28
1
-13
/
+4
*
add missing bezerk-mode flag to GROBID import
Bryan Newbold
2019-01-28
1
-3
/
+8
*
fix typo in crossref importer
Bryan Newbold
2019-01-28
1
-1
/
+1
*
update journal meta import/transform
Bryan Newbold
2019-01-25
1
-3
/
+3
*
more import script fixes
Bryan Newbold
2019-01-23
1
-1
/
+4
*
update importer script
Bryan Newbold
2019-01-23
1
-33
/
+24
*
pubmed+datacite tokens; no journal,grobid,matched tokens
Bryan Newbold
2019-01-22
1
-2
/
+2
*
issn => journal_metadata in several places
Bryan Newbold
2019-01-17
1
-9
/
+9
*
start refactoring API object passing
Bryan Newbold
2019-01-08
1
-13
/
+36
*
crossref importer checks for existing DOIs
Bryan Newbold
2018-11-21
1
-3
/
+7
*
correct kafka topic names
Bryan Newbold
2018-11-20
1
-1
/
+1
*
start supporting kafka importers
Bryan Newbold
2018-11-19
1
-3
/
+17
[next]