index
:
fatcat
bnewbold-doaj-article-harvest
bnewbold-elastic-extras
bnewbold-openapi-client-generator-v601
bnewbold-pythonclient-types
bnewbold-redoc
bnewbold-rust-gen-v5
bnewbold-sitemap
bnewbold-ubuntu-jammy
cockroach
confluent-kafka
master
preview
x-attic-auth-other-macaroon-lib
x-attic-camp
x-attic-changelog-export
x-attic-chocula
x-attic-cockroach
x-attic-golang
x-attic-more-importers
x-attic-preview
x-attic-python-rust-hacks
[no description]
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
Commit message (
Expand
)
Author
Age
Files
Lines
...
*
|
|
table size snapshots
Bryan Newbold
2020-02-19
2
-0
/
+47
*
|
|
Merge branch 'bnewbold-shadow-import'
Bryan Newbold
2020-02-19
7
-2
/
+289
|
\
\
\
|
*
|
|
remove arabesque short wayback URL hack
Bryan Newbold
2020-02-14
1
-6
/
+0
|
*
|
|
clarify shadow filter code
Bryan Newbold
2020-02-13
1
-1
/
+1
|
*
|
|
filter out shadows-only files in webface
Bryan Newbold
2020-02-13
2
-2
/
+7
|
*
|
|
improve shadow import file url cleanup path
Bryan Newbold
2020-02-13
1
-2
/
+12
|
*
|
|
shadow import fixes from QA testing
Bryan Newbold
2020-02-13
2
-1
/
+7
|
*
|
|
shadow import: more filtering of file_meta fields
Bryan Newbold
2020-02-13
3
-18
/
+28
|
*
|
|
basic shadow importer
Bryan Newbold
2020-02-13
5
-0
/
+262
*
|
|
|
more SQL db size reduction notes
Bryan Newbold
2020-02-19
1
-0
/
+16
*
|
|
|
always crawl researchgate DOIs
Bryan Newbold
2020-02-18
1
-0
/
+2
*
|
|
|
ingest import: fix edit_extra path
Bryan Newbold
2020-02-18
1
-1
/
+1
*
|
|
|
ingest importer: edit_extra is a top-level key
Bryan Newbold
2020-02-18
1
-1
/
+1
*
|
|
|
ingest import: allow short version of corpus names
Bryan Newbold
2020-02-18
1
-0
/
+3
*
|
|
|
ingest importer: pass through link rel
Bryan Newbold
2020-02-18
1
-1
/
+6
|
|
_
|
/
|
/
|
|
*
|
|
fatcat_ingest: as 'fatcat-ingest', not 'fatcat-ingest-container'
Bryan Newbold
2020-02-14
1
-1
/
+1
*
|
|
Merge branch 'martin-harvest-print' into 'master'
bnewbold
2020-02-14
3
-17
/
+22
|
\
\
\
|
|
/
/
|
/
|
|
|
*
|
harvest: log state on startup and use stderr for diagnostics
Martin Czygan
2020-02-14
3
-17
/
+22
|
/
/
*
|
add acceptlist override for biorxiv/medrxiv
Bryan Newbold
2020-02-10
1
-2
/
+12
*
|
check ingest_request_source existance for SPN as well as ingest
Bryan Newbold
2020-02-06
1
-0
/
+3
*
|
additional trusted link sources
Bryan Newbold
2020-02-06
1
-0
/
+3
*
|
add mag and s2 as trusted link sources
Bryan Newbold
2020-02-06
1
-1
/
+1
*
|
ingest worker: handle missing ingest_request_source
Bryan Newbold
2020-02-06
1
-0
/
+3
*
|
switch '!= None' to 'is not None'
Bryan Newbold
2020-02-04
1
-3
/
+3
*
|
allow-non-oa is a top-level flag, not sub-command
Bryan Newbold
2020-02-04
1
-3
/
+0
*
|
default to PMC ingest URLs over DOI
Bryan Newbold
2020-02-04
1
-4
/
+4
*
|
ingest: add 'extid' and 'query' modes; filters; refactor
Bryan Newbold
2020-02-04
1
-38
/
+147
*
|
Merge branch 'martin-datacite-strptime-none' into 'master'
Martin Czygan
2020-01-31
1
-1
/
+1
|
\
\
|
*
|
datacite: prevent none
Martin Czygan
2020-01-31
1
-1
/
+1
|
/
/
*
|
Merge branch 'martin-datacite-micropub' into 'master'
Martin Czygan
2020-01-31
4
-25
/
+162
|
\
\
|
|
/
|
/
|
|
*
datacite: name shall not be None
Martin Czygan
2020-01-31
1
-1
/
+1
|
*
datacite: add exception for https://www.micropublication.org/
Martin Czygan
2020-01-31
2
-1
/
+7
|
*
datacite: do not skip records w/o date
Martin Czygan
2020-01-31
1
-2
/
+1
|
*
datacite: improve docstring
Martin Czygan
2020-01-31
1
-4
/
+4
|
*
datacite: improve date handling and minor tweak
Martin Czygan
2020-01-30
4
-21
/
+153
|
/
*
fix KafkaError worker reporting for partition errors
Bryan Newbold
2020-01-29
3
-3
/
+3
*
additional DOI prefix filters
Bryan Newbold
2020-01-28
1
-0
/
+8
*
increase kafka-pixy timeout to 25 seconds
Bryan Newbold
2020-01-28
1
-1
/
+1
*
apply ingest request filtering in entity worker
Bryan Newbold
2020-01-28
1
-3
/
+34
*
remove 'oa_only' feature from ingest transform
Bryan Newbold
2020-01-28
2
-15
/
+1
*
more TODO/proposal cleanup
Bryan Newbold
2020-01-22
4
-10
/
+34
*
more details on potential _edit table disk savings
Bryan Newbold
2020-01-22
1
-3
/
+23
*
proposal of ideas for reducing database size
Bryan Newbold
2020-01-21
1
-0
/
+154
*
cleanup some of old TODO list into proposals
Bryan Newbold
2020-01-21
4
-44
/
+269
*
refactor fatcat_import kafka group names
Bryan Newbold
2020-01-21
1
-13
/
+54
*
fix trivial typo in file importer
Bryan Newbold
2020-01-20
1
-1
/
+1
*
stats: remove internal PG table sizes from old dumps
Bryan Newbold
2020-01-19
2
-292
/
+0
*
update stats and table sizes
Bryan Newbold
2020-01-19
4
-0
/
+96
*
Merge branch 'martin-openapi-typo-exmaple' into 'master'
bnewbold
2020-01-19
1
-1
/
+1
|
\
|
*
fix a typo in openapi definition
Martin Czygan
2020-01-18
1
-1
/
+1
[prev]
[next]