index
:
sandcrawler
bnewbold-args
bnewbold-backfill
bnewbold-persist-grobid-errors
bnewbold-refactor-loggging
master
trawler
[no description]
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
path:
root
/
python
/
sandcrawler
/
db.py
Commit message (
Expand
)
Author
Age
Files
Lines
*
tweak html_meta SQL schema
Bryan Newbold
2020-11-03
1
-12
/
+19
*
html: start on SQL table
Bryan Newbold
2020-11-03
1
-0
/
+44
*
fixes and tweaks from testing locally
Bryan Newbold
2020-06-17
1
-0
/
+47
*
pdf_trio persist fixes from prod
Bryan Newbold
2020-02-19
1
-4
/
+4
*
include rel and oa_status in ingest request 'extra'
Bryan Newbold
2020-02-18
1
-1
/
+1
*
pdftrio basic python code
Bryan Newbold
2020-02-12
1
-0
/
+57
*
fix bug where ingest_request extra fields not persisted
Bryan Newbold
2020-02-05
1
-1
/
+2
*
persist grobid: actually, status_code is required
Bryan Newbold
2020-01-21
1
-1
/
+1
*
persist: work around GROBID timeouts with no status_code
Bryan Newbold
2020-01-21
1
-1
/
+1
*
persist: fix dupe field copying
Bryan Newbold
2020-01-15
1
-1
/
+8
*
persist worker: implement updated ingest result semantics
Bryan Newbold
2020-01-15
1
-1
/
+1
*
small fixups to SandcrawlerPostgrestClient
Bryan Newbold
2020-01-14
1
-1
/
+10
*
db: move duplicate row filtering into DB insert helpers
Bryan Newbold
2020-01-02
1
-0
/
+25
*
fix DB import counting
Bryan Newbold
2020-01-02
1
-4
/
+5
*
fix small errors found by pylint
Bryan Newbold
2020-01-02
1
-1
/
+1
*
db: fancy insert/update separation using postgres xmax
Bryan Newbold
2020-01-02
1
-15
/
+30
*
improve DB helpers
Bryan Newbold
2020-01-02
1
-26
/
+81
*
start work on DB connector and minio client
Bryan Newbold
2020-01-02
1
-0
/
+141