index
:
sandcrawler
bnewbold-args
bnewbold-backfill
bnewbold-persist-grobid-errors
bnewbold-refactor-loggging
master
trawler
[no description]
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
Commit message (
Expand
)
Author
Age
Files
Lines
*
grobid_affiliations fix from prod, and usage example
Bryan Newbold
2019-10-02
1
-0
/
+5
*
deliver_dumpgrobid_to_s3: typo fix from old prod
Bryan Newbold
2019-10-02
1
-3
/
+4
*
grobid affiliation extractor (script)
Bryan Newbold
2019-10-02
1
-0
/
+47
*
python tests for pusher classes
Bryan Newbold
2019-10-02
2
-0
/
+28
*
have grobidworker error status indicate issues instead of bailing
Bryan Newbold
2019-10-02
1
-4
/
+13
*
grobid_tool.py example usage in docstring
Bryan Newbold
2019-10-02
1
-0
/
+6
*
add tests for affiliation extraction
Bryan Newbold
2019-10-02
2
-1
/
+25
*
have grobid2json extract full names and affiliations
Bryan Newbold
2019-10-02
1
-5
/
+27
*
more counts and bugfixes in grobid_tool
Bryan Newbold
2019-09-26
3
-5
/
+7
*
off-by-one error in batch sizes
Bryan Newbold
2019-09-26
1
-1
/
+1
*
small improvements to GROBID tool
Bryan Newbold
2019-09-26
2
-2
/
+10
*
lots of grobid tool implementation (still WIP)
Bryan Newbold
2019-09-26
8
-16
/
+748
*
gitlab CI: run both python and python_hadoop tests
Bryan Newbold
2019-09-25
1
-1
/
+6
*
pylint as part of pytest; update lint config
Bryan Newbold
2019-09-25
2
-1
/
+17
*
pipfile update
Bryan Newbold
2019-09-25
2
-241
/
+70
*
test of GROBID client
Bryan Newbold
2019-09-25
1
-0
/
+53
*
move a bunch of random old scripts to subdir
Bryan Newbold
2019-09-25
9
-0
/
+0
*
get rid of old xml2json
Bryan Newbold
2019-09-25
1
-7
/
+0
*
update README with new folders
Bryan Newbold
2019-09-25
1
-4
/
+10
*
point 'please' to python_hadoop
Bryan Newbold
2019-09-25
1
-4
/
+4
*
refactor old python hadoop code into new directory
Bryan Newbold
2019-09-25
21
-0
/
+3523
*
re-write parse_cdx_line for sandcrawler lib
Bryan Newbold
2019-09-25
3
-2
/
+116
*
fix test grobid2json test
Bryan Newbold
2019-09-25
1
-1
/
+4
*
commit WIP on file ingest script
Bryan Newbold
2019-09-23
1
-0
/
+386
*
rename postgrest directory sql
Bryan Newbold
2019-09-23
9
-0
/
+0
*
start refactoring sandcrawler python common code
Bryan Newbold
2019-09-23
5
-0
/
+131
*
update Pipfile with additional libraries
Bryan Newbold
2019-09-23
2
-77
/
+293
*
more matching examples
Bryan Newbold
2019-09-20
1
-0
/
+4
*
unpaywall blobs.fatcat.wiki backfill notes
Bryan Newbold
2019-09-20
1
-0
/
+59
*
grobid2json: extract fatcat identifier
Bryan Newbold
2019-09-20
1
-1
/
+5
*
fatcat-blobs nginx config example
Bryan Newbold
2019-09-20
1
-0
/
+51
*
old groupworks job log
Bryan Newbold
2019-09-20
1
-0
/
+8
*
update service docs
Bryan Newbold
2019-09-20
3
-1
/
+16
*
add filter_groupworks.py
Bryan Newbold
2019-09-04
1
-0
/
+144
*
large pipfile update
Bryan Newbold
2019-09-04
1
-375
/
+402
*
GroupFatcatWorksSubsetJob
Bryan Newbold
2019-08-26
3
-0
/
+111
*
update shadow sandcrawler schema
Bryan Newbold
2019-08-26
1
-3
/
+4
*
please command for groupworksfatcat
Bryan Newbold
2019-08-10
2
-1
/
+64
*
FatcatScorable and ScoreSelfFatcat job
Bryan Newbold
2019-08-10
3
-0
/
+334
*
add fatcat ident fields in prep for self-scoring job
Bryan Newbold
2019-08-10
2
-3
/
+24
*
postgrest backfill updates
Bryan Newbold
2019-08-10
1
-1
/
+19
*
sandcrawler HTTP nginx configs
Bryan Newbold
2019-08-09
3
-0
/
+153
*
move postgres/rest directory
Bryan Newbold
2019-08-09
8
-0
/
+0
*
SQL backfill notes and python scripts
Bryan Newbold
2019-08-09
6
-0
/
+506
*
more tweaks to sql schema
Bryan Newbold
2019-08-09
1
-1
/
+2
*
sandcrawler SQL schema more idempotent-ish
Bryan Newbold
2019-08-08
1
-8
/
+8
*
minio README
Bryan Newbold
2019-08-08
1
-0
/
+24
*
update sandcrawler_schema.sql
Bryan Newbold
2019-08-08
1
-7
/
+7
*
start of postgres/postgrest notes and schema
Bryan Newbold
2019-08-01
2
-0
/
+177
*
more kafka topics
Bryan Newbold
2019-07-07
1
-0
/
+9
[next]