Commit message (Expand) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
* | pylint as part of pytest; update lint config | Bryan Newbold | 2019-09-25 | 2 | -1/+17 | |
* | pipfile update | Bryan Newbold | 2019-09-25 | 2 | -241/+70 | |
* | test of GROBID client | Bryan Newbold | 2019-09-25 | 1 | -0/+53 | |
* | move a bunch of random old scripts to subdir | Bryan Newbold | 2019-09-25 | 9 | -0/+0 | |
* | get rid of old xml2json | Bryan Newbold | 2019-09-25 | 1 | -7/+0 | |
* | update README with new folders | Bryan Newbold | 2019-09-25 | 1 | -4/+10 | |
* | point 'please' to python_hadoop | Bryan Newbold | 2019-09-25 | 1 | -4/+4 | |
* | refactor old python hadoop code into new directory | Bryan Newbold | 2019-09-25 | 21 | -0/+3523 | |
* | re-write parse_cdx_line for sandcrawler lib | Bryan Newbold | 2019-09-25 | 3 | -2/+116 | |
* | fix test grobid2json test | Bryan Newbold | 2019-09-25 | 1 | -1/+4 | |
* | commit WIP on file ingest script | Bryan Newbold | 2019-09-23 | 1 | -0/+386 | |
* | rename postgrest directory sql | Bryan Newbold | 2019-09-23 | 9 | -0/+0 | |
* | start refactoring sandcrawler python common code | Bryan Newbold | 2019-09-23 | 5 | -0/+131 | |
* | update Pipfile with additional libraries | Bryan Newbold | 2019-09-23 | 2 | -77/+293 | |
* | more matching examples | Bryan Newbold | 2019-09-20 | 1 | -0/+4 | |
* | unpaywall blobs.fatcat.wiki backfill notes | Bryan Newbold | 2019-09-20 | 1 | -0/+59 | |
* | grobid2json: extract fatcat identifier | Bryan Newbold | 2019-09-20 | 1 | -1/+5 | |
* | fatcat-blobs nginx config example | Bryan Newbold | 2019-09-20 | 1 | -0/+51 | |
* | old groupworks job log | Bryan Newbold | 2019-09-20 | 1 | -0/+8 | |
* | update service docs | Bryan Newbold | 2019-09-20 | 3 | -1/+16 | |
* | add filter_groupworks.py | Bryan Newbold | 2019-09-04 | 1 | -0/+144 | |
* | large pipfile update | Bryan Newbold | 2019-09-04 | 1 | -375/+402 | |
* | GroupFatcatWorksSubsetJob | Bryan Newbold | 2019-08-26 | 3 | -0/+111 | |
* | update shadow sandcrawler schema | Bryan Newbold | 2019-08-26 | 1 | -3/+4 | |
* | please command for groupworksfatcat | Bryan Newbold | 2019-08-10 | 2 | -1/+64 | |
* | FatcatScorable and ScoreSelfFatcat job | Bryan Newbold | 2019-08-10 | 3 | -0/+334 | |
* | add fatcat ident fields in prep for self-scoring job | Bryan Newbold | 2019-08-10 | 2 | -3/+24 | |
* | postgrest backfill updates | Bryan Newbold | 2019-08-10 | 1 | -1/+19 | |
* | sandcrawler HTTP nginx configs | Bryan Newbold | 2019-08-09 | 3 | -0/+153 | |
* | move postgres/rest directory | Bryan Newbold | 2019-08-09 | 8 | -0/+0 | |
* | SQL backfill notes and python scripts | Bryan Newbold | 2019-08-09 | 6 | -0/+506 | |
* | more tweaks to sql schema | Bryan Newbold | 2019-08-09 | 1 | -1/+2 | |
* | sandcrawler SQL schema more idempotent-ish | Bryan Newbold | 2019-08-08 | 1 | -8/+8 | |
* | minio README | Bryan Newbold | 2019-08-08 | 1 | -0/+24 | |
* | update sandcrawler_schema.sql | Bryan Newbold | 2019-08-08 | 1 | -7/+7 | |
* | start of postgres/postgrest notes and schema | Bryan Newbold | 2019-08-01 | 2 | -0/+177 | |
* | more kafka topics | Bryan Newbold | 2019-07-07 | 1 | -0/+9 | |
* | ia_pdf_match.py bugfix | Bryan Newbold | 2019-07-07 | 1 | -4/+4 | |
* | please: add staging config (commented out) | Bryan Newbold | 2019-07-07 | 1 | -0/+4 | |
* | create deliver_gwb_to_disk.py | Bryan Newbold | 2019-07-07 | 1 | -0/+166 | |
* | petabox journal files ingest updates | Bryan Newbold | 2019-06-20 | 2 | -0/+133 | |
* | new release schema kafka topic | Bryan Newbold | 2019-05-24 | 1 | -2/+3 | |
* | Merge remote-tracking branch 'github/master' | Bryan Newbold | 2019-05-13 | 0 | -0/+0 | |
|\ | ||||||
| * | more fatcat update topics | Bryan Newbold | 2019-03-04 | 1 | -0/+3 | |
* | | update grobid2json to include given_name/surname | Bryan Newbold | 2019-05-13 | 2 | -6/+10 | |
* | | deliver_dumpgrobid_to_s3: allow heritrix-style SHA-1 format | Bryan Newbold | 2019-05-10 | 1 | -0/+12 | |
* | | clearer CDX munge notes | Bryan Newbold | 2019-05-09 | 1 | -1/+1 | |
* | | deliver_dumpgrobid_to_s3: storage class config | Bryan Newbold | 2019-05-09 | 1 | -1/+7 | |
* | | deliver_dumpgrobid_to_s3.py | Bryan Newbold | 2019-04-15 | 1 | -0/+106 | |
* | | schema notes on deeper file metadata | Bryan Newbold | 2019-04-12 | 1 | -0/+8 |