aboutsummaryrefslogtreecommitdiffstats
Commit message (Expand)AuthorAgeFilesLines
* lots of grobid tool implementation (still WIP)Bryan Newbold2019-09-268-16/+748
* gitlab CI: run both python and python_hadoop testsBryan Newbold2019-09-251-1/+6
* pylint as part of pytest; update lint configBryan Newbold2019-09-252-1/+17
* pipfile updateBryan Newbold2019-09-252-241/+70
* test of GROBID clientBryan Newbold2019-09-251-0/+53
* move a bunch of random old scripts to subdirBryan Newbold2019-09-259-0/+0
* get rid of old xml2jsonBryan Newbold2019-09-251-7/+0
* update README with new foldersBryan Newbold2019-09-251-4/+10
* point 'please' to python_hadoopBryan Newbold2019-09-251-4/+4
* refactor old python hadoop code into new directoryBryan Newbold2019-09-2521-0/+3523
* re-write parse_cdx_line for sandcrawler libBryan Newbold2019-09-253-2/+116
* fix test grobid2json testBryan Newbold2019-09-251-1/+4
* commit WIP on file ingest scriptBryan Newbold2019-09-231-0/+386
* rename postgrest directory sqlBryan Newbold2019-09-239-0/+0
* start refactoring sandcrawler python common codeBryan Newbold2019-09-235-0/+131
* update Pipfile with additional librariesBryan Newbold2019-09-232-77/+293
* more matching examplesBryan Newbold2019-09-201-0/+4
* unpaywall blobs.fatcat.wiki backfill notesBryan Newbold2019-09-201-0/+59
* grobid2json: extract fatcat identifierBryan Newbold2019-09-201-1/+5
* fatcat-blobs nginx config exampleBryan Newbold2019-09-201-0/+51
* old groupworks job logBryan Newbold2019-09-201-0/+8
* update service docsBryan Newbold2019-09-203-1/+16
* add filter_groupworks.pyBryan Newbold2019-09-041-0/+144
* large pipfile updateBryan Newbold2019-09-041-375/+402
* GroupFatcatWorksSubsetJobBryan Newbold2019-08-263-0/+111
* update shadow sandcrawler schemaBryan Newbold2019-08-261-3/+4
* please command for groupworksfatcatBryan Newbold2019-08-102-1/+64
* FatcatScorable and ScoreSelfFatcat jobBryan Newbold2019-08-103-0/+334
* add fatcat ident fields in prep for self-scoring jobBryan Newbold2019-08-102-3/+24
* postgrest backfill updatesBryan Newbold2019-08-101-1/+19
* sandcrawler HTTP nginx configsBryan Newbold2019-08-093-0/+153
* move postgres/rest directoryBryan Newbold2019-08-098-0/+0
* SQL backfill notes and python scriptsBryan Newbold2019-08-096-0/+506
* more tweaks to sql schemaBryan Newbold2019-08-091-1/+2
* sandcrawler SQL schema more idempotent-ishBryan Newbold2019-08-081-8/+8
* minio READMEBryan Newbold2019-08-081-0/+24
* update sandcrawler_schema.sqlBryan Newbold2019-08-081-7/+7
* start of postgres/postgrest notes and schemaBryan Newbold2019-08-012-0/+177
* more kafka topicsBryan Newbold2019-07-071-0/+9
* ia_pdf_match.py bugfixBryan Newbold2019-07-071-4/+4
* please: add staging config (commented out)Bryan Newbold2019-07-071-0/+4
* create deliver_gwb_to_disk.pyBryan Newbold2019-07-071-0/+166
* petabox journal files ingest updatesBryan Newbold2019-06-202-0/+133
* new release schema kafka topicBryan Newbold2019-05-241-2/+3
* Merge remote-tracking branch 'github/master'Bryan Newbold2019-05-130-0/+0
|\
| * more fatcat update topicsBryan Newbold2019-03-041-0/+3
* | update grobid2json to include given_name/surnameBryan Newbold2019-05-132-6/+10
* | deliver_dumpgrobid_to_s3: allow heritrix-style SHA-1 formatBryan Newbold2019-05-101-0/+12
* | clearer CDX munge notesBryan Newbold2019-05-091-1/+1
* | deliver_dumpgrobid_to_s3: storage class configBryan Newbold2019-05-091-1/+7
generated by cgit v1.2.3 (git 2.39.1) at 2024-11-22 18:40:38 +0000