| Commit message (Expand) | Author | Age | Files | Lines |
* | fileset ingest: fix table name typo (via mypy) | Bryan Newbold | 2021-10-26 | 1 | -1/+1 |
* | update 'XXX' notes from fileset ingest development | Bryan Newbold | 2021-10-26 | 2 | -9/+6 |
* | bugfix: setting html_biblio on ingest results | Bryan Newbold | 2021-10-26 | 2 | -2/+2 |
* | lint collection membership (last lint for now) | Bryan Newbold | 2021-10-26 | 7 | -32/+32 |
* | commit updated flake8 lint configuration | Bryan Newbold | 2021-10-26 | 1 | -6/+10 |
* | ingest fileset: fix silly import typo | Bryan Newbold | 2021-10-26 | 1 | -1/+1 |
* | type annotations for persist workers; required some work | Bryan Newbold | 2021-10-26 | 1 | -66/+59 |
* | ingest file HTTP API: fixes from type checking | Bryan Newbold | 2021-10-26 | 1 | -3/+3 |
* | more progress on type annotations | Bryan Newbold | 2021-10-26 | 8 | -34/+55 |
* | grobid: fix a bug with consolidate_mode header, exposed by type annotations | Bryan Newbold | 2021-10-26 | 1 | -1/+2 |
* | grobid: type annotations | Bryan Newbold | 2021-10-26 | 1 | -9/+19 |
* | type annotations on SandcrawlerWorker | Bryan Newbold | 2021-10-26 | 1 | -46/+57 |
* | more progress on type annotations and linting | Bryan Newbold | 2021-10-26 | 11 | -55/+87 |
* | live tests: FTP wayback replay now returns 200, not 226 | Bryan Newbold | 2021-10-26 | 1 | -2/+2 |
* | ia: more tweaks to delicate code to satisfy type checker | Bryan Newbold | 2021-10-26 | 1 | -10/+12 |
* | ia helpers: enforce max_redirects count correctly | Bryan Newbold | 2021-10-26 | 1 | -1/+1 |
* | set CDX request params are str, not int or datetime | Bryan Newbold | 2021-10-26 | 1 | -3/+6 |
* | bugfix: was setting 'from' parameter as a tuple, not a string | Bryan Newbold | 2021-10-26 | 1 | -1/+1 |
* | start type annotating IA helper code | Bryan Newbold | 2021-10-26 | 1 | -37/+65 |
* | start adding python type annotations to db and persist code | Bryan Newbold | 2021-10-26 | 2 | -97/+124 |
* | Makefile: don't fail on isort error (consider these minor) | Bryan Newbold | 2021-10-26 | 1 | -1/+1 |
* | tweak flake8 config | Bryan Newbold | 2021-10-26 | 1 | -2/+11 |
* | flake8 clean (with current settings) | Bryan Newbold | 2021-10-26 | 9 | -25/+24 |
* | pipenv: import type annotations for requests and dateparser | Bryan Newbold | 2021-10-26 | 2 | -1/+19 |
* | start handling trivial lint cleanups: unused imports, 'is None', etc | Bryan Newbold | 2021-10-26 | 30 | -149/+86 |
* | make fmt | Bryan Newbold | 2021-10-26 | 59 | -1225/+1582 |
* | tweak lint/fmt settings | Bryan Newbold | 2021-10-26 | 2 | -4/+6 |
* | update pytest warning filters (they are pretty expansive) | Bryan Newbold | 2021-10-26 | 1 | -0/+3 |
* | ingest_html: update trafilatura TEI-XML output kwarg | Bryan Newbold | 2021-10-26 | 1 | -1/+1 |
* | python: isort all imports | Bryan Newbold | 2021-10-26 | 57 | -178/+207 |
* | add pyproject.toml (for isort and yapf config), and update 'lint' and 'fmt' m... | Bryan Newbold | 2021-10-26 | 2 | -3/+13 |
* | pipenv: general update; add isort, yapf (over black), grobid_tei_xml | Bryan Newbold | 2021-10-26 | 2 | -730/+880 |
* | kafka monitoring commands | Bryan Newbold | 2021-10-26 | 1 | -0/+4 |
* | more small fileset ingest tweaks | Bryan Newbold | 2021-10-26 | 2 | -6/+21 |
* | commit SPN account changes | Bryan Newbold | 2021-10-15 | 1 | -0/+14 |
* | commit old ingest domain summary | Bryan Newbold | 2021-10-15 | 1 | -0/+345 |
* | python: more aggressive gitignore | Bryan Newbold | 2021-10-15 | 1 | -0/+3 |
* | persist support for ingest platform table, using existing persist worker | Bryan Newbold | 2021-10-15 | 3 | -4/+131 |
* | sql fileset ingest table iteration | Bryan Newbold | 2021-10-15 | 1 | -12/+11 |
* | document passing back platform_base_url | Bryan Newbold | 2021-10-15 | 1 | -0/+1 |
* | improve fileset ingest integration with file ingest | Bryan Newbold | 2021-10-15 | 4 | -5/+25 |
* | more fileset iteration | Bryan Newbold | 2021-10-15 | 5 | -45/+81 |
* | move SPNv2 'simple_get' logic to SPN client | Bryan Newbold | 2021-10-15 | 3 | -52/+31 |
* | filesets: iteration of implementation and docs | Bryan Newbold | 2021-10-15 | 5 | -96/+167 |
* | updates to fileset ingest proposal | Bryan Newbold | 2021-10-15 | 2 | -239/+337 |
* | fileset ingest notes | Bryan Newbold | 2021-10-15 | 1 | -3/+23 |
* | fileset ingest: improve platform parsing | Bryan Newbold | 2021-10-15 | 1 | -12/+196 |
* | fileset ingest: improve error handling | Bryan Newbold | 2021-10-15 | 4 | -48/+106 |
* | initial implementation of zenodo platform import | Bryan Newbold | 2021-10-15 | 1 | -0/+100 |
* | initial figshare platform helper | Bryan Newbold | 2021-10-15 | 1 | -0/+95 |