aboutsummaryrefslogtreecommitdiffstats
path: root/python/sandcrawler/html_ingest.py
Commit message (Expand)AuthorAgeFilesLines
* html: syntax fixes; resolve relative URLs; extract more XML fulltext URLsBryan Newbold2020-10-301-3/+3
* html: work around firstmonday DOCTYPE issueBryan Newbold2020-10-301-0/+3
* html: more ingest improvementsBryan Newbold2020-10-301-18/+118
* html ingest: improve data flowBryan Newbold2020-10-291-18/+41
* better default CLI output (show usage)Bryan Newbold2020-10-291-1/+1
* html: initial ingest implementationBryan Newbold2020-10-291-0/+193