sandcrawler/proposals, branch bnewbold-refactor-loggging [no description] https://git.bnewbold.net/sandcrawler/atom?h=bnewbold-refactor-loggging 2022-01-28T01:55:40+00:00 'trawling' proposal (in progress) 2022-01-28T01:55:40+00:00 Bryan Newbold bnewbold@archive.org 2022-01-28T01:55:40+00:00 urn:sha1:6b59e1f4f08662ac9e6c3adb731af31e42f894a6 codespell fixes in proposals 2021-11-25T00:01:51+00:00 Bryan Newbold bnewbold@archive.org 2021-11-25T00:01:47+00:00 urn:sha1:d93d542adf9d26633b0f3cfa361277ca677c46f3 sql: grobid_refs table JSON as 'JSON' not 'JSONB' 2021-11-05T00:19:52+00:00 Bryan Newbold bnewbold@archive.org 2021-11-02T03:05:16+00:00 urn:sha1:4315b44a93ca31725b9b0a2a55c310725ac55efe I keep flip-flopping on this, but our disk usage is really large, and if 'JSON' is smaller than 'JSONB' in postgresql at all it is worth it. update grobid refs proposal 2021-11-05T00:19:52+00:00 Bryan Newbold bnewbold@archive.org 2021-10-30T01:36:03+00:00 urn:sha1:16f4b7f45ae8bdcd4018850efe164ed19069e9fe initial proposal for GROBID refs table and pipeline 2021-11-05T00:19:52+00:00 Bryan Newbold bnewbold@archive.org 2021-10-29T19:16:22+00:00 urn:sha1:5267f3c778b1bc70830be7f3a45fda52c23477bd sql: fixes to ingest_fileset_platform schema (from table creation) 2021-11-02T03:08:11+00:00 Bryan Newbold bnewbold@archive.org 2021-11-02T03:08:11+00:00 urn:sha1:58acf442af343b4b74f2e206cea1e95145dce744 commit SPN account changes 2021-10-16T01:17:32+00:00 Bryan Newbold bnewbold@archive.org 2021-10-16T01:17:32+00:00 urn:sha1:12d041b781912dc376444198c920ade2d6cee7c8 persist support for ingest platform table, using existing persist worker 2021-10-16T01:15:29+00:00 Bryan Newbold bnewbold@archive.org 2021-10-16T01:04:39+00:00 urn:sha1:bb06c833f500fbd37579ffb4aa1c53dc0d1e9c96 document passing back platform_base_url 2021-10-16T01:15:29+00:00 Bryan Newbold bnewbold@archive.org 2021-10-16T00:14:28+00:00 urn:sha1:0a6e449317278e95c3c706aaee19ffb9dc00bebc filesets: iteration of implementation and docs 2021-10-16T01:15:29+00:00 Bryan Newbold bnewbold@archive.org 2021-10-15T20:17:23+00:00 urn:sha1:6cccac03451f46cb59897871e6631debca558771