fatcat/rust/migrations, branch x-attic-cockroach [no description] https://git.bnewbold.net/fatcat/atom?h=x-attic-cockroach 2018-09-11T02:37:36+00:00 Merge branch 'master' into cockroach 2018-09-11T02:37:36+00:00 Bryan Newbold bnewbold@robocracy.org 2018-09-11T02:37:36+00:00 urn:sha1:dd0dbc45a0c0aad0819203431d374cbd93cce58f Manually resolve conflicts in: rust/migrations/2018-05-12-001226_init/up.sql remove 'IS NOT NULL' identifier index constraints 2018-09-10T23:46:52+00:00 Bryan Newbold bnewbold@robocracy.org 2018-09-10T23:46:49+00:00 urn:sha1:2e335344e59de0ff42f1c2797a4e4ffbf3f4b30b These seemed to be resulting in table scans on 404s in QA with postgres 10, despite the adding "IS NOT NULL" WHERE clauses earlier. Query time was very significant, even for the creator table (1.2 seconds or so on SSD). I looked at using hash indices (which have improved in postgres 10), which could save index size (disk and RAM) and potentially be faster for these trivial exact lookups, but didn't go for it at this time. changelog ID as a sequence 2018-09-09T20:51:56+00:00 Bryan Newbold bnewbold@robocracy.org 2018-09-09T20:51:54+00:00 urn:sha1:2732c2e3ba50f28c4c8a3b244783bc70d04806fa As noted elsewhere, auto-increment sequences in postgres, mysql, and cockroach can have gaps: when transactions that increment a number are rolled back, a "gap" is left. I didn't realize this, and it's problematic for the external changelog API. I'll need to re-write the changelog inserter to query for the current highest number when inserting, which is unfortunate and might slow down bulk imports. Merge branch 'http-verbs' into cockroach 2018-09-09T17:10:42+00:00 Bryan Newbold bnewbold@robocracy.org 2018-09-09T17:10:42+00:00 urn:sha1:b15eff77fdb7974ce2bf3c2e44c8edc354f9f452 Manually merged conflicts: rust/migrations/2018-05-12-001226_init/up.sql rust/src/api_server.rs rust/src/database_schema.rs use index_val, not index, in SQL schema 2018-08-20T08:18:10+00:00 Bryan Newbold bnewbold@robocracy.org 2018-08-20T08:18:10+00:00 urn:sha1:b8ca8ebdae304dcc2a694e5dfbc9070003f0df8a add index on release_rev_abstract SHA1 column 2018-08-20T01:27:48+00:00 Bryan Newbold bnewbold@robocracy.org 2018-08-20T01:27:48+00:00 urn:sha1:42fa2a4d01d31922de2a61881860840f2bfa80f5 add index on file_rev_url file_rev 2018-08-19T23:45:51+00:00 Bryan Newbold bnewbold@robocracy.org 2018-08-19T23:45:51+00:00 urn:sha1:bed06d8726a063e177ccd8a40554a799e0fdb1f1 create index on release_rev_abstracts 2018-08-18T08:16:14+00:00 Bryan Newbold bnewbold@robocracy.org 2018-08-18T08:16:14+00:00 urn:sha1:21fd7bd5d15850da942991bcdb7c00c3332231cc cockroach: catch remaining JSONB stuff 2018-08-17T22:08:25+00:00 Bryan Newbold bnewbold@robocracy.org 2018-08-17T22:08:25+00:00 urn:sha1:8faacb2dcfc17b052f8020aeffc675f2db0f24cc cockroach: try JSONB over JSON 2018-08-15T04:19:28+00:00 Bryan Newbold bnewbold@robocracy.org 2018-08-15T04:16:23+00:00 urn:sha1:8136c7bdfb3f96b506001a083b4b92ebd15e083a