Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Merge branch 'master' into cockroachx-attic-cockroachcockroach | Bryan Newbold | 2018-09-10 | 22 | -555/+634 |
|\ | | | | | | | | | Manually resolve conflicts in: rust/migrations/2018-05-12-001226_init/up.sql | ||||
| * | add import timing notes from weekend | Bryan Newbold | 2018-09-10 | 1 | -0/+249 |
| | | |||||
| * | update TODO | Bryan Newbold | 2018-09-10 | 1 | -8/+2 |
| | | |||||
| * | many small API cleanups | Bryan Newbold | 2018-09-10 | 5 | -193/+148 |
| | | | | | | | | | | | | - use FatCatId much more often (though not everywhere yet) - more consistent types - remove redundant error handling code in wrappers | ||||
| * | re-gen rust code | Bryan Newbold | 2018-09-10 | 7 | -61/+133 |
| | | |||||
| * | make API types more consistent | Bryan Newbold | 2018-09-10 | 1 | -6/+14 |
| | | |||||
| * | continue CRUD refactor, removing CUD handlers | Bryan Newbold | 2018-09-10 | 4 | -276/+60 |
| | | | | | | | | | | | | | | | | Can't remove the "get" handlers because of the expand parameter, which is only implemented for releases and in the handler (not in the CRUD trait, yet). Also didn't do the batch handler stuff yet. | ||||
| * | squelch unused macro warning | Bryan Newbold | 2018-09-10 | 1 | -0/+2 |
| | | |||||
| * | database_entity_crud -> api_entity_crud | Bryan Newbold | 2018-09-10 | 5 | -5/+5 |
| | | |||||
| * | fix python import of ORCIDs ending 'X' | Bryan Newbold | 2018-09-10 | 4 | -1/+9 |
| | | |||||
| * | TODO update | Bryan Newbold | 2018-09-10 | 1 | -0/+7 |
| | | |||||
| * | remove 'IS NOT NULL' identifier index constraints | Bryan Newbold | 2018-09-10 | 1 | -14/+14 |
| | | | | | | | | | | | | | | | | | | | | | | These seemed to be resulting in table scans on 404s in QA with postgres 10, despite the adding "IS NOT NULL" WHERE clauses earlier. Query time was very significant, even for the creator table (1.2 seconds or so on SSD). I looked at using hash indices (which have improved in postgres 10), which could save index size (disk and RAM) and potentially be faster for these trivial exact lookups, but didn't go for it at this time. | ||||
* | | add some notes from cockroach tuning | Bryan Newbold | 2018-09-10 | 1 | -0/+96 |
| | | |||||
* | | switch entity acceptance for cockroach branch | Bryan Newbold | 2018-09-09 | 1 | -10/+10 |
| | | |||||
* | | test: contribs should work without wiping database | Bryan Newbold | 2018-09-09 | 1 | -1/+1 |
| | | | | | | | | | | | | This removes an entanglement between tests that was breaking on the cockroachdb branch (where the database isn't reset between each individual test). | ||||
* | | changelog ID as a sequence | Bryan Newbold | 2018-09-09 | 2 | -1/+5 |
| | | | | | | | | | | | | | | | | | | | | | | As noted elsewhere, auto-increment sequences in postgres, mysql, and cockroach can have gaps: when transactions that increment a number are rolled back, a "gap" is left. I didn't realize this, and it's problematic for the external changelog API. I'll need to re-write the changelog inserter to query for the current highest number when inserting, which is unfortunate and might slow down bulk imports. | ||||
* | | Merge branch 'http-verbs' into cockroach | Bryan Newbold | 2018-09-09 | 3 | -50/+159 |
|\| | |||||
| * | generic edit accept, and per-row variant | Bryan Newbold | 2018-09-09 | 2 | -44/+158 |
| | | | | | | | | The per-row variant is for use with cockroach. | ||||
| * | api_server: give up and use star schema import | Bryan Newbold | 2018-09-09 | 1 | -6/+1 |
| | | |||||
* | | Merge branch 'http-verbs' into cockroach | Bryan Newbold | 2018-09-09 | 48 | -896/+7243 |
|\| | | | | | | | | | | | | | | | Manually merged conflicts: rust/migrations/2018-05-12-001226_init/up.sql rust/src/api_server.rs rust/src/database_schema.rs | ||||
| * | update TODO | Bryan Newbold | 2018-09-09 | 1 | -9/+11 |
| | | |||||
| * | parallelize abstracts insertion | Bryan Newbold | 2018-09-09 | 1 | -15/+20 |
| | | |||||
| * | TODO and comment | Bryan Newbold | 2018-09-07 | 5 | -1/+1102 |
| | | |||||
| * | fixes after autoaccept merge | Bryan Newbold | 2018-09-07 | 4 | -49/+41 |
| | | |||||
| * | re-codegen | Bryan Newbold | 2018-09-07 | 1 | -1/+11 |
| | | |||||
| * | fmt | Bryan Newbold | 2018-09-07 | 5 | -207/+364 |
| | | |||||
| * | Merge branch 'autoaccept' into http-verbs | Bryan Newbold | 2018-09-07 | 20 | -75/+628 |
| |\ | | | | | | | | | | | | | | | | | | | | | | | | | Started resolving conflicts in: TODO notes/cloud_instances.txt rust/fatcat-api/README.md rust/src/api_server.rs | ||||
| | * | autoaccept notes | Bryan Newbold | 2018-08-30 | 1 | -0/+31 |
| | | | |||||
| | * | "true" is the only truthy value (oh no) | Bryan Newbold | 2018-08-30 | 3 | -3/+3 |
| | | | |||||
| | * | importers: create editgroup and pass | Bryan Newbold | 2018-08-30 | 5 | -9/+31 |
| | | | |||||
| | * | editgroup IDs are fcid, not uuid | Bryan Newbold | 2018-08-30 | 1 | -1/+1 |
| | | | |||||
| | * | minimal autoaccept tests | Bryan Newbold | 2018-08-30 | 1 | -0/+41 |
| | | | |||||
| | * | editgroup parameter for batch inserts | Bryan Newbold | 2018-08-30 | 2 | -6/+21 |
| | | | |||||
| | * | WIP: autoaccept | Bryan Newbold | 2018-08-24 | 11 | -64/+269 |
| | | | |||||
| | * | cost notes on hosting a fatcat mirror | Bryan Newbold | 2018-08-20 | 1 | -0/+8 |
| | | | |||||
| | * | notes on recent bulk import | Bryan Newbold | 2018-08-20 | 1 | -0/+292 |
| | | | |||||
| | * | codegen python | Bryan Newbold | 2018-08-20 | 1 | -5/+25 |
| | | | |||||
| | * | fix bug in new batch create python importer | Bryan Newbold | 2018-08-20 | 1 | -1/+1 |
| | | | |||||
| | * | python autoaccept implementation | Bryan Newbold | 2018-08-20 | 4 | -6/+3 |
| | | | | | | | | | | | | | | | | | | More to review: - duplicate containers getting created in batch mode? eg, if multiple releases with same container. should push+autoaccept those anyways? | ||||
| | * | implement autoaccept | Bryan Newbold | 2018-08-20 | 2 | -20/+46 |
| | | | | | | | | | | | | | | | | | | Need to review: - changelog creation - clobbering of existing editgroup flag | ||||
| | * | codegen | Bryan Newbold | 2018-08-20 | 8 | -51/+223 |
| | | | |||||
| | * | autoaccept flag for batch inserts | Bryan Newbold | 2018-08-20 | 1 | -0/+29 |
| | | | |||||
| * | | fix/replace a lot of expect() calls | Bryan Newbold | 2018-09-07 | 3 | -47/+48 |
| | | | |||||
| * | | mostly done with CRUD refactor | Bryan Newbold | 2018-09-07 | 3 | -625/+745 |
| | | | | | | | | | | | | One failing test in this commit. | ||||
| * | | batch inserts by default | Bryan Newbold | 2018-09-07 | 3 | -27/+95 |
| | | | |||||
| * | | generic create (multiple inserts) | Bryan Newbold | 2018-09-07 | 1 | -26/+24 |
| | | | | | | | | | | | | | | | | | | | | | This does away entirely with the fancy CTE-based custom SQL inserts. Because performance is currently only important for batch inserts, I think this is acceptable, and will refactor to do batch inserts as actual batch SQL operations next. | ||||
| * | | crud: refactor to split out rev insert | Bryan Newbold | 2018-09-07 | 1 | -43/+51 |
| | | | |||||
| * | | major CRUD refactor | Bryan Newbold | 2018-09-07 | 5 | -85/+336 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This is the start of a large refactor to move all entity CRUD (create, read, update, delete) model/database code into it's own file. HACKING has been updated with an overview of what happens in each file. Next steps: - split rev (and sub-table) insertion in to db_rev_insert and make create/update generic - inserts should be batch (vector) by default - move all other entities into this new trait framework - bypass api_server wrappers and call into CRUD from api_wrappers for entity ops (should be a big cleanup) | ||||
| * | | update TODO | Bryan Newbold | 2018-09-06 | 1 | -0/+7 |
| | | | |||||
| * | | skeleton create/delete endpoints for works | Bryan Newbold | 2018-09-06 | 3 | -2/+293 |
| | | | | | | | | | | | | Other entities just stubs |