diff options
| author | Bryan Newbold <bnewbold@robocracy.org> | 2018-08-24 13:37:43 -0700 |
|---|---|---|
| committer | Bryan Newbold <bnewbold@robocracy.org> | 2018-08-24 13:37:43 -0700 |
| commit | ca00cb327cb066c85a0f11a947b4497655ddf0de (patch) | |
| tree | f91688de5c26d63b0382aa0203b9c6d18d961981 | |
| parent | 7cc6337d57063ca17bde2ff36445df480773325e (diff) | |
| download | fatcat-ca00cb327cb066c85a0f11a947b4497655ddf0de.tar.gz fatcat-ca00cb327cb066c85a0f11a947b4497655ddf0de.zip | |
database dump notes
| -rw-r--r-- | notes/database_dumps_backups.txt | 22 |
1 files changed, 22 insertions, 0 deletions
diff --git a/notes/database_dumps_backups.txt b/notes/database_dumps_backups.txt index 0b05b9b8..60d4bba0 100644 --- a/notes/database_dumps_backups.txt +++ b/notes/database_dumps_backups.txt @@ -23,9 +23,31 @@ There are a few different database dump formats folks might want: should be on a work or release basis; will go with release for now. Harder to do using public interface because of the need for transaction locking. +## Full Postgres Backup + Backing up the entire database using `pg_dump`, with parallelism 1 (use more on larger machine with fast disks; try 4 or 8?), assuming the database name is 'fatcat', and the current user has access: pg_dump -j1 -Fd -f test-dump fatcat +## Identifier Dumps + +The `extras/quick_dump.sql` script will dump abstracts and identifiers as TSV +files to `/tmp/`. Pretty quick; takes about 15 GB of disk space (uncompressed). + +## Releases Export + + # simple command + ./fatcat_export.py releases /tmp/fatcat_ident_releases.tsv /tmp/releases-dump.json + + # usual command + time ./fatcat_export.py releases /tmp/fatcat_ident_releases.tsv - | pv -l | wc + +## Changelog Export + + # simple command + ./fatcat_export.py changelog /tmp/changelog-dump.json + + # usual command + time ./fatcat_export.py changelog - | pv -l | wc |