2019-11-29 22:17:47 -07:00
# Introduction
This project provides Docker images to periodically backup a PostgreSQL database to AWS S3, and to restore from the backup as needed.
2019-11-27 17:05:27 -07:00
2019-11-27 21:24:31 -07:00
# Credit where due
This repository is a fork and re-structuring of schickling's [postgres-backup-s3 ](https://github.com/schickling/dockerfiles/tree/master/postgres-backup-s3 ) and [postgres-restore-s3 ](https://github.com/schickling/dockerfiles/tree/master/postgres-restore-s3 ).
2019-11-27 17:05:27 -07:00
2019-12-01 18:47:18 -07:00
fork goals:
2019-11-27 17:05:27 -07:00
- [x] dedicated repository
- [x] automated builds
- [x] support multiple PostgreSQL versions
2019-12-01 20:02:12 -07:00
- [x] merge backup and restore images
2019-11-29 22:17:47 -07:00
- [x] support encrypted (password-protected) backups
- [x] option to restore from specific backup by timestamp
2019-12-01 18:47:18 -07:00
other changes:
2019-11-29 22:17:47 -07:00
- uses `pg_dump` 's `custom` format (see [docs ](https://www.postgresql.org/docs/10/app-pgdump.html ))
- backup blobs and all schemas by default
- recreate all database objects on restore
- some env vars renamed
- only scheduled backups supported, not ad-hoc
2019-12-01 20:02:12 -07:00
- filter backups on S3 by database name
2019-11-27 20:57:21 -07:00
# Usage
## Backup
```yaml
postgres:
2019-11-29 22:17:47 -07:00
image: postgres:11
2019-11-27 20:57:21 -07:00
environment:
POSTGRES_USER: user
POSTGRES_PASSWORD: password
2019-12-01 18:47:18 -07:00
pg_backup_s3:
2019-11-29 22:17:47 -07:00
image: eeshugerman/postgres-backup-s3:11
2019-11-27 20:57:21 -07:00
environment:
2019-12-01 20:09:47 -07:00
SCHEDULE: '@weekly '
2019-11-29 22:17:47 -07:00
PASSPHRASE: passphrase
2019-11-27 20:57:21 -07:00
S3_REGION: region
S3_ACCESS_KEY_ID: key
S3_SECRET_ACCESS_KEY: secret
S3_BUCKET: my-bucket
S3_PREFIX: backup
POSTGRES_DATABASE: dbname
POSTGRES_USER: user
POSTGRES_PASSWORD: password
```
2019-12-01 18:47:18 -07:00
- Images are tagged by the major PostgreSQL version they support: `9` , `10` , `11` , or `12` .
- The `SCHEDULE` variable determines backup frequency. See go-cron schedules documentation [here ](http://godoc.org/github.com/robfig/cron#hdr-Predefined_schedules ).
- If `PASSPHRASE` is provided, the backup will be encrypted using GPG.
2019-11-27 20:57:21 -07:00
## Restore
2019-12-01 20:02:12 -07:00
> **WARNING:** DATA LOSS! All database objects will be dropped and re-created.
2019-11-29 22:17:47 -07:00
2019-12-01 18:47:18 -07:00
### ... from latest backup
2019-11-27 20:57:21 -07:00
```sh
docker exec < container name > sh restore.sh
```
2019-12-01 20:02:12 -07:00
> **NOTE:** If your bucket has more than a 1000 files, the latest may not be restored -- only one S3 `ls` command is used
2019-11-29 22:17:47 -07:00
2019-12-01 18:47:18 -07:00
### ... from specific backup
2019-11-29 22:17:47 -07:00
```sh
docker exec < container name > sh restore.sh < timestamp >
```