Disaster recovery runbook¶
Targets¶
| Metric | Default |
|---|---|
| RTO | 4 hours |
| RPO | 1 hour |
Failover steps¶
- Confirm outage via
/health/readyand Prometheus alerts. - Restore PostgreSQL from latest
pg_dump(hourly) or managed PITR. - Restore file storage from full backup or S3 sync.
- Rotate
SECRET_KEYand encryption keys if compromise suspected. - Redeploy
./deploy.sh productionon standby host or K8s cluster. - Verify smoke tests and notify tenants.
Cross-region backup¶
Enable BACKUP_S3_ENABLED=true and replicate bucket to secondary region.
Document bucket name and restore credentials in ops vault.
Contacts¶
Platform on-call and security lead — update for production.