• Learn how your database works • Implement new features (or pay someone to do it) • Fix bugs and test fixes without waiting for new release • No license costs, no price per core or per server
• Learn how your database works • Implement new features (or pay someone to do it) • Fix bugs and test fixes without waiting for new release • No license costs, no price per core or per server
themselves (using shell scripts, ssh, …) • Semi-automated way. DBAs run Ansible/Rex/Puppet/… scenarios to converge the cluster/clusters to the desired state • Automated way: End-users create new clusters directly using Database as a Service (DBaaS)
• Vendor-lock • Not always community PostgreSQL (i.e. Amazon RDS or Aurora) • You may not have all features (i.e. no superuser, logical replication, …) • Build it yourself • Expensive and requires a lot of expertise outside of the database world • Duplication of efforts between different companies • Tied to your existing infrastructure • Embrace the open-source
on one or more servers • Physical or cloud based (AWS, GCE, Azure, Digital Ocean etc) • Automating deployment • Scaling and management • Container-based applications
providers (i.e. AWS, GCP, Azure) • Declarative based deployments of resources and applications • Repeatable deployments with containers • Extensible services to define and manage user-specified resources
• On the same host • Share host resources (i.e network) • Usually one instance of the app • Scheduled to run on nodes based on memory, cpu requirements metadata: name: my pod labels: application=myapp, version=v1, environment=release spec: containers: AppContainer, Sidecar volumes: volumeA App container Sidecar Volume
EC2 or GCE instance) • Running as many pods as it provides resources by Kubelet • Container runtime (i.e. docker) • kube-proxy to route requests to pods Pod A Pod B Pod C Docker runtime kube-proxy
volumes together • Each pod gets attached a persistent volume • On restart, the same volume and IP address is attached to a pod • Statefulset manages the defined amount of pods (killing excessive, starting missing) StatefulSet Name: app Replicas: 3 pv app-data-1 pod app-1 pod app-2 pod app-3 pv app-data-2 pv app-data-3
Values are base64 encoded • Usually restrictive access • Useful for storing logins-passwords apiVersion: v1 data: # user batman with the password justice batman: anVzdGljZQ== kind: Secret metadata: name: postgresql-infrastructure-roles namespace: default type: Opaque
external volume mount • Configuration controlled by environment variables • Many extensions (contrib, pgbouncer, postgis, pg_repack) installed together with multiple versions of PostgreSQL. • Zalando own open-source extension: pam_oauth2 and bgmon • Compressed to save space and speedup pod startup • Patroni-based automatic failover for HA clusters
that manages one PostgreSQL instance. • Patroni runs alongside PostgreSQL on the same system (needs access to the data directory) • Instances are attributed to the HA cluster based on the cluster name in Patroni configuration. • At most one instance in the HA cluster holds the master role, others replicate from it.
a distributed and strongly-consistent key-value system aka DCS (Etcd, Zookeeper, Consul or Kubernetes native API) • A leader node name is set as a value of the leader key /$clustername/leader that expires after pre-defined TTL • The leader node updates the leader key more often than expiration TTL, preventing its expiration • A non-leader node is not allowed to update the leader key with its name (CAS operation). • Each instance watches the leader key • One the leader key expires, each remaining instance decides if it is “healthy enough” to become a leader • The first “healthy” instance that creates the leader key with its name becomes the leader.
in DCS, then promote. • Demoting: first demote, then delete the leader key • Member is never healthy if the old master is still running • Member connects directly to other cluster members to get most up-to- date information • Member is never healthy if its WAL position is behind some other member or too far behind the last known master position.
StatefulSet • A StatefulSet creates N identical pods • Each pod runs Postgres docker image with Patroni • Patroni initiates leader election, one pod is elected as primary • Rest of the pods find the primary in the same cluster as they are and stream from it