Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Postgres in the Containers Era

OnGres
October 18, 2023

Postgres in the Containers Era

Containers are everywhere. Whether in a code test suite, a developer’s laptop, in production or CI/CD pipelines, containers have taken the deployment world by storm. Similarly, Kubernetes adoption is skyrocketing.

How does Postgres fit in this container era? Is Postgres “cloud native”?

The challenges to optimally run Postgres in containers will be explored, including the challenges associated with one of most loved features: extensions.

Containers are here to stay, and they are everywhere. Postgres can and should run optimally on containers. We can catch this train of the present and future, or watch it go. It’s time to act.

OnGres

October 18, 2023
Tweet

More Decks by OnGres

Other Decks in Technology

Transcript

  1. Postgres in the Container Era @ahachete ` whoami ` Alvaro

    Hernandez <[email protected]> aht.es • Founder & CEO, OnGres • 20+ years Postgres user and DBA • Mostly doing R&D to create new, innovative software on Postgres • More than 135 tech talks, most about Postgres • Founder and President of the NPO Fundación PostgreSQL • AWS Data Hero
  2. Postgres in the Container Era @ahachete This is a journey

    from doubting, being scared, and avoiding to embracing, loving and needing containers
  3. Postgres in the Container Era @ahachete But what about Kubernetes???

    https://www.rawpixel.com/image/434575/massive-container-ship
  4. Postgres in the Container Era @ahachete This is a journey

    from doubting, being scared, and avoiding to embracing, loving and needing containers and Kubernetes
  5. Postgres in the Container Era @ahachete Containers and Kubernetes are

    here to stay https://dok.community/wp-content/uploads/2022/10/DoK_Report_2022.pdf
  6. Postgres in the Container Era @ahachete Containers and Kubernetes are

    here to stay https://www.datadoghq.com/container-report/
  7. Postgres in the Container Era @ahachete What is NOT a

    container A container is not a “lightweight” VM
  8. Postgres in the Container Era @ahachete What is NOT a

    container A container is not a “lightweight” VM • Well, a container is more lightweight than a VM
  9. Postgres in the Container Era @ahachete What is NOT a

    container A container is not a “lightweight” VM • Well, a container is more lightweight than a VM • Well, actually a container can be a VM (but that’s not what we meant here)
  10. Postgres in the Container Era @ahachete So what’s technically a

    container? • Namespace isolation $ unshare …
  11. Postgres in the Container Era @ahachete So what’s technically a

    container? • Namespace isolation $ unshare … • Container image / chroot
  12. Postgres in the Container Era @ahachete So what’s technically a

    container? • Namespace isolation $ unshare … • Container image / chroot • cgroups
  13. Postgres in the Container Era @ahachete Yeah, but what about

    I/O? Just. Use. External. Storage https://giphy.com/gifs/KubbAndCo-simple-just-do-it-quite-really-W5Ub2lhJPWlL4iXnNL/
  14. Postgres in the Container Era @ahachete Option 1: the fatty

    container • Size • Security • Restarts (downtime)
  15. Postgres in the Container Era @ahachete Option 2: dynamically inject

    into container • Security • Startup time • Approach followed in StackGres See https://aht.es/#talks-postgres_extensions_in_kubernetes
  16. Postgres in the Container Era @ahachete Option 3: dynamically generate

    container images Formula to compute all possible number of images, considering n extensions to choose from
  17. Postgres in the Container Era @ahachete Option 3: dynamically generate

    container images Formula to compute all possible number of images, considering n extensions to choose from
  18. Postgres in the Container Era @ahachete Option 3: dynamically generate

    container images Formula to compute all possible number of images, considering n extensions to choose from is bigger than
  19. Postgres in the Container Era @ahachete Option 3: dynamically generate

    container images Option 3: dynamically generate container images n=10 → 252 n=200 → 9.05485146561032811654E+58
  20. Postgres in the Container Era @ahachete Option 3: dynamically generate

    container images • acl • hypopg • mv_stats • orafce • pg_jobmon • pg_track_settings • pg_uuidv7 • vector
  21. Postgres in the Container Era @ahachete Can containers solve the

    Postgres collation issues? • OS upgrades are painful and vendor dependent
  22. Postgres in the Container Era @ahachete Can containers solve the

    Postgres collation issues? • OS upgrades are painful and vendor dependent • Containers isolate (and stabilize!) OS image
  23. Postgres in the Container Era @ahachete Can containers solve the

    Postgres collation issues? • OS upgrades are painful and vendor dependent • Containers isolate (and stabilize!) OS image • Create containers with stable collation (libc or better ICU) and deploy on any OS
  24. Postgres in the Container Era @ahachete Single image, multiple OS

    • Containers are (mostly) Linux-only • But Windows (and also Mac) can run (more or less transparently) Linux containers
  25. Postgres in the Container Era @ahachete Single image, multiple OS

    • Containers are (mostly) Linux-only • But Windows (and also Mac) can run (more or less transparently) Linux containers • Pack once, deploy on any OS
  26. Postgres in the Container Era @ahachete Kubernetes is containers next

    level • It’s not “that complicated”
  27. Postgres in the Container Era @ahachete Kubernetes is containers next

    level • It’s not “that complicated” • Allows automation of infrastructure to unknown levels
  28. Postgres in the Container Era @ahachete Kubernetes is containers next

    level • It’s not “that complicated” • Allows automation of infrastructure to unknown levels • Operators can make extremely hard things extremely easy
  29. Postgres in the Container Era @ahachete Learn more about Postgres

    on Kubernetes https://speakerdeck.com/ongres/where-should-i-run-my-database