Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Data Gateways: Legacy Data for Microservices

Data Gateways: Legacy Data for Microservices

Application architecture evolution has fragmented the backend implementation into independent microservices and functions. However there is still a gap on the way this evolution has dealt with data as it tends to avoid dealing with static environments. At the same time, microservices encourage developers to create new polyglot data persistence layers that then, need to be composite to deliver business value. How can we apply the knowledge from API gateways to these new data stores?

In this session we will talk about:
- How data gateways act like API gateways to offer a secured abstraction layer on top of the physical data stores,
- the different data gateway types and architectures, and
- extended data-proxy for hybrid cloud deployments.

Hugo Guerrero

September 24, 2020
Tweet

More Decks by Hugo Guerrero

Other Decks in Programming

Transcript

  1. Legacy data for microservices Data Gateways Hugo Guerrero APIs &

    Messaging Developer Advocate, Red Hat DATA GATEWAYS 1
  2. Agenda DATA GATEWAYS 2 Architecture Evolution Application architecture trends Microservices

    Data The rise of the gateways Microservices Data Data Gateways Capabilities Types Open source data gateways Hugo Guerrero Mexican @ MA, USA APIs & Event-Driven Specialist | Open Source Advocate | History, Travel & Food Enthusiast @hguerreroo
  3. DATA GATEWAYS 3 12 factor apps What became hot? Application

    Architecture Evolution Microservices Serverless
  4. DATA GATEWAYS 7 The Rise of API Gateways The traditional

    Load Balancer is not enough Developer Apps API Backend 2 API Gateway API Request Authorized API Request API Backend 1 API Backend 3
  5. 8 DATA GATEWAYS Microservices Data • Independent database per microservice

    ◦ Independent database instance ◦ Independent schema and logical grouping of tables • Only one microservice owns the data
  6. 9 Source: https://martinfowler.com/bliki/PolyglotPersistence.html DATA GATEWAYS Microservices Data • Polyglot persistence

    layer ◦ Data is different, so the persistence layer • Relational database and document and in-memory and…
  7. Source: https://www.infoq.com/articles/data-gateways-cloud-native/ “A data gateway is like an API gateway,

    but it understands and acts on the data layer implementation rather than the networking layer” DATA GATEWAYS 11
  8. 12 DATA GATEWAYS Data Gateway Capabilities • Abstraction / Decoupling

    ◦ Hides implementation ◦ Abstracts physical source • Security ◦ Access control based on data model (row, column, etc.) • Scaling ◦ Caching and materialized views • Federation • Schema-first based on SQL standard
  9. 13 DATA GATEWAYS Many Types of Data Gateways • Classic

    Data Virtualization • Database with Federation • GraphQL bridges • Cloud-hosted • Secure tunneling data-proxies • Open source data gateways
  10. • Apache Drill ◦ Schema-free SQL query engine for NoSQL

    databases and file systems • PrestoDB ◦ Distributed SQL query engine targeting big data use cases through its coordinator-worker architecture • Teiid ◦ Data federation engine purposefully re-written for the Kubernetes ecosystem sponsored by Red Hat 14 DATA GATEWAYS Open Source Data Gateways
  11. “Data has gravity, requires granular access control, is hard to

    scale, and difficult to move on/off/between cloud-native infrastructures. Having a data gateway component as part of the cloud-native tooling arsenal, which is hybrid and works on multiple cloud providers, supports different use cases is becoming a necessity.” DATA GATEWAYS 16 Source: https://www.infoq.com/articles/data-gateways-cloud-native/
  12. linkedin.com/company/red-hat youtube.com/user/RedHatVideos facebook.com/redhatinc twitter.com/RedHat 17 Red Hat is the world’s

    leading provider of enterprise open source software solutions. Award-winning support, training, and consulting services make Red Hat a trusted adviser to the Fortune 500. Thank you DATA GATEWAYS