Kubernetes meets Serverless: Deploy EDAs with Kubernetes APIs (API308)

Kubernetes Meets Serverless

Key Takeaways

  1. Heterogeneous Technology Choices: Customers are making use of a diverse range of technology choices, including both containers/Kubernetes and serverless/Lambda, to build modern applications.

  2. Bridging the Gap: The presenters discussed the challenges they faced in the past when trying to bring these different compute technologies together, and how new tools like AWS Controllers for Kubernetes (ACK) and Kube Resource Orchestrator (KRO) can help address these challenges.

  3. Empowering Developers: Providing developers with an API-driven experience, where they can easily deploy their applications and access the resources they need, is crucial for enabling them to build quickly and efficiently.

Detailed Summary

Heterogeneous Technology Landscape

  • Customers are building modern applications using a mix of containers/Kubernetes and serverless/Lambda, based on the specific requirements of their workloads.
  • This heterogeneous landscape often arises due to factors like company acquisitions, technology preferences, and specific use case requirements.
  • While this diversity can create some challenges, it also allows teams to choose the right tool for the job, which can be a successful approach.

Addressing the Challenges

  • The presenters shared their personal experiences in trying to build a centralized platform to manage both Kubernetes and serverless resources, and the difficulties they faced.
  • This led to the development of tools like ACK (AWS Controllers for Kubernetes) and KRO (Kube Resource Orchestrator) to help bridge the gap between Kubernetes and serverless.
    • ACK provides a set of Kubernetes controllers to manage AWS resources, including serverless services like Lambda and S3.
    • KRO is a new open-source project that allows you to group and orchestrate these AWS resources within Kubernetes.

Empowering Developers

  • The key is to provide developers with an API-driven experience, where they can easily deploy their applications and access the resources they need, without having to go through a cumbersome ticketing process.
  • This enables developers to build and deploy quickly, while still adhering to the necessary security, compliance, and governance requirements.

Demo: Data Processing Use Case

  • The presenters demonstrated a data processing use case that combines the use of EMR on EKS (for the data processing) and AWS Step Functions (for the orchestration) within a Kubernetes-based architecture.
  • This showcases how you can leverage both Kubernetes and serverless technologies to build a complete, end-to-end data processing pipeline.

Resources

Your Digital Journey deserves a great story.

Build one with us.

Cookies Icon

These cookies are used to collect information about how you interact with this website and allow us to remember you. We use this information to improve and customize your browsing experience, as well as for analytics.

If you decline, your information won’t be tracked when you visit this website. A single cookie will be used in your browser to remember your preference.

Talk to us