AWS Graviton: The best price performance for your AWS workloads (CMP320)

Here is the detailed summary of the video transcription in Markdown format, broken into sections for better readability:

AWS Graviton: Delivering the Best Price-Performance for Your Workloads

Introduction

  • The session covers how AWS Graviton enables the best price-performance for customer workloads.
  • Presenters include Sudarshan Ramesh (AWS), Ali Sidi (AWS), and Sujit Katakam (Robin Hood).

AWS's Custom Chip Journey

  • AWS has been investing in building custom chips across data center infrastructure, core compute, and machine learning.
  • Reasons for building custom chips include specialization, innovation, and security.
  • The Graviton journey started in 2018 with Graviton 1, and each generation has pushed performance, capabilities, and efficiency.

Graviton Generations

  • Graviton 2 (launched in 2019) delivered up to 40% better price-performance over other instances.
  • Graviton 3 (launched in 2021) provided 25% higher performance and 2x improvement in floating-point performance over Graviton 2.
  • Graviton 4 (latest generation) has 50% more cores, 2x the L2 cache, and 75% more bandwidth than Graviton 3.

Graviton 4 Instances

  • Graviton 4 instances are available in 8th-generation compute, memory, and general-purpose families, offering up to 30% higher performance than Graviton 3.
  • The new I8 storage-optimized instance provides up to 65% better real-time storage performance.
  • The upcoming network-optimized Graviton 4 instance is expected to be available soon.

Customer Adoption and Use Cases

  • Customers across different industries and sizes are adopting Graviton, with 95% of the top 1000 EC2 customers using Graviton.
  • Use cases include gaming, observability, databases, electronic design automation (EDA), and more.
  • Customers are also leveraging Graviton to reduce their carbon footprint, with up to 60% less energy consumption.

Graviton 4 Processor Details

  • Graviton 4 has 96 CPU cores (50% more than Graviton 3), a larger L2 cache, and support for multi-socket coherency.
  • The processor is designed to optimize performance for real-world workloads, with improvements to the front-end and branch prediction.
  • Graviton 4 supports the Arm v9 architecture, which includes new instructions for branch target identification and ROP mitigation.

Graviton 4 Performance

  • Graviton 4 delivers up to 40% higher performance than Graviton 3 for workloads like MySQL, Nginx, and Grails.
  • It also provides 20-30% better performance for machine learning frameworks like PyTorch.
  • Over the past four generations, Graviton has seen around a 4x performance improvement.

Robin Hood's Journey with Graviton

  • Robin Hood, a financial services company, adopted Graviton to leverage the benefits of price-performance, sustainability, and innovation.
  • The adoption journey involved a POC phase, adding Arm64 support in the build-release-deploy pipeline, and a phased migration approach.
  • Key challenges and solutions included cross-compiling native code, pre-building Python wheels, and using multi-architecture image indexes.
  • Robin Hood continues to optimize resource utilization and explore Graviton 4 for further gains.

Resources and Best Practices

  • The Graviton Technical Guide, Graviton Fast Start program, and Porting Advisor tool provide guidance for adopting Graviton.
  • Recommendations include leveraging managed services, using the latest software stacks, and utilizing performance analysis tools like AP Perf.

Your Digital Journey deserves a great story.

Build one with us.

Cookies Icon

These cookies are used to collect information about how you interact with this website and allow us to remember you. We use this information to improve and customize your browsing experience, as well as for analytics.

If you decline, your information won’t be tracked when you visit this website. A single cookie will be used in your browser to remember your preference.

Talk to us