Accelerate database performance and scalability with AWS storage (STG332)

Here is a detailed summary of the video transcription in markdown format, broken into sections for better readability.

Introduction

  • Ryan S. and Jim White are speakers with backgrounds in storage, both as users and vendors.
  • The discussion will focus on self-managed storage in the cloud, with organizations rapidly moving databases to AWS.

Database Freedom

  • Database freedom is the ability to choose different database services, whether managed or self-managed solutions.
  • This flexibility allows for integration of components like generative AI into databases and analytics.

Self-Managed Databases

  • Reasons for self-managing databases in the cloud include compliance requirements, specific database user requirements, or the need for more control.
  • Traditional databases like MySQL, PostgreSQL, and MongoDB, as well as newer databases like CockroachDB, TiDB, and MongoDB, are commonly deployed in a self-managed manner.
  • These databases can be deployed on EC2 or containerized using ECS or EKS, often utilizing EBS and FSX for block and file storage.

Choosing Storage Solutions

  • Customers often deploy databases exclusively on block storage (EBS) or a combination of block and file storage.
  • EBS volumes offer different performance options, such as gp3, io2 Block Express, st1, and sc1, depending on the workload requirements.
  • Factors to consider when choosing storage include RTO/RPO, resiliency, agility, and total cost of ownership (TCO).
  • In addition to EBS, the discussion will focus on three members of the FSX family: FSX for NetApp ONTAP, FSX for Windows File Server, and FSX for OpenZFS.

EBS: Key Features and Capabilities

  • EBS provides a simple, block-level storage solution that can deliver high performance.
  • Elastic Volumes allow online modification of volume types without downtime, enabling efficient management of seasonal or changing storage needs.
  • Fast Snapshot Restore (FSR) enables quick rehydration of volumes from snapshots, useful for database upgrades or migrations.
  • EBS volumes can be categorized based on performance requirements, with gp3 as the general-purpose option, io2 Block Express for low-latency and high-IOPS workloads, and st1/sc1 for batch or less-critical workloads.
  • EBS offers 99.999% durability, and Amazon Data Lifecycle Manager can help manage snapshot lifecycle.

FSX Family: Key Features and Capabilities

  • FSX for Windows File Server provides a familiar Windows-based storage experience for SQL Server and other Windows-based databases.
  • FSX for OpenZFS offers a rich set of data management features, such as snapshots and clones, suitable for Oracle and PostgreSQL databases.
  • FSX for NetApp ONTAP supports both block (iSCSI) and file (SMB, NFS) connections, catering to a variety of database requirements.
  • All FSX services offer either single-AZ or multi-AZ highly available deployment options, with synchronous replication between AZs in the multi-AZ configuration.

Snapshots, Clones, and Data Protection

  • Snapshots in FSX for ONTAP and OpenZFS are database-consistent, allowing quick rollback and recovery without the need for extensive roll-forward.
  • Clones, based on snapshots, enable rapid provisioning of test, development, and training environments without consuming additional storage space.
  • Clones can also be used for disaster recovery testing or to promote a clone to production in another region.

Customer Case Studies

  • Adidas consolidated multiple on-premises ERP systems onto a single S/4HANA deployment on AWS, using FSX for ONTAP for its snapshot and clone capabilities to reduce recovery times.
  • Amdoc, a telecommunications company, uses FSX for OpenZFS to create hundreds of standby, reporting, and test/dev databases for its Oracle workloads, leveraging snapshots and clones.
  • S&P Global and Change Healthcare both deployed SQL Server FCI clusters on AWS, using FSX for ONTAP and FSX for Windows File Server, respectively, to achieve high availability and reduce licensing costs.

Choosing the Right Storage Service

  • The presentation provides a comparison chart to help customers evaluate the features and capabilities of EBS, FSX for ONTAP, FSX for OpenZFS, and FSX for Windows File Server.
  • Factors to consider include familiarity, block or file access, storage resiliency, and advanced data management features like snapshots and clones.

Getting Started

  • The presenters recommend working with an AWS account team to conduct an assessment of the existing database infrastructure and workloads, which can help identify the most suitable storage services.
  • The assessment can also help group databases and other workloads for efficient migration to AWS.
  • The presenters highlight the various storage-related sessions available during the AWS re:Invent conference, including their own session on "Merging the Best of EC2 Instance Store and EBS".

Your Digital Journey deserves a great story.

Build one with us.

Cookies Icon

These cookies are used to collect information about how you interact with this website and allow us to remember you. We use this information to improve and customize your browsing experience, as well as for analytics.

If you decline, your information won’t be tracked when you visit this website. A single cookie will be used in your browser to remember your preference.

Talk to us