AWS re:Invent 2024 -Amazon FSx Intelligent-Tiering: A new, fully elastic file storage class (STG216)
Amazon FSX Intelligent Tiering
Overview
Introduction to Amazon FSX and FSX for OpenZFS
Amazon FSX provides fully managed Network Attached Storage (NAS) in the cloud.
FSX for OpenZFS is a solution for NAS deployments built on the open-source OpenZFS file system.
Challenges with Large NAS Data Sets
Unpredictable data growth and shrinkage, requiring operational effort to manage storage capacity.
Rapidly growing data sets, with customers wanting to retain data for longer.
High-performance all-SSD storage being cost-prohibitive for large, petabyte-scale data sets.
Amazon FSX Intelligent Tiering
Introducing the New Storage Class
Amazon FSX Intelligent Tiering combines the functionality of NAS with the benefits of fully elastic, intelligently tiered, and low-cost storage.
Automatically grows and shrinks to fit data, eliminating the need to manage storage capacity.
Automatically optimizes costs by moving data across storage tiers (frequent access, infrequent access, and archive instant access).
Reduces storage costs for NAS data sets by up to 85% compared to the existing SSD storage class, and up to 20% compared to traditional HDD-based NAS deployments on-premises.
How Intelligent Tiering Works
Three storage tiers: frequent access, infrequent access, and archive instant access.
Data automatically moves between tiers based on access patterns (30 days for infrequent access, 90 days for archive instant access).
All data is instantly retrievable with tens of milliseconds of latency, regardless of the tier.
Pricing based on the amount of data stored in each tier, and the number of requests (reads and writes) to the storage.
Performance and Cost Optimization
SSD-based write journal for low-latency writes (around 1 millisecond).
Optional SSD read cache to provide low-latency reads for latency-sensitive or IOPS-intensive workloads.
Optimizations like write aggregation and prefetching to balance performance and cost.
Examples of cost savings for different data access patterns (hot, typical, and archive-like data sets).
Use Cases and Recommendations
Intelligent Tiering is suitable for many workloads, including performance-intensive ones, due to the performance optimizations.
Provisioned SSD deployments are still recommended for workloads with truly random access patterns across the entire data set.
Backup support, including incremental backups, fast restores, and independent backup storage on Amazon S3.
Conclusion
Amazon FSX Intelligent Tiering provides a powerful solution for managing large NAS data sets in the cloud, combining the capabilities of NAS with the benefits of fully elastic, intelligently tiered, and low-cost storage.
The new storage class enables customers to migrate even their largest, HDD-based data sets to the cloud cost-effectively, without sacrificing performance or functionality.
These cookies are used to collect information about how you interact with this website and allow us to remember you. We use this information to improve and customize your browsing experience, as well as for analytics.
If you decline, your information won’t be tracked when you visit this website. A single cookie will be used in your browser to remember your preference.