AWS re:Invent 2025 - Harnessing analytics for humans and AI (INV201)

Harnessing Analytics for Humans and AI: Key Trends and Innovations at AWS re:Invent 2025

1. Integrating AI Assistance into Analytics Workflows

• AWS is building AI capabilities directly into their analytics services and tools to streamline data tasks.
• Highlights include:
  • Optimized Spark 3.5.6 engine powering EMR, Glue, Athena, and SageMaker Notebooks
  • AI-powered Spark upgrade assistance to automate migration to the new Spark engine
  • AI-enabled SageMaker Notebooks that can write code, generate pipelines, and provide natural language interaction
• Benefits:
  • Faster Spark upgrades, from months to weeks, by automating the process with AI
  • More intuitive and efficient data exploration and insight generation in SageMaker Notebooks
  • Reduced operational burden of managing analytics infrastructure

2. Embracing Open Analytics Architectures

• Customers want flexibility to choose the right analytics solution for their needs, rather than a one-size-fits-all approach.
• Open data formats like Apache Parquet and Iceberg enable this composable, cost-effective analytics architecture.
• AWS is investing heavily in Iceberg support across its analytics services (Athena, EMR, Redshift).
• New capabilities:
  • Iceberg table append write support in Amazon Redshift
  • Improved Redshift read performance for Iceberg queries by over 2x
• Benefits:
  • Freedom of choice for developers and data engineers to use their preferred analytics tools
  • Reduced costs by avoiding data migrations and paying only for what's needed
  • Simplified experience with SageMaker Unified Studio as a single analytics development environment

3. Analytics Building Blocks for Composability

• AWS is introducing "analytics building blocks" - reusable capabilities that work across multiple services.
• Examples include:
  • Fully managed materialized views for Iceberg tables
  • S3 tables as a universal data store queryable by any Iceberg-compliant engine
• Benefits:
  • Increased flexibility and composability of analytics architectures
  • Automatic management of infrastructure and performance optimizations
  • Reduced operational overhead for developers

4. Harnessing the Power of Vectors for Semantic Understanding

• AWS is making vector storage a first-class citizen in S3, enabling semantic understanding of data.
• S3 Vectors now support up to 2 billion vectors per index, 10,000 indexes per bucket.
• Integrations with OpenSearch provide hybrid search capabilities and GPU acceleration for vector indexing.
• Benefits:
  • Ability to build billion-scale vector databases for semantic search and AI agent memory
  • Simplified vector management and optimization through S3 and OpenSearch
  • Reduced costs and increased performance through GPU acceleration and auto-optimization

5. Customer Spotlight: Intuit's Data-Driven Transformation

• Intuit transformed its data strategy to become a "system of intelligence" for its 86 million customers.
• Key elements:
  • Standardizing data semantics across product lines for better communication
  • Establishing common data infrastructure and pipelines for efficient data flow
  • Implementing robust metadata management and data governance
  • Automating data discovery and access to reduce time from 20 days to 9.4 hours
• Benefits:
  • Enabled seamless experiences between Intuit products like TurboTax and Credit Karma
  • Empowered data-driven decision making and personalized customer experiences
  • Improved data quality, reliability, and accessibility across the organization

Conclusion

AWS is driving innovation in analytics by integrating AI assistance, embracing open architectures, introducing composable building blocks, and harnessing the power of vectors. These advancements enable customers to build more intelligent, flexible, and cost-effective data platforms to power their businesses.