Modernize managed file transfer with SFTP (STG305)

Here is a detailed summary of the video transcription in markdown format:

Modernizing Managed File Transfer (MFT) with AWS Transfer Family

Overview

• The session covers the value of modernizing managed file transfer (MFT) and provides examples of customers who have done so.
• The presenters discuss the AWS approach to building cloud-native MFT solutions that integrate with data pipelines.
• They provide an overview of the key features and capabilities of the AWS Transfer Family service.

Key Takeaways

Expectations for Modern MFT

1. Multiple Protocols: Support for industry-standard protocols like SFTP, FTPS, AS2, etc.
2. Authentication and Access Control: Flexibility to integrate with various directory services (OKTA, Azure AD, etc.).
3. Automation: Ability to automate the entire MFT process.
4. Centralized Logging and Auditing: To meet regulatory requirements.

Challenges with Legacy MFT Stacks

• Managing infrastructure, connectivity, and scaling as the business grows.
• Data stored on-premises, making it inaccessible to cloud-based analytics tools.
• Burden of regularly patching and maintaining SFTP servers.
• Treating MFT infrastructure as "pets" instead of "cattle".

AWS Transfer Family

• Fully managed service, eliminating infrastructure management.
• Highly available and scalable to meet business needs.
• Supports multiple protocols, including the newly launched HTTPS-based Web Apps.
• Integrates with event-driven workflows and data pipelines.
• Provides centralized logging and auditing capabilities.

Customer Success Stories

• Regeneron saved 90% by migrating to AWS Transfer Family.
• FINRA used Transfer Family to integrate their data lake on Amazon S3.
• The Singapore government used Transfer Family to collect data for electric vehicle infrastructure planning.

Key Capabilities of AWS Transfer Family

1. Servers: SFTP, FTPS, AS2, and Web Apps for non-technical users.
2. Data Processing: Managed workflows and event-driven processing using Amazon EventBridge.
3. Data Integration: SFTP connectors for fetching data from external sources.
4. B2B Data Exchange: Automated transformation of EDI documents at scale.

New Features and Enhancements

• Support for static IPs, standardized security policies, and APIs for SFTP connectors.
• Improved support for AS2 protocol, including EventBridge integration.
• Increased file size and throughput for SFTP connectors.
• Launch of AWS Transfer Family Web Apps for easy access to data in Amazon S3.

Conclusion

• The presenters encourage attendees to explore the available resources, including workshops, toolkits, and partner programs, to help modernize their MFT infrastructure using AWS Transfer Family.
• They also highlight the importance of continued learning and exploration of AWS storage and data services beyond Transfer Family.

Q&A Session

The presenters open the floor for questions and answers.