Amazon FSx for Lustre, which makes it easy and cost effective to launch and run the world’s most popular high-performance file system in AWS, is making it even easier to process data residing in Amazon S3 by enabling your file system’s contents to be updated automatically as data is added to or changed in an S3 bucket.
Customers use FSx for Lustre for a wide spectrum of use cases. High-performance files systems are perfect for media processing and transcoding, electric design automation (EDA), autonomous vehicles, big data and financial analytics, machine learning, and high performance computing (HPC).
It’s the most widely used file system for the 500 fastest computers in the world. It provides submillisecond latencies, hundreds of gigabytes per second of throughput, and millions of IOPS enabling compute intensive workloads to complete faster. Many enterprises and other AWS customers often store their datasets and build their data lakes on Amazon S3. Since Amazon FSx for Lustre is deeply integrated with S3, customers can create a new FSx for Lustre file system linked to their S3 bucket in minutes.
With this feature, AWS customers who periodically collect and process new data, such as autonomous vehicle researchers and financial analysts, can easily use Amazon FSx for Lustre to process the latest data when it is added to or changed in their S3 bucket.
Read more about the use case examples and how to get started with imports of Amazon S3 object updates into Amazon FSx for Lustre in the new AWS blog.