Linking Lustre and object storage - Data repository associations in Amazon FSx
HPC and machine learning are increasingly being used to solve complex problems, but working with massive datasets can be prohibitively expensive.
Today's Tech Short shows how to elevate data in S3 into a high speed POSIX filesystem in just two clicks. Simply specify the S3 path and filesystem location to create an association. The entire bucket structure becomes visible as metadata in the filesystem, while the data remains in low-cost S3 storage.
When files are accessed, they are efficiently streamed from S3 on-demand. Pre-loading and caching commands allow optimizing read performance.
If you need to efficiently process huge datasets for HPC, machine learning or other applications, watch this video to see how FSx for Lustre can save you time and money by seamlessly integrating S3 object storage with a high performance filesystem.
If you have ideas for technical topics you'd like to see us cover in a future show, let us know by emailing us at [email protected].
Смотрите видео Linking Lustre and object storage - Data repository associations in Amazon FSx онлайн без регистрации, длительностью часов минут секунд в хорошем качестве. Это видео добавил пользователь HPC Tech Shorts 19 Сентябрь 2024, не забудьте поделиться им ссылкой с друзьями и знакомыми, на нашем сайте его посмотрели 18 раз и оно понравилось людям.