High Performant File System Workloads for AI and HPC on AWS using IBM Spectrum Scale

A draft IBM Redpaper publication

Updated 26 January 2021

cover image

IBM Form #: REDP-5626-00

More options

Rate and comment

Authors: Sanjay Sudam

Abstract

This Redpaper Blueprint is intended to facilitate the deployment and configuration of the IBM® Spectrum Scale based high performance storage solutions for the scalable Data and AI solutions on Amazon Web Services (AWS).

The Blueprint presents configuration, testing results, and tuning guidelines for running the IBM Spectrum® Scale based high performance storage solutions for the Data and AI workloads on AWS. The LAB Validation was conducted with the Red Hat Linux nodes to IBM Spectrum Scale using the various Amazon Elastic Compute Cloud (EC2) instances. Simultaneous workloads are simulated across multiple Amazon EC2 nodes running with Red Hat Linux to determine scalability against the IBM Spectrum Scale clustered file system. This paper will outline the architecture, configuration details and performance tuning to maximize the Data and AI application performance with IBM Spectrum Scale on AWS.

Table of contents

Not available.

These pages are Web versions of IBM Redbooks- and Redpapers-in-progress. They are published here for those who need the information now and may contain spelling, layout and grammatical errors. This material has not been submitted to any formal IBM test and is published AS IS. It has not been the subject of rigorous review. Your feedback is welcomed to improve the usefulness of the material to others.

Follow IBM Redbooks

Follow IBM Redbooks