SC25: Modern High Performance I/O: Leveraging Object Stores

This repository contains the slides and exercises for the SC25 tutorial on Object Storage for High Performance I/O

This contains material contributed from a number of authors and organsations, including:

• Adrian Jackson, EPCC
• Mohamad Chaarawi, HPE
• Kenneth Cain, HPE
• Nicolau Manubens, ECMWF
• Johann Lombardi, HPE
• Rob Latham, ANL
• Glenn Lockwood, VAST
• Rob Ross, ANL

Timetable

• 8:30 Introduction
• 8:40 Object Storage and Storage Hardware
• 9:10 Benchmarking Exercise
• 9:30 Overview of DAOS
• 10:00 Break 30 minute coffee/snack break
• 10:30 APIs for DAOS
• 11:00 Programmig with DAOS
• 11:30 Ceph and LibRADOS
• 12:00 Lunch 90 minute lunch reset
• 13:30 MPI-I/O
• 14:00 Darshan
• 14:30 I/O Libraries and Object Store
• 15:00 Break 30 minute coffee/snack break
• 15:30 I/O libraries Part 2
• 16:00 I/O benchmarking principles & practice
• 16:30 AI workloads
• 17:00 Finish

Running

We are still working out the details for how to run hands-on. We've provided examples you are welcome to run on your own systems.