July 2024 OLCF User Conference Call: The ADIOS I/O Framework

The OLCF hosts monthly User Conference Calls. These calls are your opportunity to speak with center personnel to get the latest updates, express any concerns you may have, etc. No registration is required for this event. An email with an invite to the event will be sent to OLCF users approximately one week beforehand.

Monthly Topic: The ADIOS I/O Framework

Speaker: Norbert Podhorszki (ORNL)

Abstract:

We present the concepts of parallel I/O in ADIOS, to write and read data in a scalable and portable way, with a declarative approach that is free of manual optimization of I/O in the application source code. We look at the settings some of the largest codes use to avoid I/O bottlenecks at large scale (thousands of compute nodes, up to PBs of data). We discuss reading performance, and large scale visualization with ParaView. Then we show why and how in situ data processing is useful to avoid producing too much data on storage and to accelerate scientific workflows. Finally, we introduce the new directions our research is going and present new concepts in helping the integration of an application into a larger scientific workflow spanning experiments, simulations and AI tools.

Recording | Slides

Looking for a previous User Call recording? Check out our Training Archive and Vimeo Channel.