Loading…
This event has ended. Create your own event → Check it out
This event has ended. Create your own
View analytic
Thursday, March 3 • 11:50am - 12:10pm
Facilities, Infrastructure & Visualization: Advanced Parallel IO Libraries Study for Seismic Depth Imaging Applications

Sign up or log in to save this to your schedule and see who's attending!

WATCH THE PRESENTATION

Seismic applications such as the Reverse Time Migration (RTM) are very demanding on HPC resources, being compute, memory or storage. Using those resources efficiently is critical on an industrial production system where a full processing campaign can take up to several months of intensive computations. Henceforth, extracting a maximum of performances from every part of a seismic processing application is a necessity.

IO operations are a critical part of a HPC seismic application and the nature of IO in this domain is of a great diversity in terms of access pattern: serial, parallel on a shared file or independently. Optimizing IO can become complex when considering the multiple level of storage in parallel at the local or system level.

While parallel IO in HPC environments is typically achieved through a mix of MPI-IO \cite{thakur1997users} for shared file IO and POSIX-IO for single file per process data accesses. Extracting good performances from the underlying file system at scale is difficult and requires a lot of optimization, tuning and boiler plate code. For this reason, advanced parallel IO libraries have been subject to an increasing interest from the Oil and Gas industry due to the advanced data management semantics they propose, the implementation simplicity and high performances.

We propose here a study on the performances of two of those libraries, namely parallel HDF5 and ADIOS for checkpointing and shared file access in parallel. This study has been done on several HPC systems in an industrial environment. We show that using advanced parallel IO libraries provides a good trade-off in terms performances for seismic software.


Thursday March 3, 2016 11:50am - 12:10pm
BioScience Research Collaborative Building (BRC), Room 103

Attendees (7)