AMD Memory Hierarchy

AMD will present “AMD Memory Hierarchy” on Monday, September 18, 2023. This event is part of the HIP Training Series and will be presented by Alessandro Fanfarillo of AMD.

This presentation on the AMD Memory Hierarchy will take a deeper look into the AMD GPU hardware. With an understanding of GPU memory systems and in particular the AMD GPU memory system, we’ll explore how we can improve the performance of applications. This understanding is crucial to designing code to perform well. We’ll look at register usage and how to optimize your application for best utilization of this precious resource. Then we’ll look at occupancy and what might limit it in your application kernels. We’ll then cover the use of the local data store (LDS) that is available for each workgroup and the use of shuffle instructions for even more performance. The hands-on exercises will have examples of implementing each of these optimizations. While this presentation targets the AMD GPU hardware, many of the same ideas work on other vendor hardware.

Participation in the hands-on portion of each session will be limited to participants who already have access to OLCF’s Frontier or NERSC’s Perlmutter.

The Q&A for all the sessions will be in this Google doc

If you have any questions, please contact Subil Abraham ([email protected])

This event is in the past. Thank you for participating.

Will be shared via email to registered participants.
[/tw-toggle] [tw-toggle title=”Presentations”] (slides | recording)
[/tw-toggle] [tw-toggle title=”Exercises”] Exercises on Github

This event is past. Thank you for participating.