CUDA: Atomics, Reductions, and Warp Shuffle

CUDA: Atomics, Reductions, and Warp Shuffle
Wednesday, May 13, 2020

On-site participation will be held at the following sites:

ORNL Building 5100, Room 128 (JICS Auditorium) 1:00 PM – 3:00 PM (ET)
NERSC Building 59 (Shyh Wang Hall), Room 4102 10:00 AM – 12:00 PM (PT)

On Wednesday, May 13, 2020, NVIDIA will present part 5 of a 9-part CUDA Training Series titled “Atomics, Reductions, and Warp Shuffle”.

This CUDA programming model does not enforce any order of thread execution. This requires attention when performing operations like reductions on the GPU. This module introduces atomic operations, parallel reductions, and warp shuffle, which can help you in cases where exposing parallelism is not immediately obvious due to potential thread contention. After the presentation, there will be a hands-on session where in-person participants can complete example exercises meant to reinforce the presented concepts. While the exercises will be made available to all participants (both in-person and remote), remote participants will not be supported during the hands-on sessions.

In-Person Participation
OLCF and NERSC will both be holding in-person events for each part of the series, where participants can watch the presentations and get help from experts during the hands-on sessions. In-person participants without current Summit or Cori-GPU access will be given temporary accounts to work on the examples.

NOTE: The deadline for registration is May 6, 2020.

Remote Participation
Remote participants can watch the presentations via web broadcast and will have access to the training exercises, but temporary access to the compute systems will be limited as follows:

  • Current NERSC users will have Cori-GPU access temporarily added to their accounts.
  • Temporary Summit access will not be available for remote participants.

NOTE: Registration is required for both in-person and remote participation. To register, please submit the form below.

If you have any questions, please contact Tom Papatheodore (


May 13 2020


Thomas Papatheodore
1 (865) 576-1244
QR Code

Comments are closed.