HPC133 Introduction to GPU Programming (Feb 2023)
HPC133 Introduction to GPU Programming (Feb 2023)
An overview of GPUs and their use in supercomputers. This workshop will explain what GPUs are, and cover the basic ideas of GPU use in scientific computing. We will introduce several GPU programming frameworks, and demonstrate how to accelerate a solution of a science problem using a GPU. Python or C++ could be used for the assignment.
Format: In person, but also broadcast.Teacher: Yohai MeironStart date: 21 Feb 2023End date: 24 Feb 2023High Performance Computing Credits: 6
Please fill in this very short survey
[updated with Friday's slides]
This tarball contains the source code for the vector addition examples, gravitational potential exercise, and sample code for the diffusion equation homework exercise.
src/gravitydirectory contains two Python programs to test and benchmark the different solutions for the gravitational potential exercise; the solution functions are in the
gravity_calculatorssubdirectory. The Sapporo N-body library has to be downloaded, patched, and built before it can be used here; this is done automatically by the
get_sapporo.shscript in the
sapporo2directory (tested on Mist; some tweaks required to get this program to work on other systems).
Assignment2D diffusion equation AssignmentDue: Saturday, 11 March 2023, 12:00 AM
The assignment is to numerically solve the diffusion (heat) equation in two dimensions, using GPU acceleration, in either Python or C++.
You can find serial, CPU-based solutions in both languages in the course’s source tarball.
If you choose Python, you can follow the instructions on the appropriate slide in the handouts, titled Setting up the environment (Python). If you want graphics on Mist, please also install the
matplotlibpackage in your Conda environment using
conda install(no need on Graham as the package is provided by the
scipy-stackmodule). You could modify the file
diff2d.pysuch that the bulk of the calculation (within the time loop) is done using the GPU. You can follow the gravitational potential calculation example shown in class, Numba and/or CuPy can be used in the solution. Note that the sample solution in Python is equivalent to the “naïve” solution for the gravitational potential problem, therefore very bad.
If you choose C++, we count on you being familiar with how to compile source code. You could modify the file
diff2d.cppsuch that the bulk of the calculation (within the time loop) is done using the GPU. On both Mist and Graham, load the following modules:
pgplot(you may skip PGPLOT but then please remove the plotting calls from the main source file and do not compile
diff2dplot.cpp). If you choose to work with HIP instead of CUDA, on Mist you can load the
hipmodule in addition to the cuda module (which is still necessary since HIP uses the CUDA compiler under the hood when compiling for Nvidia GPUs). HIP is not currently available on Graham, but you can try to install it locally there.
The sample C++ code uses rarray, you can install it locally or just pull the header.
The usual suffix of CUDA files is
nvcccommand is used to compile the source (instead of
g++for example). You can keep the
.cppsuffix, but then have to pass
nvcc(this is not recommended for files that contains a kernel launch with triple angle brackets, as that is not legal C++ syntax). The usual suffix of HIP files is just
.cpp, and the
hipcccommand is used to compile. GPU kernels can be in the same file where the main function is, as we saw in the vector addition example, but in more complex applications the GPU code (including kernel launches) would generally be separated out to one or more compilation units that are linked to the rest of the code during the build process.
The Mist login node has four GPUs that can be used for the assignment, on Graham one has to submit a job to the scheduler. Unlike for submitted jobs, there is no guarantee that a GPU on the Mist login node would be free when you launch your application, as the node is shared by everyone. You could use the
nvidia-smicommand to see the current usage of the GPUs. By default, the first device (number 0) is used, but this behaviour can be change by setting an environment variable as shown below. For example, if you want to use device number 1:
CUDA_VISIBLE_DEVICES=1 python code.py
There are three “bonus” tasks that you can try for your own amusement (2 & 3 are beyond the scope of this workshop):
- The smaller Δx, the more accurate and computationally heavy the solution. Plot the timing for your solution and of the serial CPU-based solution (and possibly improved CPU-based solutions) as a function of Δx.
- Decompose the domain and solve the problem with multiple GPUs on the same node.
- Use a distributed memory library to deploy your solution on multiple nodes.
Hint: for a single node you could use
multiprocessingin Python and
threador OpenMP in C++. For multiple nodes you could use
mpi4py(Python) or MPI (C++).
FileExample solution File