GPU Acceleration of Runge-Kutta Integrators

L.M. Murray


We consider the use of commodity graphics processing units (GPUs) for the common task of numerically integrating ordinary differential equations (ODEs), achieving speedups of up to 115-fold over comparable serial CPU implementations, and 15-fold over multithreaded CPU code with SIMD intrinsics. Using Lorenz ‘96 models as a case study, single and double precision benchmarks are established for both the widely used DOPRI5 method and computationally tailored low-storage RK4(3)5[2R+]C. A range of configurations are assessed on each, including multithreading and SIMD intrinsics on the CPU, and GPU kernels parallelized over both the dimensionality of the ODE system and number of trajectories. On the GPU, we draw particular attention to the problem of variable task-length among threads of the same warp, proposing a lightweight strategy of assigning multiple data items to each thread to reduce the prevalence of redundant operations. A simple analysis suggests that the strategy can draw performance close to that of ideal parallelism, while empirical results demonstrate up to a 10 percent improvement over the standard approach.

L.M. Murray (2012). GPU Acceleration of Runge-Kutta Integrators. IEEE Transactions on Parallel and Distributed Systems. 23:94--101.

L.M. Murray (2012). <a href="">GPU Acceleration of Runge-Kutta Integrators</a>. <em>IEEE Transactions on Parallel and Distributed Systems</em>. <strong>23</strong>:94--101.

  title = {{GPU} acceleration of {R}unge---{K}utta integrators},
  author = {Lawrence Matthew Murray},
  journal = {IEEE Transactions on Parallel and Distributed Systems},
  year = {2012},
  volume = {23},
  pages = {94--101},
  doi = {10.1109/TPDS.2011.61}
blog Latest
GPU Programming in the Cloud
How to develop on remote cloud instances, and a roundup of cloud service providers.

Lawrence Murray

22 Nov 22

GPU Programming in the Cloud
blog Related
Matrix Gradients of Scalar Functions
Understanding the building blocks of reverse-mode automatic differentiation.

Lawrence Murray

7 Nov 22

photography Next
Alpine Plateau
photography Previous
Being Different