Transcription of Optimizing Parallel Reduction in CUDA - Nvidia
{{id}} {{{paragraph}}}
Example: bachelor of science
Optimizing Parallel Reduction in CUDA - Nvidia
Optimizing Parallel Reduction in cuda . Mark Harris Nvidia Developer Technology Parallel Reduction Common and important data Parallel primitive Easy to implement in cuda . Harder to get it right Serves as a great optimization example We'll walk step by step through 7 different versions Demonstrates several important optimization strategies 2. Parallel Reduction Tree-based approach used within each thread block 3 1 7 0 4 1 6 3. 4 7 5 9. 11 14. 25. Need to be able to use multiple thread blocks To process very large arrays To keep all multiprocessors on the GPU busy Each thread block reduces a portion of the array But how do we communicate partial results between thread blocks?
Reductions have very low arithmetic intensity 1 flop per element loaded (bandwidth-optimal) Therefore we should strive for peak bandwidth Will use G80 GPU for this example 384-bit memory interface, 900 MHz DDR 384 * 1800 / 8 = 86.4 GB/s
Tags:
Information
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document: