Common Steps to Parallelization Partitioning d ou U i O L UE m Po P1 Po P1 0. es Po P1 n Qo-- g r t P2 P3 P2 P3 R2 Pe i n n Sequential Tasks Execution Parallel computation Processors Units Program 11 ②nVIDIA ILLINOIS
11 Common Steps to Parallelization
Patterns for Parallelizino Proarams 4 Design Spaces Algorithm Expression Software Construction Finding Concurrency Supporting Structures Expose concurrent Code and data structuring tasks patterns Algorithm Structure Implementation Mechanisms Map tasks to units of Low level mechanisms used execution to exploit to write parallel programs parallel architecture Patterns for Parallel Programming.Mattson, Sanders,and Massingill (2005). ②nVIDIA ILLINOIS
12 Patterns for Parallelizing Programs