Writing Parallel software Intro Why would you use parallelism From the software point of view 2 main targets o multiplexing different tasks on the same machine o making one heavy task faster o by running different subparts of it in parallel From the hardware point of view o do not waste available resources o make best value for money Net consequence:we need to find things to be done in parallel what find expect 6/46 S.Ponce-CERN
Writing Parallel software 6 / 46 S. Ponce - CERN Intro Threading Safety Solutions what find expect Why would you use parallelism ? From the software point of view 2 main targets multiplexing different tasks on the same machine making one heavy task faster by running different subparts of it in parallel From the hardware point of view do not waste available resources make best value for money Net consequence : we need to find things to be done in parallel
Writing Parallel software 花5 Finding parallelism Task parallelism Sum act on the work flow Measures o break the work in tasks Sum squares o run several concurrently Data parallelism datal Computex2 osplit data in pieces data2 Computex2 o run on several concurrently data3 Computex2 what find empect 7/46 S.Ponce-CERN
Writing Parallel software 7 / 46 S. Ponce - CERN Intro Threading Safety Solutions what find expect Finding parallelism Task parallelism act on the work flow break the work in tasks run several concurrently Measures Sum Sum squares σ Data parallelism split data in pieces run on several concurrently data1 data2 data3 Compute χ 2 Compute χ 2 Compute χ 2
Writing Parallel software Task parallelism Concept parallelism achieved through the partition of load into "baskets of work" consumed by a pool of resources. Implications o requires splitting the processing into blocks o and dealing with dependencies between them o well adapted to data processing frameworks Thread/process pools usually useful a pool a workers is created at start o and reused during all processing tasks are mapped to available workers what find expect 8/46 S.Ponce-CERN
Writing Parallel software 8 / 46 S. Ponce - CERN Intro Threading Safety Solutions what find expect Task parallelism Concept parallelism achieved through the partition of load into “baskets of work” consumed by a pool of resources. Implications requires splitting the processing into blocks and dealing with dependencies between them well adapted to data processing frameworks Thread/process pools usually useful a pool a workers is created at start and reused during all processing tasks are mapped to available workers
Writing Parallel software Task parallelism example Event reconstruction case o processing consists in running a bunch of algorithms o originally as a sequence ○I■0■○ onow as a dependency graph o using a thread pool and a scheduler mapping what can be done to available threads 010 what find expect 9/46 S.Ponce-CERN
Writing Parallel software 9 / 46 S. Ponce - CERN Intro Threading Safety Solutions what find expect Task parallelism example Event reconstruction case processing consists in running a bunch of algorithms originally as a sequence now as a dependency graph using a thread pool and a scheduler mapping what can be done to available threads
Writing Parallel software Data parallelism Concept parallelism achieved through the application of the same transformation to multiple pieces of data Implications o requires independent pieces of data o may have an impact on data structures o and potentially on memory Practically for our event processing example 时Hp 10/46 S.Ponce-CERN
Writing Parallel software 10 / 46 S. Ponce - CERN Intro Threading Safety Solutions what find expect Data parallelism Concept parallelism achieved through the application of the same transformation to multiple pieces of data Implications requires independent pieces of data may have an impact on data structures and potentially on memory Practically for our event processing example