Task Parallelism and Data Distribution: An Overview of Explicit Parallel Programming Languages

Dounia Khaldi (1) , Pierre Jouvelot (1) , Corinne Ancourt (1) , François Irigoin (1)

1 CRI - Centre de Recherche en Informatique

Programming parallelmachines as effectively as sequential ones would ideally require a language that provides high-level programming constructs to avoid the programming errors frequent when expressing parallelism. Since task parallelism is considered more error-prone than data parallelism, we survey six popular and efficient parallel language designs that tackle this difficult issue: Cilk, Chapel, X10, Habanero-Java, OpenMP and OpenCL. Using as single running example a parallel implementation of the computation of the Mandelbrot set, this paper describes how the fundamentals of task parallel programming, i.e., collective and point-to-point synchronization and mutual exclusion, are dealt with in these languages. We discuss how these languages allocate and distribute data over memory. Our study suggests that, even though there are many keywords and notions introduced by these languages, they all boil down, as far as control issues are concerned, to three key task concepts: creation, synchronization and atomicity. Regarding memory models, these languages adopt one of three approaches: shared memory, message passing and PGAS (Partitioned Global Address Space). The paper is designed to give users and language and compiler designers an upto- date comparative overview of current parallel languages.

Domaines: Calcul parallèle, distribué et partagé [cs.DC]; Parallélisation

Dounia Khaldi, Pierre Jouvelot, Corinne Ancourt, François Irigoin. Task Parallelism and Data Distribution: An Overview of Explicit Parallel Programming Languages. 25th International Workshop on Languages and Compilers for Parallel Computing (LCPC 2012), Sep 2012, Tokyo, Japan. pp 174-189, ⟨10.1007/978-3-642-37658-0_12⟩. ⟨hal-00742536⟩