Evaluation of Dataflow Programming Models for Electronic Structure Theory

TitleEvaluation of Dataflow Programming Models for Electronic Structure Theory
Publication TypeJournal Article
Year of Publication2018
AuthorsJagode, H., A. Danalis, R. Hoque, M. Faverge, and J. Dongarra
JournalConcurrency and Computation: Practice and Experience (CCPE): Special Issue on Parallel and Distributed Algorithms
Date Published05-2018
KeywordsCCSD, coupled cluster methods, dataflow, NWChem, OpenMP, parsec, StarPU, task-based runtime

Dataflow programming models have been growing in popularity as a means to deliver a good balance between performance and portability in the post-petascale era. In this paper, we evaluate different dataflow programming models for electronic structure methods and compare them in terms of programmability, resource utilization, and scalability. In particular, we evaluate two programming paradigms for expressing scientific applications in a dataflow form: (1) explicit dataflow, where the dataflow is specified explicitly by the developer, and (2) implicit dataflow, where a task scheduling runtime derives the dataflow using per-task data-access information embedded in a serial program. We discuss our findings and present a thorough experimental analysis using methods from the NWChem quantum chemistry application as our case study, and OpenMP, StarPU, and PaRSEC as the task-based runtimes that enable the different forms of dataflow execution. Furthermore, we derive an abstract model to explore the limits of the different dataflow programming paradigms.

Project Tags: 
External Publication Flag: