%0 Conference Paper %B ISC High Performance %D 2019 %T MagmaDNN: Towards High-Performance Data Analytics and Machine Learning for Data-Driven Scientific Computing %A Daniel Nichols %A Natalie-Sofia Tomov %A Frank Betancourt %A Stanimire Tomov %A Kwai Wong %A Jack Dongarra %X In this paper, we present work towards the development of a new data analytics and machine learning (ML) framework, called MagmaDNN. Our main goal is to provide scalable, high-performance data analytics and ML solutions for scientific applications running on current and upcoming heterogeneous many-core GPU-accelerated architectures. To this end, since many of the functionalities needed are based on standard linear algebra (LA) routines, we designed MagmaDNN to derive its performance power from the MAGMA library. The close integration provides the fundamental (scalable high-performance) LA routines available in MAGMA as a backend to MagmaDNN. We present some design issues for performance and scalability that are specific to ML using Deep Neural Networks (DNN), as well as the MagmaDNN designs towards overcoming them. In particular, MagmaDNN uses well established HPC techniques from the area of dense LA, including task-based parallelization, DAG representations, scheduling, mixed-precision algorithms, asynchronous solvers, and autotuned hyperparameter optimization. We illustrate these techniques and their incorporation and use to outperform other frameworks, currently available. %B ISC High Performance %I Springer International Publishing %C Frankfurt, Germany %8 2019-06 %G eng %R https://doi.org/10.1007/978-3-030-34356-9_37 %0 Conference Paper %B Practice and Experience in Advanced Research Computing (PEARC ’19) %D 2019 %T OpenDIEL: A Parallel Workflow Engine and DataAnalytics Framework %A Frank Betancourt %A Kwai Wong %A Efosa Asemota %A Quindell Marshall %A Daniel Nichols %A Stanimire Tomov %B Practice and Experience in Advanced Research Computing (PEARC ’19) %I ACM %C Chicago, IL %8 2019-07 %G eng