The primary goal of the Evolvable Methods for Benchmarking Realism and Community Engagement (EMBRACE) project is to find the most rational way to design and develop forward-looking benchmarks followed by correctly interpreting their results. This concept has become difficult over time because the performance engineering side of the scientific computing community is broadening, its applications are diverse, and the hardware platforms are quickly evolving. The aim of the EMBRACE project then is to facilitate a technical and reasoned debate about benchmarking, and to keep this debate alive over time.
EMBRACE is a collaboration between ICL/UTK and Georgia Tech. ICL’s contribution includes expertise in benchmark design and implementation, and community engagement. In November 2015, an EMBRACE Birds-of-a-Feather session was held at the SC15 conference in Austin, TX. The reception was very positive and the need for reimagining the benchmarking process, creation, and interpretation was clearly voiced by the attendees. A workshop for IPDS17 is upcoming and was met with enthusiastic response as a forum for discussion about the community’s need for performance benchmarking.
Find out more at https://sites.google.com/site/wsembrace/
In Collaboration With
- Georgia Tech University