Philipp Schaad, Timo Schneider, Tal Ben-Nun, Alexandros Nikolaos Ziogas, Alexandru Calotoiu, Torsten Hoefler:
FuzzyFlow: Leveraging Dataflow To Find and Squash Program Optimization Bugs
(In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC'23), Association for Computing Machinery, ISBN: 979-8-400701-09-2, Nov. 2023)
The current hardware landscape and application scale is driving performance engineers towards writing bespoke optimizations. Verifying such optimizations, and generating minimal failing cases, is important for robustness in the face of changing program conditions, such as inputs and sizes. However, isolation of minimal test-cases from existing applications and generating new configurations are often difficult due to side effects on the system state, mostly related to dataflow. This paper introduces FuzzyFlow: a fault localization and test case extraction framework designed to testprogram optimizations. We leverage dataflow program representations to capture a fully reproducible system state and area-of-effect for optimizations to enable fast checking for semantic equivalence. To reduce testing time, we design an algorithm for minimizing test inputs, trading off memory for recomputation. We demonstrate FuzzyFlow on example use cases in real-world applications where the approach provides up to 528 times faster optimization testing and debugging compared to traditional approaches.
@inproceedings{, author={Philipp Schaad and Timo Schneider and Tal Ben-Nun and Alexandros Nikolaos Ziogas and Alexandru Calotoiu and Torsten Hoefler}, title={{FuzzyFlow: Leveraging Dataflow To Find and Squash Program Optimization Bugs}}, year={2023}, month={Nov.}, booktitle={Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC'23)}, publisher={Association for Computing Machinery}, isbn={979-8-400701-09-2}, source={http://www.unixer.de/~htor/publications/}, }
