TY - GEN
T1 - Profiling a Task-Based Molecular Dynamics Application with a Data Science Approach
AU - Asch, Christian
AU - Schnorr, Lucas Mello
AU - Meneses, Esteban
N1 - Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2026.
PY - 2026
Y1 - 2026
N2 - Charm++ is a parallel programming framework based on task-driven execution and global object references. It has been used successfully in various high-performance computing (HPC) applications, including the molecular dynamics simulator NAMD. While Charm++ includes built-in support for performance tracing and visualization through its Projections tool, the existing system offers limited extensibility and has no support for modern data science workflows. This work presents a new visualization and analysis pipeline for Charm++ trace data that emphasizes modularity, openness, and composability. Our toolchain leverages standard scripting languages and data formats - producing output in CSV and Parquet formats - to facilitate integration with data analysis ecosystems. We demonstrate the effectiveness of this approach using LeanMD, a proxy application derived from NAMD, and highlight specific types of custom visualizations that are difficult to achieve with Projections. Our system enables custom visualizations and streamlined analysis of chare-level execution behavior, offering researchers and tool developers improved capabilities for understanding program performance and identifying load imbalance. We discuss the architecture of our tool, its application to real-world traces, and potential extensions for other task-based frameworks.
AB - Charm++ is a parallel programming framework based on task-driven execution and global object references. It has been used successfully in various high-performance computing (HPC) applications, including the molecular dynamics simulator NAMD. While Charm++ includes built-in support for performance tracing and visualization through its Projections tool, the existing system offers limited extensibility and has no support for modern data science workflows. This work presents a new visualization and analysis pipeline for Charm++ trace data that emphasizes modularity, openness, and composability. Our toolchain leverages standard scripting languages and data formats - producing output in CSV and Parquet formats - to facilitate integration with data analysis ecosystems. We demonstrate the effectiveness of this approach using LeanMD, a proxy application derived from NAMD, and highlight specific types of custom visualizations that are difficult to achieve with Projections. Our system enables custom visualizations and streamlined analysis of chare-level execution behavior, offering researchers and tool developers improved capabilities for understanding program performance and identifying load imbalance. We discuss the architecture of our tool, its application to real-world traces, and potential extensions for other task-based frameworks.
KW - Charm++
KW - Performance Analysis
KW - Trace Visualization
UR - https://www.scopus.com/pages/publications/105047318771
U2 - 10.1007/978-3-032-24923-4_10
DO - 10.1007/978-3-032-24923-4_10
M3 - Contribución a la conferencia
AN - SCOPUS:105047318771
SN - 9783032249227
T3 - Communications in Computer and Information Science
SP - 140
EP - 155
BT - High Performance Computing - 12th Latin American High Performance Computing Conference, CARLA 2025, Proceedings
A2 - Brown, Kevin
A2 - Felker, Kyle
A2 - Meneses, Esteban
A2 - Azevedo Gomes, Antônio Tadeu
A2 - Monsalve Diaz, José Manuel
A2 - Rasmussen, Katherine
PB - Springer Science and Business Media Deutschland GmbH
T2 - 12th Latin American Conference on High Performance Computing, CARLA 2025
Y2 - 22 September 2025 through 26 September 2025
ER -