Topology-Driven Solver Selection for Stochastic Shortest Path MDPs via Explainable Machine Learning

Monday, 12 May 2025·
Mathieu Gravel
Jaël Champagne Gareau
Jaël Champagne Gareau
Abstract
Selecting optimal solvers for complex AI tasks grows increasingly difficult as algorithmic options expand. We address this challenge for Stochastic Shortest Path Markov Decision Processes (SSP-MDPs) — a core model for robotics navigation, autonomous system planning, and stochastic scheduling — by introducing a topology-driven solver selection framework. First, we identify and empirically validate topological features — including strongly connected components, goal-state ratio, goal eccentricity (i.e., maximal distance to a goal), and average actions per state — that critically influence solver performance across synthetic and real-world SSP-MDPs. Using these insights, we propose the first classifier able to predict the fastest MDP solver for a given instance, achieving over 64% accuracy on diverse benchmarks. Counterfactual explainability analysis further clarifies how these features govern solver efficiency. By directly linking topological structures to algorithmic performance, our work streamlines solver selection while enhancing computational efficiency, offering a principled approach to MDP optimization.
Type
Publication
Proceedings of the Canadian Conference on Artificial Intelligence
publications
Jaël Champagne Gareau
Authors
Postdoctoral Researcher in Computer Science
I am currently a postdoctoral researcher in computer science at Université TÉLUQ, where my research focuses on speeding up the conversion of integer and floating-point numbers into decimal strings. During my doctoral studies, I designed algorithms and data structures that leverage modern computer architectures to solve large instances of Markov decision processes (MDPs). In my master’s research, I developed routing algorithms for electric vehicles aimed at determining the optimal path between two points while minimizing travel time (including driving, charging, and expected waiting time at charging stations).

Citation