MDP

Topology-Driven Solver Selection for Stochastic Shortest Path MDPs via Explainable Machine Learning

Selecting optimal solvers for complex AI tasks grows increasingly difficult as algorithmic options expand. We address this challenge for Stochastic Shortest Path Markov Decision …

Mathieu Gravel

Résolution efficace de processus décisionnels de Markov par l'exploitation d'approches structurelles et algorithmiques tirant parti de l'architecture moderne des ordinateurs

Cette thèse présente des contributions en planification automatique sous incertitude, un domaine de l'intelligence artificielle. Ce domaine s'intéresse principalement au calcul de …

avatar
Jaël Champagne Gareau

Towards Topologically Diverse Probabilistic Planning Benchmarks

Markov Decision Processes (MDPs) are often used in Artificial Intelligence to solve probabilistic sequential decision-making problems. In the last decades, many probabilistic …

avatar
Jaël Champagne Gareau

Cache-Efficient Dynamic Programming MDP Solver

Automated planning research often focuses on developing new algorithms to improve the computational performance of planners, but effective implementation can also play a …

avatar
Jaël Champagne Gareau

pcTVI: Parallel MDP Solver Using a Decomposition Into Independent Chains

Markov Decision Processes (MDPs) are useful to solve real-world probabilistic planning problems. However, finding an optimal solution in an MDP can take an unreasonable amount of …

avatar
Jaël Champagne Gareau
Markov Decision Processes featured image

Markov Decision Processes

This project aimed at finding different ways to improve (SSP-)MDP planners performance when considering computer architectures (e.g., cache-memory, parallelism)

Cache-Efficient Memory Representation of Markov Decision Processes

Research in automated planning typically focuses on the development of new or improved algorithms. Yet, an equally important but often overlooked topic is that of how to actually …

avatar
Jaël Champagne Gareau

Citation