Numerical Approximations for Minimax Markov Control Problems

Wednesday, May 9, 2018 - 3:00pm - 3:30pm
Lind 305
Tomás Prieto Rumeau (Universidad Nacional de Educación a Distancia (UNED))
We study a minimax control problem with general state and action spaces under the discounted cost optimality criterion. We are interested in approximating numerically the value function and an optimal strategy of this general discounted minimax control problem. To do so, we provide an approximating minimax control model with finite state and action spaces, and hence computationally tractable. The discretization procedure of the state space is related to a probabilistic criterion based on the Wasserstein distance, while the action spaces are discretized with a geometric criterion, based on the Hausdorff metric. These results can be extended to two-player zero-sum Markov games.
MSC Code: 
90C40; 91A15