Approximate solution of the Hamilton-Jacobi-Bellman equation

The Hamilton-Jacobi-Bellman (HJB) equation, as a notable approach obtained from dynamic programming, is widely used in solving optimal control problems that results in a feedback control law. In this study, the HJB equation is first transformed into the Convection-Diffusion (CD) equation by adding a viscosity coefficient. Then, a novel numerical method is presented to solve the corresponding CD equation and to obtain a viscosity solution of the HJB. The proposed approach encompasses two well-known methods of Finite Volume Method (FVM) and Algebraic Multigrid (AMG). The former as a reliable method for solving parabolic PDEs and the latter as a powerful tool for acceleration. Finally, numerical examples illustrate the practical performance of the proposed approach.

کلیدواژه ها:

Optimal control problems ، Hamilton-Jacobi-Bellman (HJB) equation ، convection-diffusion equation ، finite volume method ، algebraic multigrid method