Analytical and numerical solutions to ergodic control problems arising in environmental management.

Yoshioka, Hidekazu; Tsujimura, Motoh; Yaegashi, Yuta

Environmental management optimizing a long‐run objective is an ergodic control problem whose resolution can be achieved by solving an associated non‐local Hamilton–Jacobi–Bellman (HJB) equation having an effective Hamiltonian. Focusing on sediment storage management as a modern engineering problem, we formulate, analyze, and compute a new ergodic control problem under discrete observations: a simple but non‐trivial mathematical problem. We give optimality and comparison results of the corresponding HJB equation having unique non‐smoothness and discontinuity. To numerically compute HJB equations, we propose a new fast‐sweep method resorting to neither pseudo‐time integration nor vanishing discount. The optimal policy and the effective Hamiltonian are then computed simultaneously. Convergence rate of numerical solutions is computationally analyzed. An advanced robust control counterpart where the dynamics involve uncertainties is also numerically considered.

ENVIRONMENTAL management; ANALYTICAL solutions; ROBUST control; STOCHASTIC control theory; INDUSTRIAL engineering

Mathematical Methods in the Applied Sciences, 2022, Vol 45, Issue 13, p8329

0170-4214

Academic Journal

10.1002/mma.8338