CORTEXA
← Browse
arxiveess.SYcs.LG2026-07-24

Trajectory-Regularized Stochastic Optimal Control via KL Divergence

Mintae Kim, Koushil Sreenath

We introduce trajectory-regularized stochastic optimal control (TRSOC), which augments standard stochastic optimal control (SOC) with a Kullback--Leibler (KL) divergence between controlled and reference trajectory distributions. Using Girsanov's theorem, the trajectory KL reduces to a quadratic drift mismatch penalty, yielding a modified running cost that preserves the dynamic programming (DP) structure. We derive the corresponding Hamilton--Jacobi--Bellman (HJB) equation and characterize the optimal policy. In the linear-quadratic (LQ) setting, the formulation admits a closed-form solution with an augmented control cost. Experiments show that the regularization parameter induces a trade-off between performance-driven and reference-preserving behavior, including cases with reference dynamics learned from offline data.

View free PDFSource page

Related papers

arxivcs.LGeess.SY2026-07-24

Variance-Reduced Q-Learning over Static and Time-Varying Networks

Sreejeet Maity, Feng Zhu, Aritra Mitra, Robert W. Heath

We investigate a decentralized reinforcement learning problem involving multiple agents that interact with the same Markov Decision Process (MDP). The agents can exchange information over a network to collectively learn the optimal state-action value function. For this setting, w…

View free PDFSource page
arxivcs.LGeess.SY2026-07-31

Assessing the Generalization of Graph Neural Networks for Fault Location Across Increasing Distributed Energy Resource Penetration Levels

Burak Karabulut, Olayiwola Arowolo, Carlo Manna, Chris Develder, Jochen L. Cremer

Accurate fault location is critical for distribution network reliability. However, increasing distributed energy resource (DER) penetration complicates fault location due to intermittent generation and bidirectional power flows that reshape fault signatures. Spatio-Temporal Graph…

View free PDFSource page
arxiveess.SY2026-07-23

Certified Stochastic Control via Covariance Steering with Pick-to-Learn

Chun-Wei Kong, Zachary Donovan, Morteza Lahijanian, Jay McMahon

We present CS-P2L, a framework coupling covariance steering (CS) with the Pick-to-Learn (P2L) meta-algorithm for certified controller synthesis over high-fidelity stochastic simulators. The method iteratively evaluates policies on simulator rollouts, tightens surrogate constraint…

View free PDFSource page
arxivmath.OCeess.SY2026-07-31

Node-Wise Dynamic Optimal Control for Evolutionary Games on General Multilayer Networks

Rio Aurachman, Giuliano Punzo

Promoting cooperative behaviour amongst decision makers has key implications for the long term sustainability of social systems. Incentives can promote cooperation in situations where defection is more favourable. Previous research has identified optimal decentralised incentives…

View free PDFSource page