CS Paper Radar

Power Setpoint Tracking for Large-Scale EV Charging: Transformer-Constrained Charging Policy Learning with Self-Tuning Constraint Prices

Daniyal Sajedi-Hosseini, Yoshihiko Fujisawa, Shubham Singh, Lei Zhou, Katsuki Fujisawa, Sebastien Gros, Mazaher Karimi, Xun Shen

cs.LG eess.SY ·submitted 2026-11-19 11:51 UTC · v1

Abstract

In power setpoint tracking (PST), an operator follows a purchased charging profile without overloading shared transformers or undercharging vehicles. PST is cast as a constrained Markov decision process that minimizes tracking error subject to overload and mean user-satisfaction constraints. Transformer-Constrained Charging Policy Learning (TC-CPL) extends soft actor-critic with proportional-integral Lagrange-multiplier updates from measured violations, a residual on the incumbent dispatcher that is warm-started from its demonstrations, and a transformer-aware encoder shared by all ports. It observes no departure times or states of charge. Simulations (five seeds, 100 paired days) compare it with the incumbent, Round-Robin. On a 600-port, 122-substation district, raw overload falls from 3.59 to 0.0017 kWh/day (overloaded seed-days from 77% to 0.4%), and absolute tracking error falls by 27%. Delivered energy rises by 16%, and satisfaction rises from 0.959 to 0.989. On a 42-kW transformer with household load, overload falls from 1.86 to 0.0014 kWh/day and satisfaction rises from 0.974 to 0.985, but absolute tracking error is 22% higher. Against hand-set fixed multipliers, self-tuning is statistically indistinguishable on the district. On the single transformer, it raises satisfaction by 0.011 at similar overload, but a short sweep found a better-serving fixed pair. The overload multipliers stay below their cap.

Comment
13 pages, 7 figures, 6 tables. Submitted to IEEE Transactions on Transportation Electrification

Closest papers

Nearest neighbours by meaning across the whole index.

Price-Optimized EV and Heat-Pump Scheduling Can Exceed Uncoordinated Feeder Peaks

eess.SY ·2026-10-05 ·Tatjana Hein, Lukas P. Wagner, Alex Bernhard, Felix Ocker
publishedcode/data similarity 0.65
Abstract · Accepted at 2026 IEEE IES ONCON

Electric vehicles and heat pumps add large, time-flexible loads to low-voltage feeders. When each household independently minimizes its own charging cost against the same electricity price, this flexible demand piles into the cheapest hours, and the resulting synchronization can stress the feeder more than uncoordinated operation does. This work quantifies that effect on a rural low-voltage feeder with photovoltaics (97 buses, 250 kVA transformer) in 913 simulation runs that compare seven strategies across four seasons, device penetrations of up to 90 %, 208 price weeks from 2022-2025, and heterogeneous heat pumps. At 30 % penetration of each device, this decentralized cost minimization drives the transformer to 253 % of rated capacity, more than three times the peak of non-optimized Fixed-random charging with the same mobility and charged energy, and 478 % with electric vehicles alone at 90 % penetration, with undervoltage at the far end of the longest feeder arm. It exceeds Fixed-random and Fixed-times charging in every winter, spring, and autumn price week, and each 30 pp of heat-pump penetration raises its peak by about 110 pp, twelve times as much as without optimization. Centralized peak minimization removes all demand-driven violations. In the heat-pump-free summer case at 60 % photovoltaics, midday reverse power flow sets a transformer floor of 128.9 % that no strategy undercuts, since no commuting electric vehicle is at home at the export peak. With a time-variable grid fee added to the spot price, the weekly peak of decentralized cost minimization falls into the reduced-fee window in 99 of the 104 fee-active price weeks, compared with 53 without the fee, while keeping at least 89.8 % of its height, so the fee relocates rather than removes the synchronization. The simulation and optimization code is available at https://github.com/lukas-wagner/SynchronizationEffectsAnalysis.

0.64

Physics-Informed Graph-Based Safe RL with Constraint-Specific Critics for Community Battery Coordination in Distribution Network

cs.AI eess.SYmath.OC ·2026-10-24 ·Chenghao Huang, Yue Yang, Hao Wang
top venue similarity 0.62
Abstract

High penetrations of distributed energy resources (DERs) and fast-varying electric vehicle (EV) charging intensify voltage and line-limit violations in distribution networks (DNs), making safe, low-cost operation increasingly challenging. This paper proposes a physics-informed safe deep reinforcement learning (DRL) framework for coordinating community battery energy storage systems to mitigate constraint violations while minimizing operating cost. To represent nonlocal spatiotemporal interactions, we develop a dual-level physics-informed graph representation in which line impedance and capacity shape spatial information propagation, while power-balance, voltage-profile, and flow-reconstruction losses regularize the latent state toward control-relevant physical consistency. Building on this representation, we develop Lagrangian Dedicated-Critic PPO (LDCPPO), which implements constraint-specific value decomposition: independent reward and cost critics preserve heterogeneous voltage- and line-loading-related learning signals and combine their advantages only during the Lagrangian policy update. Case studies on DNs with high rooftop photovoltaic penetration and EV charging demonstrate that the proposed method reduces the key voltage-violation degree by up to 80.5% compared with the tested baselines, while also achieving the lowest voltage-violation count and line-overload degree with competitive operating cost.

0.31

Distributionally Robust Chance-Constrained Reinforcement Learning for Home Energy Management under Electric Vehicle Uncertainty

eess.SY ·2026-10-18 ·Meng Yuan, Ye Wang, Yi Mei, Ramesh Rayudu, Alan Brent +2 more
similarity 0.62
Abstract

The electrification of residential energy systems and adoption of electric vehicles (EVs) create demand-side flexibility. However, random driving behaviour makes it difficult to ensure EV readiness at departure and maintain thermal comfort. To address this, we formulate residential scheduling as a distributionally robust (DR) chance-constrained Markov decision process, whose 2-Wasserstein ambiguity set guards against tail risk and distribution shift in EV behaviour. The intractable DR chance constraint is then replaced by a sufficient tightened expectation constraint under the nominal distribution. The resulting problem is solved by a Lagrangian soft actor--critic with distributional cost critics, and an online boundary guard enforces EV reachability and thermal comfort within the actuator limits at every step. Five controllers are compared over one year in Wellington, New Zealand, under a degraded forecast. The proposed controller is the cheapest controller that meets the EV target on every day and both chance constraints under forecast error and random driving behaviour. Compared with the rule-based baseline, the only other controller to do so, it lowers the annual cost by 8.6% and the comfort violation hours by 69%. The ablation study confirms that the boundary guard ensures pointwise feasibility within the actuator limits, and the DR chance constraint reduces tail risk.

0.16

Electric Vehicle Scheduling and Carbon-Aware Energy Dispatch for Charging Stations

eess.SY ·2026-10-27 ·Fulong Yao, Yiming Xu, Maurizio Albano, Liana Cipcigan, Naeima Hamed +2 more
similarity 0.61
Abstract

Electric vehicle (EV) charging stations integrating photovoltaic (PV) generation, battery storage, and bidirectional grid exchange must coordinate access to limited chargers with energy supply while considering both energy cost and carbon emissions. This paper proposes a solver-free greedy heuristic (SFGH) for dynamic vehicle scheduling (VS) and a twin delayed deep deterministic policy gradient (TD3) controller for carbon-aware energy dispatch (ED). SFGH assigns EVs according to reductions in service delays, and TD3 controls battery operation to balance energy costs and carbon emissions while meeting the resulting charging demand. The model allows both PV and battery exports, accounting for export revenue and carbon credits. Simulations on year-long case studies show that SFGH--TD3 achieves the lowest accumulated service delay, energy cost, and carbon emissions among the evaluated heuristic and multi-agent deep reinforcement learning (DRL) configurations.

0.24

Who Gets the Grid Capacity? Allocating Dynamic Access Among Multiple Virtual Power Plants

eess.SY ·2026-11-16 ·Nakul Sreekanth, Jun He, Andrew L. Liu, S. Sivaranjani
similarity 0.60
Abstract

Virtual power plants (VPPs) trade in the same wholesale market and share distribution lines and transformers, and uncoordinated, profit-maximizing VPPs can push a shared transformer past its thermal limit or drive a feeder voltage out of band. The utility, which only observes the front-of-the-meter net injection at each bus, must keep the network safe from that net injection alone. We allocate a 24-hour active and reactive operating envelope to each VPP by a Benders decomposition: the utility sets a trial envelope, each VPP solves its private convex portfolio problem, and the returned value and dual gradient become supporting cuts that rebuild its value function while its schedule, state, and cost stay private. The envelope carries the transformer's thermal state across hours, bounds a joint conditional value-at-risk over forecast uncertainty, and is re-optimized each hour with the current hour committed. On a reduced IEEE-13 feeder with real load and prices, an active-power-only implementation lowers the transformer's peak-temperature CVaR from 254 to 97\,$^\circ$C at a 28\% value give-up and holds the transformer below its limit where nameplate access breaches it.

0.35

Learned Control Variates for Rare Grid-Outage Estimation at Electric Vehicle Charging Stations

cs.AI cs.CEeess.SYstat.ML ·2026-10-19 ·Sulyman Iyanda, Mansur Arief
similarity 0.60
Abstract

Public charging of electric vehicles (EVs) adds a large and synchronized load to the distribution feeders. In most networks, it is rare to overload a feeder at the same time. When it does happen, the consequences can be severe: an overloaded feeder stresses its transformers and can trigger cascading outages across a city. Planners who design for high reliability therefore need to estimate very small outage probabilities. To that end, plain Monte Carlo estimation with an expensive grid simulator can require a prohibitively large number of runs for this task. To reduce the number of runs, we propose a control variate (CV) built from a learned classifier of the outage, trained on cheap observable features such as temperature and load forecasts. We show that for any binary learner, the variance reduction is an explicit function of its recall and false-positive rate. Furthermore, we show that control variate based on a Gaussian proxy of the load loses its effect as outages become rarer, while a learner with non-vanishing precision keeps removing a fixed fraction of the variance even in the extreme rare-event regime. We verify these results in numerical experiments using a feeder-overload simulator across three orders of magnitude of outage probability and obtain that even weak learner with a single feature can remove a quarter of the variance, while a boosted-tree learner is able to remove about 60%. We then apply the estimator to the feeder network of Surabaya, Indonesia, in which the Gaussian load model leaves every feeder three to seven times the one-day-in-ten-years blackout target. At the same simulation budget, planning the reserve with the learned CV and a 95% confidence limit reduces the city-wide blackout days by a third compared with Monte Carlo. These results show that learned control variates can help planners design distribution grids that stay reliable against rare outages.

0.20

Learning to Modulate, Not to Cycle: Soft Actor---Critic Recovers Inverter-Style Heat-Pump Control

cs.LG cs.AI ·2026-08-10 ·Faizan Ahmed, Aniket Dixit, James Brusey
published similarity 0.59
Abstract · 9 pages, 4 figures, Accepted at UKCI 2026, Will be published in Springer

On--off cycling is the main cause of compressor wear in residential heat pumps, yet reinforcement learning (RL) controllers for buildings typically optimise only energy cost and thermal comfort, ignoring how much the learned policy cycles. We add a levelised compressor-wear term to the control reward and study how the resulting behaviour depends on the RL algorithm. Training Soft Actor---Critic (SAC) and Proximal Policy Optimisation (PPO) on an identical Markov decision process for the BOPTEST bestest hydronic heat pump case, we find that SAC learns a continuous modulation policy that keeps the compressor permanently engaged---the operating principle of an inverter-driven heat pump---achieving zero start-ups per day, whereas PPO collapses to bang-bang control that cycles more than the baseline. On the BOPTEST emulator the SAC policy cuts thermal discomfort by up to 90.7% for an 11.5% cost increase, while eliminating all baseline cycling.

0.25

Prospective Action-Resource Graph Multi-Agent Reinforcement Learning for Electric HGV Fleets under Shared Charging Infrastructure

eess.SY ·2026-11-09 ·Yiming Xu, Fulong Yao, Maurizio Albano, Rigel Gjomemo, Liana Cipcigan
benchmark similarity 0.59
Abstract

Electric heavy goods vehicle (eHGV) fleet coordination requires each vehicle to choose driving, charging and resting actions whose consequences depend on shared infrastructure. Existing multi-agent reinforcement learning (MARL) methods mainly represent current states, leaving action-specific futures and resource interactions to be learned indirectly. We develop Horizon-Preview and Graph-Coordinated Proximal Policy Optimisation (HGC-PPO), which integrates horizon preview and candidate-resource graph coordination into the PPO decision architecture. Horizon preview represents each legal action through its short-horizon operational consequences. Graph message passing then updates these candidates through station, charger-type and time-slot resources shared across the fleet. On the 794km Folkestone-Glasgow task, HGC-PPO achieved the lowest mean charging cost among five RL methods at £504.32 per vehicle, with a fleet completion time of 24.920h. It also completed the task 1.763h faster and cost £36.51 less per vehicle than a replay-verified finite-budget MILP benchmark. Across six unseen routes and fleet sizes from 5 to 20 vehicles, HGC-PPO delivered the lowest macro-average completion time, charging cost and charging frequency among the RL methods. A 2 by 2 ablation showed that the full preview-graph architecture performed best across all four operational metrics. These results show that prospective action information and fleet-wide resource coordination improve eHGV decisions under charging and driver-hours constraints.

0.22