CS Paper Radar

Stochastic Sequential Feedback Optimization for Wind Farm Control under Time-Varying Inflow

Shijie Huang, Sergio Grammatico

eess.SY math.OC ·submitted 2026-10-02 21:06 UTC · v1
benchmark

Abstract

We consider steady-state optimization of nonlinear dynamical systems under time-varying stochastic operating conditions, where the objective is an expected-value function over the current operating-condition distribution, so that changes in the distribution induce a moving stochastic optimum. To address this problem, we propose stochastic sequential feedback optimization (S2FO), which combines projected feedback-gradient updates with sequential sensitivity estimates obtained by linearizing the plant at realized stochastic operating conditions. We analyze the closed-loop performance of S2FO through expected dynamic regret, instantaneous tracking in expectation, and almost-sure convergence under diminishing step sizes. We then apply the method to wind farm power maximization under time-varying stochastic inflow. Simulations on a benchmark layout and on a realistic offshore wind farm show that S2FO improves average power generation when persistent wake interactions are present, and that its advantage decreases as wind-direction variability increases.

Closest papers

Nearest neighbours by meaning across the whole index.

Hybrid Sequential Feedback Optimization for Wind Farm Power Maximization

eess.SY math.OC ·2026-09-15 ·Shijie Huang, Sergio Grammatico
published similarity 0.72
Abstract · Accepted to the 65th IEEE Conference on Decision and Control (CDC 2026)

This paper considers feedback optimization for optimal steady-state operation of nonlinear discrete-time systems when the steady-state input-output map and its sensitivity are expensive to compute. We propose a hybrid extension of sequential feedback optimization (SFO) that augments the model-based SFO gradient with correction terms through a convex combination with summable diminishing weights. Two variants are studied: one based on recursive least-squares (RLS) sensitivity estimation, and another on extremum seeking control (ESC) gradient estimation. Under contractivity and smoothness assumptions, we show that both hybrid schemes preserve the convergence of SFO to a neighborhood of the optimal steady state. The proposed methods are validated through a wind farm power maximization problem using a medium-fidelity model, demonstrating improved early transient performance compared to pure SFO.

0.36

Noise Steering: Exploiting Wake Steering and Acoustic Directivity for Noise-Constrained Wind Farm Control via Reinforcement Learning

cs.AI eess.SYphysics.ao-phphysics.flu-dyn ·2026-10-27 ·Martín de Frutos, Baptiste Corban, Claire Bizon Monroc, Ana Bušić, Donatien Dubuc +2 more
similarity 0.61
Abstract · 17 pages, 11 figures

Existing noise mitigation strategies for wind farms usually consist in reducing turbines power output, without accounting for the wake interactions between them and the noise emission directivity. This leads to over-conservative policies and unexploited wind power. Yet, turbine yaw can simultaneously affect wake interactions and the direction of noise emission, offering an additional degree of freedom for farm-level noise control. We therefore propose Noise Steering, a model-free reinforcement learning (RL) strategy that jointly controls turbine yaw angles and power setpoints to maximise farm power while satisfying a local noise constraint in a defined region. To enable training at a reduced computational cost, a low-fidelity acoustic model is coupled with the steady-state FLORIS simulator. The RL agent effectively learns how to redirect wakes and noise directivity away from the protected region while redistributing power across the farm. On a six-turbine test farm, the policy satisfies the 40 dB noise constraint throughout the full range of turbulent winds, with an average power deficit of only 2% relative to greedy unimpeded control, and up to 7.7% at high wind speeds. In comparison, the industry-standard noise-reduced operation (NRO) baseline here generates an average power loss of 17%. When deployed in the higher-fidelity FASTFarm simulator, the policy largely retains its performance under steady and turbulent inflow, despite differences in simulation fidelity. These results demonstrate the potential of combining yaw control and power derating through RL to improve the power-noise trade-off in wind farm operation.

0.20

Offline Reinforcement Learning for Wind Farm Control: A Wind Tunnel Study under Dynamic Wind Directions

cs.LG ·2026-09-11 ·Yuhan Su, Hongyang Dong, Simone Tamaro, Filippo Campagnolo, Carlo L. Bottasso +1 more
benchmark similarity 0.61
Abstract

This paper addresses the wind farm power maximization problem in the presence of wind direction changes. Specifically, a model-free Modified Twin Delayed Deep Deterministic Policy Gradient with Behavior Cloning (MTD3-BC) algorithm is proposed to tackle this task through yaw control under varying wind direction conditions. MTD3-BC is an offline reinforcement learning (RL) algorithm that aims to infer good behavior from only a precollected offline dataset. Additionally, to ensure smooth and moderate yaw adjustments, a new action consistency term is introduced into the policy optimization objective. Unlike online RL methods, MTD3-BC does not require extensive interactions with a wind farm simulator during training, significantly reducing computational costs and training time. A wind tunnel experiment is conducted to validate the effectiveness of the algorithm under varying wind directions. The results demonstrate that MTD3-BC successfully mitigates wake effects, delivering farm-level power gains of approximately 10\% over the baseline greedy strategy and performance on par with a data-calibrated model-based wake-steering benchmark, while requiring no wake model and only a small fraction of the training cost of online RL. To our knowledge, this is the first time an offline RL wind farm control policy has been validated and demonstrated experimentally.

0.30

Performance-Guaranteed Reference Tracking With Power Directionality Constraints: Application to Controlled Stochastic Watersheds

eess.SY ·2026-08-20 ·Jonathan Shell, Sepehr Moalemi, Branko Kerkez, Jeff Scruggs
published similarity 0.59
Abstract · 6 pages, 6 figures. Accepted to the 65th IEEE Conference on Decision and Control (CDC)

Modern stormwater infrastructure faces increased demands that require a corresponding increase in capacity. Traditionally, these demands have been met by constructing new infrastructure assets, which is a costly endeavor. More recently, many system operators have achieved great success in employing feedback control techniques to improve system performance. However, the resulting closed-loop system exhibits power directionality constraints that introduce nonlinear constraints in feedback synthesis. In this work, we develop a stochastic control synthesis procedure with provable performance bounds on mean-square reference tracking for a general class of problems in which power directionality constraints arise. The proposed method is then applied to a flood mitigation example using a numerical model of a real-world smart water system. The key result is an extension of the performance-guaranteed control (PGC) framework, which was originally designed for disturbance rejection, to accommodate reference tracking control objectives.

0.36

Distributed Model-Free Turbine Repositioning for Wake Overlap Minimization in Floating Offshore Wind Farms

eess.SY math.DS ·2026-10-06 ·Zekai Chen, Ryozo Nagamune
similarity 0.58
Abstract · This paper has been submitted to the American Control Conference (ACC) 2027

This paper presents a model-free method for turbine repositioning control in floating offshore wind farms. The method uses a distributed online optimization framework to mitigate the wake effect. Conventional approaches rely on centralized, model-based control architectures, which suffer from poor practical feasibility. To overcome this limitation and address nonconvexity and inaccessible gradient information, we incorporate physics-informed knowledge of wake dynamics into the control system design. We demonstrate the effectiveness of the proposed method by comparing it with a centralized, model-based baseline in mid-fidelity simulations. Results indicate that the proposed method achieves slightly better performance while significantly reducing computational cost.

0.23

Energy system device sizing under closed-loop operation with imperfect forecasts

eess.SY ·2026-11-12 ·Cara Koepele, Kevin Wallington, Georgios Mavromatidis, John Lygeros
similarity 0.57
Abstract · 8 pages, 7 figures, 2 tables. Submitted to the 2027 European Control Conference (ECC)

The value of renewable energy devices depends on their operation, which must adapt to weather and demand using limited, imperfect forecasts that update over time. Conventional energy systems planning practices assume unlimited foresight in a single-level formulation, potentially leading to long-term investment in suboptimal device sizes. Accounting for realistic operation corresponds to a bi-level problem: the upper level selects device sizes, while the lower level contains closed-loop operation under evolving forecasts. We solve this problem using backpropagation MPC (BP-MPC), a gradient-based method, with a deterministic MPC as the lower-level controller. Using forecast errors generated by a parameterized martingale model of forecast evolution, we investigate how forecast accuracy affects the benefits of operation-aware energy systems planning and the resulting device sizes. In a case study of an energy system comprising photovoltaics, a battery, a heat pump, and thermal storage with uncertain weather and energy demands, accounting for closed-loop operation yields higher average cost savings as forecast error increases. The resulting designs achieve these savings by progressively shifting investment from battery storage to solar generation and thermal storage, which buffers forecast mismatches.

0.37

Model Predictive Control of Wind Turbines: A Model-Oriented Review of Prediction Models, Control Objectives, and Nonlinear Aerodynamic Formulations

eess.SY math.DSmath.OC ·2026-10-22 ·Roya Khalili-Amirabadi, Mohsen Jalaeian-Farimani, Mahdi Ghane
published similarity 0.57
Abstract · Khalili-Amirabadi, R., Jalaeian-Farimani, M., & Ghane, M. (2026). Model Predictive Control of Wind Turbines: A Model-Oriented Review of Pred…

Model predictive control (MPC) has been applied to wind-turbine regulation with markedly different internal prediction models, ranging from linearized low-order turbine models to nonlinear, aeroelastic, floating, and data-driven predictors. This review organizes the literature primarily by the model propagated by the controller and treats model order, predictor representation, MPC formulation, control objective, and validation plant as separate descriptors. Primary studies show that low-order linear or piecewise-affine predictors are attractive for constrained power and speed regulation, whereas flexible drivetrain, structural, and floating models are needed when drivetrain twist, tower motion, blade loads, or platform dynamics are explicit control quantities. Nonlinear and economic MPC studies further demonstrate coordinated pitch/torque control across broad operating regions, while preview, repetitive, and data-driven formulations address wind prediction, periodic loads, and model mismatch. Particular attention is given to aerodynamic pitch dependence: variable-pitch turbine dynamics can be non-affine with respect to applied pitch, and the term NMPC alone does not prove that the original nonlinear pitch map is retained inside the optimizer. The review therefore adopts a conservative, equation-based classification for direct nonlinear applied-pitch propagation. Here, direct nonlinear applied-pitch propagation means that the applied pitch at each prediction step is evaluated inside the original nonlinear aerodynamic map, rather than replacing that dependence by a linearized, scheduled, piecewise-affine, or learned surrogate. The literature supports a remaining integration challenge at the intersection of flexible drivetrain prediction, nonlinear aerodynamic pitch treatment, explicit constraints and load objectives, and validated adaptive or learned model correction.

0.35

Beyond Optimal Rates in Stochastic Optimization: Trajectory-Adaptive Stopping Rules

cs.LG math.OCmath.STstat.ML ·2026-08-26 ·Liviu Aolaritei, Lucas Lévy, Francis Bach, Michael I. Jordan
similarity 0.57
Abstract

Stochastic gradient descent (SGD) is typically analyzed at a deterministic horizon chosen before the algorithm is run, even though practical stopping decisions are made adaptively by inspecting the evolving trajectory. This mismatch creates a fundamental certification problem: fixed-time guarantees do not generally remain valid at data-dependent stopping times, while deterministic horizons derived from worst-case bounds can be highly conservative. We address this problem for strongly convex stochastic optimization by constructing fully observable, trajectory-adaptive upper confidence sequences for the squared distance of the last iterate to the optimizer and the suboptimality of a weighted average. These bounds hold simultaneously over time, attain the optimal $1/t$ decay rate up to iterated-logarithmic factors in the worst case, and adapt to the realized stochastic gradients, allowing SGD to stop as soon as a prescribed accuracy is certified without sacrificing statistical validity. Our approach treats the evolving SGD trajectory as a sequential experiment whose observations provide evidence about the unknown optimization error. To formalize this perspective, we develop new recursive confidence-sequence techniques and a general time-uniform empirical Bernstein inequality for adapted processes with time-varying conditional means and predictable ranges that may grow without bound. We further extend these confidence-sequence constructions to minibatch SGD, with the empirical Bernstein bounds exploiting the realized second-moment structure within each minibatch. Numerical experiments show that the resulting stopping rules can require several orders of magnitude fewer iterations than natural deterministic horizons.

0.18