CS Paper Radar

Self-Supervised Tuning of Low-Fidelity Optimization Models via High-Fidelity Feedback

Gonzalo E. Constante-Flores, André H. Quisaguano-Paredes, Asha Ramanujam, Rishabh Gupta, Can Li

cs.LG math.OC ·submitted 2026-10-20 19:24 UTC · v1

Abstract

Low-fidelity (LF) optimization models are widely used in large-scale operations because they can be solved efficiently and reliably, but they often exhibit systematic errors relative to high-fidelity (HF) formulations that better capture physical and operational constraints. Existing learning-based approaches typically rely on supervised or semi-supervised training with HF solutions, which are expensive to compute and may not align with HF operational objectives. We propose a self-supervised framework that parameterizes LF optimization models directly from HF feedback. The low-fidelity problem is embedded as a differentiable optimization layer and trained end-to-end, while a HF correction problem evaluates its solution and provides gradient information through its dual variables, without requiring HF solution labels. We evaluate the framework on optimal power flow, optimal gas flow, and pooling problems, spanning different sources of low- and high-fidelity mismatch. Across all three applications, the self-supervised approach improves objective quality and feasibility over untuned LF models and generally outperforms semi-supervised training. The learned parameterizations also generalize to unseen operating conditions and, for network applications with up to 30,000 nodes, to systems not encountered during training.

Comment
50 pages, 6 figures, 13 tables

Closest papers

Nearest neighbours by meaning across the whole index.

Stochastic Model Predictive Control under AC Power-Flow Constraints Using Generative Learning

eess.SY ·2026-09-07 ·Jie Zhu, Yinliang Xu, Guan Wang
code/data similarity 0.65
Abstract

This paper proposes an end-to-end generative framework for efficiently solving multi-period and multi-scenario stochastic model predictive control (SMPC) problems under nonlinear AC power-flow constraints. Conventional deterministic neural surrogates rely on a single-shot prediction, which makes reliable feasibility difficult to achieve because one dispatch trajectory must simultaneously satisfy nonlinear constraints across all scenarios and time periods. To address this limitation, a conditional stochastic neural generator (CSNG) is developed to produce multiple candidate dispatch trajectories for each uncertainty instance, enabling the recovery of a feasible and economical solution through candidate selection. A feasibility-aware self-supervised distribution-shaping scheme is further introduced to promote constraint satisfaction, candidate diversity, and operating economy without requiring computationally expensive SMPC solution labels, while mitigating candidate collapse in generative ACOPF learning. To support efficient end-to-end training, a constraint-aware differentiable architecture is introduced. It employs a projection mechanism to exactly enforce box and ramping constraints while preserving informative gradients near active bounds, together with a differentiable equality-completion surrogate for efficient AC power-flow reconstruction. Case studies on the IEEE 14- and 118-bus systems demonstrate $100\%$ feasibility, optimality gaps below $2\%$, and computational efficiency suitable for intraday dispatch. The implementation is publicly available at https://github.com/JieZhu6/Generative_SMPC.

0.22

A Light Bilevel Refinement Aligns Self-Supervised Representations for Stronger Task-Specific Learning

cs.LG cs.AIcs.CV ·2026-09-27 ·Gustav Wagner Zakarias, Zheng-Hua Tan
hot direction similarity 0.64
Abstract

Self-supervised pretraining learns representations that are broadly transferable across downstream tasks, yet direct fine-tuning can be suboptimal due to misalignment between self-supervised and downstream task objectives, potentially degrading pretrained features beneficial to the downstream task. The BiSSL framework addressed this by introducing a transitional training stage formulated as a bilevel optimization problem, in which the downstream task objective guides the self-supervised learning process in refining pretrained representations to better facilitate subsequent fine-tuning. However, BiSSL relies on conventional bilevel optimization solving techniques whose costly implicit hypergradient approximations render the method increasingly impractical for contemporary model architectures. To make it efficient and scalable, we introduce BiSSLight, which combines M-FAC-based implicit gradient approximation with parameter-efficient fine-tuning via LoRA, enabling efficient application at larger scales that were previously impractical. Evaluation across multiple downstream tasks and contemporary model architectures shows that BiSSLight consistently improves downstream performance, with gains becoming more pronounced as model size increases despite stronger baselines. The method is highly computationally efficient, reducing computation time by more than a factor of ten compared to its predecessor on a ViT-H backbone.

0.29

End-to-End Battery Dispatch with Exact Rainflow Degradation via Mixed-Integer Differentiable Predictive Control

eess.SY ·2026-09-11 ·Eshagh Safarzadeh Ravajiri, Jan Drgona, Mahdi Mehrtash, Benjamin F. Hobbs
top venue similarity 0.63
Abstract · 12 pages. Submitted to IEEE Transactions on Smart Grid

Optimal dispatch of battery energy storage systems requires balancing energy arbitrage against cycle-induced degradation, which is accurately quantified through rainflow cycle counting. However, rainflow's combinatorial, nondifferentiable algorithm is incompatible with both convex optimization and gradient-based neural network training. We present a self-supervised mixed-integer differentiable predictive control framework that trains neural policies directly on exact rainflow degradation through a novel differentiable rainflow layer combining exact gradients at state-of-charge extrema with dense proxy gradients on incremental changes, enabling stable end-to-end training while preserving true degradation physics. A mixed-integer differentiable architecture enforces power balance, dynamics, and mode exclusivity, with a safety filter guaranteeing constraint satisfaction. We evaluate the framework on 3,650 real battery-day scenarios (a 10-battery fleet over 365 days) spanning three utility regions (SDG&E California, Xcel Energy Colorado, APS Arizona) with diverse time-of-use pricing structures. A single-battery trained policy achieves a 0.35% performance gap on its training distribution with over 200x speedup, while fleet-wide training generalizes across all households and utility regions, achieving a 3.33% performance gap with 564x computational speedup (62 seconds vs. 9.7 hours) and 100% feasibility. The millisecond-scale inference reduces computation by over two orders of magnitude compared to mixed-integer solvers, enabling practical deployment at scale.

0.71

A Scalable Learned Iterative Solver for Nonlinear MPC via Temporal Decomposition

cs.LG math.OCeess.SY ·2026-10-09 ·Lukas Lüken, Sergio Lucia
benchmark similarity 0.62
Abstract · 16 pages, 7 figures, 7 tables

Nonlinear model predictive control (NMPC) can be applied to large nonlinear systems with complex objectives while enforcing constraints, but the cost of solving the underlying optimization problems limits real-time application for systems with fast dynamics or many states. Neural networks can reduce this online cost by approximating the control law, but may violate constraints and typically require many precomputed optimizer solutions for training. The learning-based iterative solver for constrained optimization (LISCO) instead learns to predict primal-dual steps toward satisfaction of the Karush-Kuhn-Tucker (KKT) conditions through self-supervised training without precomputed solutions, but its dense, monolithic architecture grows with the prediction horizon. We remove this horizon dependence by exploiting the temporal structure of the problem in the solver architecture, which makes the network size independent of the horizon while leaving the training loss and the solver iteration unchanged. A closed-loop resampling strategy further aligns the training distribution with closed-loop operation at no additional sampling cost. On an economic NMPC benchmark of a CSTR cascade, the proposed solver scales to larger problems than monolithic LISCO and achieves median speedups of up to a factor of four over IPOPT. In closed loop, it achieves comparable control performance to IPOPT with no observed constraint violations.

0.32

Self-Supervised Combinatorial Optimization with Constraints via Frank-Wolfe

cs.LG cs.AI ·2026-09-22 ·Akbar Rafiey, Yifei Xu, Nikolaos Karalias
similarity 0.62
Abstract

Self-supervised learning for combinatorial optimization has emerged as a promising paradigm for solving discrete optimization problems with neural networks, but a central challenge remains: handling hard combinatorial constraints within continuous, gradient-based training. Continuously extending combinatorial objectives to convex domains is a powerful technique, yet existing approaches often require projection steps that constrain neural network outputs to lie inside the feasible polytope and rely on ad-hoc and problem-specific constructions. We propose a general framework in which the neural network is allowed to predict arbitrary continuous vectors that could potentially lie outside of the feasible polytope. These predictions are then approximated by sparse convex combinations of feasible solutions using a geometric decomposition algorithm based on Frank--Wolfe methods and approximate Caratheodory results. This decomposition induces an a.e.-differentiable, self-supervised loss defined as the expected value of the discrete objective. The same procedure provides an automatic rounding guarantee at inference time. We demonstrate strong empirical performance across multiple combinatorial problems, including the Quadratic Assignment Problem, Maximum Coverage, and the Traveling Salesperson Problem.

0.16

Toward Out-of-Distribution Generalization in Neural AC Power Flow

cs.LG cs.AI ·2026-11-18 ·Ojas Sanghi, Anvita Bhagavathula, Alvaro Carbonero, Priya L. Donti
published similarity 0.61
Abstract · 11 pages, 5 figures. Accepted as an oral presentation at the NeurIPS 2026 Workshop on AI Foundations for Power Grids: From Models to Deploym…

Growing uncertainty in power system operations from renewables integration, extreme weather, and data center loads challenges the reliability of traditional power flow solvers at scale. Machine learning-based proxies are a potentially promising alternative, but the prohibitive cost of generating training data for large grids makes out-of-distribution generalization a key capability for deployment; currently, models trained on small grids lack that capability. In this work, we systematically evaluate how physics-informed losses, multi-grid training, and perturbation-based data augmentation improve the zero-shot transfer of three graph neural network-based power flow models from smaller systems to a larger, unseen 500-bus system. We find that (1) physics-informed losses improve transfer relative to purely supervised objectives; (2) multi-grid training on smaller systems matches the best single grid but does not close the gap to target-grid training; (3) perturbation-based augmentation on edge attributes improves transfer by up to 54.6%; and (4) random line/generator dropout does not consistently improve performance.

0.27

ML-OPF-Bench: Benchmarking Machine Learning for Optimal Power Flow

eess.SY cs.LG ·2026-10-03 ·Xinyi Liu, Xuan He, Danny H. K. Tsang, Yize Chen
benchmarkcode/data similarity 0.61
Abstract · 25 pages, 9 figures, in submission. Code available at https://github.com/XinyiLiu04/ML-OPF-Bench; Datasets available at https://huggingface.…

Machine Learning (ML) methods promise a fast solution process for Optimal Power Flow (OPF). While inconsistent test cases, implementations, and evaluation metrics across existing studies make it challenging to determine which algorithmic advances are most critical for real-world deployment. To this end, we propose ML-OPF-Bench, a unified benchmark for AC- and DC-OPF that evaluates representative ML algorithms under a consistent pipeline, stress-tests them across system sizes, distribution shifts, and resource budgets, and ranks them with a multi-objective framework. We find that prediction accuracy alone is not a reliable indicator of operational feasibility. Under heavily loaded, congested conditions, even the strongest in-distribution performers lose their advantage, while feasibility is maintained largely by post-processing that enforces the target constraints rather than by the underlying pure ML predictor. Data scaling shows that prediction accuracy and constraint violations follow different trajectories, whereas compute scaling shows that returns diminish and that larger models do not consistently perform better. These results expose critical trade-offs among ML methods' speed, accuracy, and feasibility, and offer practical guidance for future ML-OPF design. We open-source the benchmark as an extensible Python package for integrating new learning-based OPF algorithms and evaluating them under the same standard as the existing baselines.

0.33

PowerModels-ACOPF-AI: On-the-Fly Machine Learning Approach for Solving AC Optimal Power Flow Integrating Renewable Energy Sources

eess.SY ·2026-09-16 ·Bhuban Dhamala, Jose Tabarez, Anup Pandey
benchmark similarity 0.60
Abstract

The increasing complexity of modern power systems, driven by high renewable penetration, load variability, and operational uncertainty, demands fast and reliable solutions to the AC optimal power flow problem (AC-OPF). Traditional optimization methods, though accurate, often struggle with scalability and high computational burdens, making them impractical for real-time use in large networks. This paper introduces PowerModels-ACOPF-AI, a two-stage Bayesian Neural Network (BNN) surrogate designed to predict generator set points, bus voltages, and phase angles with uncertainty. The framework integrates a performance-sensitive on-the-fly learning mechanism that identifies regions of degraded prediction accuracy and dynamically retrains with additional AC-OPF solutions generated by PowerModels.jl. This self-adaptive loop ensures robust performance, enabling the model to maintain accuracy under novel or highly variable operating conditions. Validation on benchmark test systems of different sizes, namely the 30-bus, 200-bus, and 500-bus networks, demonstrates strong generalization capability, efficient handling of stochastic renewable injections, and the ability to provide rapid, uncertainty-aware predictions. Beyond predictive accuracy, the proposed approach offers practical value as both a real-time advisory tool for system operators and a fast initializer for conventional solvers, thus supporting resilient and efficient grid operation in future power systems.

0.16