CS Paper Radar

Strategic Arbitrage in Electricity Markets: A Multi-Agent Policy Optimization Framework

Eli Brock, Srikar Babu Gadipudi, Somayeh Sojoudi, Javad Lavaei

eess.SY ·submitted 2026-10-21 20:57 UTC · v1
publishedbenchmark

Abstract

Grid-scale storage and load aggregators are growing quickly in wholesale electricity markets. If highly consolidated, these new participants may distort the competitive market equilibrium through strategic withholding behavior. Traditional market power mitigation techniques are ill-suited to arbitrage-based participants. We provide a multi-agent policy optimization model to study game-theoretic equilibria for real-time markets with consolidated storage and/or aggregators. The model is designed to facilitate natural first-order equilibrium-seeking update rules. We analyze the theoretical properties of different supply functions and their implications on the convergence of the gradient dynamics. Finally, we train equilibrium policies for a modified version of the IEEE RTS-GMLC benchmark across different levels of storage fleet consolidation, to demonstrate the potential of the framework as a tool to characterize and quantify strategic arbitrage.

Comment
Accepted to the 65th IEEE Conference on Decision and Control (CDC 2026). 8 pages, 6 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Extended Version: Storage-Based Strategic Manipulation of Constraint-Binding Patterns in Power Networks

eess.SY econ.GN ·2026-09-14 ·Mehdi Davoudi, Minghao Mou, Junjie Qin
similarity 0.76
Abstract · Extended version of our paper submitted to IEEE Transactions on Power Systems

This paper studies the strategic market participation of a monopolistic energy storage aggregator (ESA) in a day-ahead electricity market. The ESA coordinates geographically distributed storage units, submits a coordinated bid for its portfolio, and may hold financial transmission rights (FTRs). The system operator clears the market through a network-constrained, multi-period economic dispatch, determining generation and load schedules, nodal prices, energy-market payments, and FTR payoffs. We formulate the ESA--system-operator interaction as a Stackelberg game and characterize its equilibrium through a constraint-binding-pattern decomposition of the market-clearing problem. Beyond enabling equilibrium computation, the framework reveals how the ESA can increase its profit by strategically inducing or avoiding particular constraint-binding patterns. It also establishes a novel welfare result: although strategic storage without FTRs is known to weakly improve social welfare relative to the no-storage case, certain FTR positions can overturn this guarantee by strengthening the ESA's incentive to induce particular patterns, causing social welfare to fall below the no-storage level. Motivated by these findings, we develop two system-operator mechanisms for limiting undesirable ESA behavior and its adverse effects on market outcomes and social welfare. Finally, a three-bus study illustrates the theoretical findings, while IEEE test systems demonstrate the scalability of the proposed method.

0.18

DER Aggregators in Wholesale Electricity Markets: A Hybrid Mean-Field Framework with Endogenous Price Feedback

eess.SY ·2026-11-12 ·Jun He, Andrew L. Liu
theory similarity 0.68
Abstract

The rapid growth of distributed energy resources (DERs), including rooftop solar and energy storage, is transforming the grid edge, where customer-side assets increasingly interact with the broader power grid. DER aggregators, entities that coordinate the actions of many small-scale DERs, play a key role in this transformation. This paper presents a hybrid Mean-Field Control (MFC) and Mean-Field Game (MFG) framework for integrating DER aggregators into wholesale electricity markets. Unlike traditional approaches that treat market prices as exogenous, our model captures the feedback between aggregators' collective actions and electricity prices. The MFC component optimizes DER operations within each aggregator, while the MFG models strategic interactions among multiple aggregators. To account for various uncertainties, we incorporate reinforcement learning, which allows aggregators to learn optimal bidding strategies in dynamic market conditions. We prove the existence and uniqueness of a mean-field equilibrium and validate the framework through a case study of the Oahu Island power system. Results show that our approach reduces price volatility and improves market efficiency, offering a scalable and decentralized solution for DER integration in wholesale markets.

0.22

Peak-Aware One-Way Trading: Competitive and Learning-Augmented Algorithms for Energy Procurement

cs.DS ·2026-10-22 ·Jackson Bibbens, Adam Lechowicz, Nicolas Christianson, Bo Sun, Mohammad Hajiesmaili
similarity 0.65
Abstract · 27 pages, 2 figures

We introduce peak-aware one-way trading ($\texttt{PA-OWT}$), an online problem in which a player must purchase a fixed quantity of an asset by a deadline, minimizing its total cost plus a charge proportional to the largest single purchase at any time. The model is motivated by electricity procurement, where the cost of energy rewards buying at low prices, but peak demand charges discourage concentrating purchases in short periods. Balancing these incentives is challenging when future prices are unknown: a large purchase can establish a peak that later decisions cannot undo. We develop a peak-aware online algorithm that balances price and peak control with deadline feasibility and achieves the order-optimal competitive ratio. We further extend our results to a learning-augmented algorithm that uses predictions of optimal purchasing decisions to achieve an order-optimal consistency-robustness tradeoff, exploiting accurate advice while retaining worst-case guarantees in the face of arbitrary prediction errors. Finally, we evaluate our algorithms in a case study on electricity procurement using historical electricity price traces to understand the benefits of peak-aware purchasing.

0.19

A Coalitional Game for Demand-Side Management in a Micro-Grid with Multiple Electricity Retailers

eess.SY ·2026-08-18 ·Pablo R Baldivieso-Monasterios, Fernando Genis Mendoza, George Konstantopoulos, Dario Bauso
theory similarity 0.65
Abstract

This paper develops a demand-side management framework for electricity networks with multiple competing retailers. The interaction among retailers is formulated as a coalitional game, yielding a family of coupled mixed-integer optimisation problems in which retail prices, consumer power demands, and the network partition are jointly optimised. To solve this problem, we propose a coalition-formation algorithm based on multi-objective optimisation principles. The algorithm seeks to identify coalition structures that balance retailer profit and consumer welfare. We prove that the proposed algorithm converges in a finite number of steps and recovers a subset of weakly Pareto-efficient solutions of the coupled optimisation problems. The framework is further extended to a risk-sharing formulation, in which the objective is defined using conditional value-at-risk. Numerical simulations on an academic example demonstrate the method's behaviour and show that the resulting equilibrium partition set contains several admissible trade-offs between the competing objectives. The results provide a tractable approach for analysing competition, coalition formation, and risk-aware pricing in multi-retailer demand-side management systems.

0.23

Optimal Pricing and Charging Strategy Design for Non-cooperative Battery Swapping Stations

cs.GT eess.SY ·2026-08-14 ·Huanyu Yan, Chenxi Sun, Huanxin Liao, Xiaoying Tang
top venuehighly cited similarity 0.64
Abstract · Published in IEEE Transactions on Mobile Computing, vol. 23, no. 12, pp. 13573-13588, Dec. 2024

Battery swapping is a rapid way to recharge electric vehicles (EVs). As more and more entities are involved in building Battery Swapping Stations (BSSs), how non-cooperative BSSs maximize their profit in a competitive market needs further investigation. In this paper, we focus on a practical scenario where competitive BSSs are coordinated by the same aggregator. To study the optimal pricing and battery charging, we formulate a hierarchical game-theoretic model, where BSSs determine the swapping price in the day-ahead market in the first stage, and then determine the optimal battery charging strategy in the real-time market in the second stage. We rigorously prove the existence and uniqueness of the Subgame Perfect Nash Equilibrium (SPNE). In particular, the uniqueness property provides theoretical support that the strategy under equilibrium is optimal in the competitive environment. Based on the unique SPNE, we propose an optimal pricing and charging strategy for each BSS to maximize profit in the competitive market. A prediction error handling method is also proposed to deal with unexpected fluctuations in swapping demand. Our simulation with a 12-BSS system based on real-life data from Xi'an, China shows that our pricing and charging strategy increases the individual BSS profit by at least 18.1\%, while the optimal charging strategy naturally achieves peak shaving for the power grid.

0.75

Co-optimizing Bidding and Power Allocation of an EV Aggregator Providing Real-time Frequency Regulation Service

eess.SY ·2026-08-25 ·Ruike Lyu, Hongye Guo, Kedi Zheng, Mingyang Sun, Qixin Chen
top venuehighly cited similarity 0.64
Abstract · Published in: IEEE Transactions on Smart Grid ( Volume: 14, Issue: 6, November 2023)

The rapidly expanding scale of electric vehicle (EV) fleets and continuously decreasing battery costs are making vehicle-to-grid services a reality. In this paper, we study the interaction between the problems of an EV aggregator's bidding in the regulation market and power allocation (i.e., determining the (dis)charging powers of the EVs in regulation deployment). Although the two problems are coupled, they are often regarded as decoupled and optimized separately for complexity issues. However, failing to consider the coupling of bidding and power allocation can lead to a decline in the profit of the EV aggregator (EVA). In this paper, we propose a framework for co-optimizing EVA bidding and power allocation in the regulation market. The bidding model is formulated as a stochastic programming problem with embedded power allocation in discretized regulation signal scenarios. To meet the solution time requirement for regulation deployment, we further propose a power allocation model that can be solved online. It utilizes the Lagrange multipliers from the bidding problem to ensure that the allocation results correspond to the optimal solution of the bidding problem. The effect of the proposed framework on improving EVA profits and reducing degradation costs is verified in the case study.

0.67

PowerMarketJax: A JAX Benchmark Suite for Multi-Agent Reinforcement Learning in Power Markets

cs.MA cs.AIeess.SY ·2026-09-29 ·Zhanhua Pan, Xin Qin, Xiao Liu, Zhilong Cao, Jianhong Wang +1 more
benchmarkcode/data similarity 0.62
Abstract · 69 pages

Power markets are a natural testbed for multi-agent reinforcement learning (MARL), where multiple self-interested participants repeatedly submit bids. A market-clearing mechanism then determines dispatch and prices subject to power grid constraints and market settlement rules. However, existing MARL environments typically focus on a single market setting, implement simplified clearing mechanisms, or rely on CPU-based optimization solvers that slow large-scale training and limit the systematic study of bidding strategies and market behavior. We introduce PowerMarketJax, a benchmark suite for MARL across five power markets: day-ahead wholesale, real-time balancing, ancillary services, peer-to-peer double auctions, and local flexibility. Each environment implements its own clearing, pricing, and settlement rules while providing a common framework for learning and evaluation. We find that learned bidding behavior depends strongly on the market design: independent learners can miss better strategies when gains require many agents to change together, when more profitable strategies lie beyond a region of lower profit, or when profits disappear as more agents adopt the same strategy. PowerMarketJax implements both market simulation and policy training in JAX, allowing the entire pipeline to run on the GPU with 1,024 X 1,200 parallelisms across both environments and market participants, achieving up to 33X speedup over CPU-based baselines. Our open-source benchmark is available at: https://github.com/powermarketjax/PowerMarketJax.

0.23

Robust Procurement Planning for Community Choice Aggregators: Managing Market Price Uncertainty

eess.SY ·2026-10-20 ·Manar Jaradat, James Himelic, Neha Patankar
code/data similarity 0.62
Abstract

Community Choice Aggregators (CCAs) play an important role in the energy transition by procuring renewable electricity for local communities while balancing affordability, resource adequacy, and clean-energy requirements. In California, these long-term procurement decisions are coordinated through integrated resource planning (IRP). However, conventional IRP frameworks typically represent wholesale electricity prices deterministically, even though price uncertainty can expose CCAs to substantial financial risk by affecting the cost of market imports and, particularly, the value of export opportunities. This paper develops a robust optimization framework for CCA resource procurement that hedges against uncertainty in wholesale import and export prices. We extend the open-source GenX capacity expansion model with a budgeted robust optimization formulation that protects procurement decisions against adverse price realizations while remaining computationally tractable for large-scale, multistage planning studies. Using data from a California CCA, we show that market price uncertainty can materially change optimal procurement strategies. Rather than aggressively expanding renewable capacity based on expected export revenues, robust portfolios reduce dependence on uncertain market revenues, leading to more conservative renewable investments and less reliance on market exports. We demonstrate that moderate uncertainty budgets provide most of the risk-reduction benefits of robust planning at limited additional cost, whereas higher robustness levels yield diminishing benefits as portfolio conservatism increases. These findings provide guidance for selecting uncertainty budgets in IRP studies and demonstrate how robust optimization can support affordable and resilient procurement decisions as CCAs contribute to the transition toward low-carbon electricity systems.

0.40