CS Paper Radar

Deep Reinforcement Learning for Optimization of STAR-RIS Phase and Energy Splitting Coefficients in OTFS-NOMA Framework

Rais. J. Gachaba, Manobendu Sarker, Anirban Bhowal

cs.IT eess.SY ·submitted 2026-09-03 22:48 UTC · v1
published

Abstract

This paper considers a downlink communication framework comprising a simultaneously transmitting and reflecting reconfigurable intelligent surface (STAR-RIS)-aided by orthogonal time frequency space (OTFS) and non-orthogonal multiple access (NOMA) technologies. Further, delay-Doppler mobility in such frameworks renders classical alternating optimization impractical for per-coherence interval reconfiguration. To mitigate such issues, the STAR-RIS phase-shift and energy-splitting design is formulated as a constrained, non-convex sum-rate maximization problem with closed-form maximum ratio transmission beamforming and fixed NOMA power allocation. To circumvent the per-interval re-optimization burden, a deep reinforcement learning (DRL) approach is adopted that maps observed channel realizations to STAR-RIS configurations through a single forward pass. Specifically, Beta-Space Soft Actor-Critic (SAC-BSE), a maximum entropy DRL agent, is proposed. Simulation results, with two NOMA-multiplexed users on each STAR-RIS branch, confirm rapid convergence, limit the sum-rate degradation to roughly 10\% across a 128-fold user-speed range, and yield consistent gains over OTFS-only, NOMA-only, STAR-RIS-only, fixed-split, and mode-switching baselines as transmit power and the number of STAR-RIS elements increase.

Comment
Accepted in IEEE ANTS 2026

Closest papers

Nearest neighbours by meaning across the whole index.

Movable-Element Multi-Functional RIS-Assisted Hybrid RSMA-NOMA: A Constrained Hybrid Reinforcement Learning Approach

cs.AI eess.SP ·2026-10-26 ·Li-Hsiang Shen, Chi-Te Kuo
top venue similarity 0.69
Abstract · Accepted by IEEE TCOM

In this work, we propose a movable-element (ME) multi-functional reconfigurable intelligent surface (MF-RIS) architecture, termed MM-RIS, which integrates element mobility with adaptive signal reflection, transmission, amplification, and energy harvesting (EH) to enhance communication flexibility and energy self-sustainability. A hybrid rate-splitting multiple access (RSMA) and non-orthogonal multiple access (NOMA) transmission scheme is further designed to improve spectral efficiency. We formulate an energy efficiency (EE) maximization problem by jointly optimizing transmit beamforming, power and rate allocation, MM-RIS configurations, panel deployment, and ME positions. To address the resulting non-convex mixed continuous-discrete optimization problem, we propose constrained hybrid deep reinforcement learning with federated transformer and parametrized sharing (CRAFTS). CRAFTS integrates multi-agent proximal policy optimization (MAPPO) and multi-agent deep Q-networks (MADQN) through bi-directional parametrized sharing to handle continuous and discrete actions, respectively. Moreover, a transformer-based architecture and federated learning (FL) are incorporated to enhance state representation and distributed knowledge sharing, whilst a Lagrangian-based adaptive penalty mechanism facilitates the constraint satisfaction. Simulation results have demonstrated that the proposed MM-RIS architecture and CRAFTS framework substantially improve EE and constraint satisfaction compared to the benchmarks in the open literature. Moreover, the results validate the benefits of spatially reconfigurable MM-RIS, hybrid RSMA-NOMA transmissions, and intelligent collaborative learning, highlighting the potential of the proposed framework for energy-efficient and adaptive next-generation wireless networks.

0.28

Exploiting Movable-Element STARS for Rate Splitting Multiple Access

eess.SP ·2026-08-17 ·Muhammad Asif, Asim Ihsan, Irfan Muhammad, Mohd Hamza Naim Shaikh, Muhammad Ayzed Mirza +2 more
benchmark similarity 0.65
Abstract · 13 pages, 10 figures

This paper investigates a movable-element simultaneously transmitting and reflecting reconfigurable intelligent surface (ME-STARS) assisted rate-splitting multiple access (RSMA) system under imperfect channel state information (CSI). Unlike conventional STARS with fixed element positions, the elements of ME-STARS can be repositioned within a predefined region, providing additional spatial degrees of freedom for improving the cascaded transmitter--STARS--user channels. To exploit this flexibility while accounting for CSI uncertainty, we formulate a robust sum-rate maximization problem that jointly optimizes the transmit beamforming, common-rate allocation, reflection and transmission coefficients, and ME-STARS element positions, subject to transmit-power, user-rate, minimum inter-element spacing, and movement-region constraints. The resulting problem is highly non-convex due to the strong coupling among the design variables and the position-dependent channels. To address this challenge, an iterative optimization framework is developed in which the transmit beamforming, STARS coefficients, and element positions are successively optimized through tractable convex reformulations. In particular, the element positions are updated sequentially using a majorization--minimization (MM) framework, where quadratic surrogate functions are constructed from the first- and second-order derivatives of the position-dependent channels while preserving the minimum inter-element spacing constraint. Simulation results demonstrate that the proposed ME-STARS design consistently outperforms the considered benchmark schemes. Moreover, the performance gains remain significant under increasing CSI uncertainty, highlighting the effectiveness of element repositioning for robust RSMA transmission.

0.49

DRL-Based AoI Minimization for RSMA in Finite-Blocklength MU-MISO

cs.IT ·2026-10-08 ·Enes Kaya, Mehmet Alp Demircioğlu, Elif Tugce Ceran, Melda Yuksel
publishedbenchmark similarity 0.65
Abstract

This letter investigates age-of-information (AoI) minimization in multi-user wireless networks operating in the finite-blocklength (FBL) regime, which is critical for low-latency transmission of short state-update packets. While rate-splitting multiple access (RSMA) provides a powerful and flexible framework for interference management in multi-user FBL systems, the joint optimization of its parameters, such as precoding vectors, power allocation, and rate-splitting ratios, to guarantee information freshness results in analytically intractable complexity. To address this challenge, we propose an actor--critic deep reinforcement learning (DRL) framework to learn dynamic resource-allocation policies in multi-user multiple-input single-output (MU-MISO) broadcast channels. Simulation results show that the proposed RSMA-RL framework achieves consistently lower AoI than the state-of-the-art benchmarks, with substantial gains observed at low signal-to-noise ratio (SNR) and short blocklengths, while matching benchmark performance at high SNR with significantly lower online complexity via a single neural-network forward pass at execution.

0.41

Movable-Element STARS-Assisted NOMA Communications

eess.SP ·2026-09-25 ·Jingjing Zhao, Yiheng Zhang, Kaiquan Cai, Xidong Mu, Yuanwei Liu
similarity 0.63
Abstract

This paper proposes a movable-element (ME) enabled simultaneously transmitting and reflecting surface (ME-STARS)-assisted non-orthogonal multiple access (NOMA) communication system, where the positions of STARS elements can be flexibly reconfigured to introduce additional spatial degrees-of-freedom. Our objective is to maximize the sum achievable rate by jointly optimizing the active beamforming at the base station (BS) as well as the passive beamforming and MEs positions at the STARS. To tackle the resultant highly-coupled non-convex optimization problem, an alternating optimization-based algorithm is proposed, in which the original problem is decomposed into three subproblems. For the BS and ME-STARS beamforming subproblems, the successive convex approximation method is employed. For the MEs positions optimization, penalty terms are incorporated into the objective function to handle the constraints, thereby transforming the original problem into an unconstrained formulation. The gradient descent algorithm is subsequently applied to iteratively approach the sub-optimal solution. Numerical results demonstrate that: i) ME-STARS-assisted NOMA communications achieve superior performance compared to the NOMA communications assisted by STARS with fixed-position elements; and ii) the performance gain brought by the MEs is significant even with restricted moving region size.

0.04

Joint Beamforming for Continuous Transmissive RIS-Enabled Multiuser Communications

cs.IT ·2026-10-06 ·Beining Han, Shumeng Zhang, Deyou Zhang, Qingchao Li, Jun Liu +1 more
similarity 0.63
Abstract

This paper studies continuous transmissive reconfigurable intelligent surface (CT-RIS)-enabled multiuser downlink communications, where passive beamforming is characterized by a phase function defined over the continuous aperture. We employ a distance-dependent spherical-wave model for the base station (BS)-to-CT-RIS link and introduce a finite-path model based on field-response vectors for the CT-RIS-to-user links. The resulting weighted sum rate maximization problem jointly optimizes the finite-dimensional BS precoders and the infinite-dimensional CT-RIS phase function, giving rise to a mixed finite- and infinite-dimensional non-convex optimization problem. To address this problem, we develop an alternating optimization algorithm that combines a closed-form BS precoder update with a functional phase update derived using the calculus of variations and minorization-maximization. Numerical results demonstrate that the proposed CT-RIS consistently outperforms the considered benchmarks, with the performance gains attributed to spatially continuous phase control and a larger effective receiving area.

0.24

Robust Resource Allocation for STAR-RIS-Assisted ISAC Networks Using Deep Learning

cs.PF ·2026-10-19 ·Yuwen Cao, Jiajun Wu, Howard H. Yang, Tomoaki Ohtsuki, Tony Q. S. Quek
theory similarity 0.62
Abstract

In this paper, we focus on investigating the resource allocation in an integrated sensing and communication (ISAC) system assisted by a simultaneously transmitting and reflecting reconfigurable intelligent surface (STAR-RIS). Due to the coupled non-convex nature of the optimization problem, solving the above joint resource optimization problem while guaranteeing superior sensing performance is challenging, especially in dynamic environment. To conquer such challenge, prior iterative optimization algorithms have been presented. However, practical implementations of these prior algorithms face notable computational challenges, e.g., the reliance on accurate global channel information and the assumption of ideal phase shifts. In this context, we propose a model-driven deep learning framework for jointly optimizing the transmit beamforming and waveform in ISAC networks with low-overhead. In addition, we adopt the Cramer-Rao lower bound (CRLB) as the sensing performance metric, and the multi-user interference (MUI) energy as the communication performance metric for performance evaluation. Besides, our framework jointly optimizes the transmit beamforming, waveform and the STAR-RIS reflection/transmission coefficient matrices by minimizing the weighted sum of MUI energy and CRLB. Our study also considers the impact of imperfect channel information, making the research scenario more aligned with real-world applications. Simulation results validate that the proposed framework not only achieves higher sum-rate performance comparable to traditional iterative algorithms but also significantly reduces computational complexity in terms of algorithm execution time, as well as exhibits inherent robustness.

0.11

Movable-Antenna Relay Enhanced Multiuser Communications: Reinforcement Learning-Based Antenna Positioning and Power Allocation

eess.SP ·2026-10-14 ·Yuanjun Zhang, Lipeng Zhu, Haobin Mao, Zhe Li, Zhenyu Xiao
similarity 0.61
Abstract · Submitted to an IEEE Journal for possible publication

Movable antenna (MA) has emerged as a promising technology for enhancing wireless communication performance by flexibly reconfiguring wireless channels via antenna movement. In this paper, we propose an MA relay-enhanced multiuser communication system that adopts a half-duplex decode-and-forward (DF) relay scheme. The relay node is equipped with an MA array, and a buffer is employed to enhance the end-to-end transmission performance. Specifically, we formulate an optimization problem to maximize the minimum average achievable rate among multiple users over a given transmission period by dynamically optimizing the positions of MAs, transmit power, and beamforming matrices, subject to the constraints on antenna movement, inter-antenna spacing, and total energy budget for antenna movement and transmission. To address this non-convex problem with highly coupled variables, we propose a reinforcement learning (RL)-based algorithm, where a twin delayed deep deterministic policy gradient (TD3) algorithm is utilized to optimize the antenna positions and power allocation, while the transmit and receive beamforming solutions are obtained through closed-form expressions in each time slot. Numerical results validate the efficacy of the proposed RL-based algorithm and demonstrate the superiority of the proposed MA relay-enhanced multiuser communication system over the conventional fixed-position antenna (FPA)-based relay system and other MA-based benchmarks.

0.43

A Particle-Swarm-Assisted Gradient Meta-Learning Algorithm for Joint Transmit Precoding and STAR-RIS Coefficient Optimization

cs.LG cs.IT ·2026-09-24 ·Kang Zhou
similarity 0.61
Abstract · 11 pages, 11 figures, 2 tables

This paper investigates the joint optimization of the transmit precoder and the transmission/reflection coefficients of a simultaneously transmitting and reflecting reconfigurable intelligent surface (STAR-RIS) to maximize the weighted sum rate (WSR) in a multi-user downlink. We propose a particle-swarm-assisted gradient meta-learning (PSA-GML) algorithm for this non-convex problem. The original problem is first equivalently transformed via an amplitude-split parameterization and a collapsed precoder representation, which automatically satisfy the energy-conservation constraint and reduce the search dimension. Particle swarm optimization (PSO) then performs a global search over the STAR-RIS coefficients to yield a high-quality, initialization-robust warm start, with the transmit precoder obtained in closed form. Departing from conventional alternating optimization (AO), a coordinate-wise long short-term memory (LSTM) meta-optimizer trained by first-order gradient meta-learning further refines the coefficients and precoder jointly, learning per-coordinate adaptive update rules from data. The meta-optimizer is trained offline and applied to unseen channels without further adaptation. Numerical results show that PSA-GML attains an 11.06 bits/s/Hz WSR at 10 dB with N=32 elements and K=4 users, exceeding AO by 13.1% (and by 6.2% even with multiple random restarts) and the random-phase scheme by 35.1%. In the interference-limited regime it reaches 83.9% of the hand-designed Adam refinement without manual hyper-parameter tuning, and it transfers zero-shot across regimes, indicating that the learned update rule captures the intrinsic WSR landscape structure.

0.27