CS Paper Radar

Sequence-to-Sequence Neural Surrogate Modeling of Transient Responses in High-Speed Links with Variable Design Parameters

Julian Withöft, Shayan Ghanbari, Werner John, Emre Ecik, Ralf Brüning, Jürgen Götze

eess.SP cs.CEcs.LG ·submitted 2026-10-16 19:09 UTC · v1

Abstract

This paper presents sequence-to-sequence (seq2seq) neural surrogates for high-speed transient response modeling and signal integrity analysis in fixed and variable design parameter spaces. To identify the structural requirements for prediction accuracy, multiple neural architectures were evaluated with respect to different training strategies such as sample-based and unit interval-based, as well as input configurations such as TX-only and TX+RX. For fixed design parameters, feedforward neural networks achieve accuracy comparable to recurrent models while requiring lower computational cost, as the static mapping can be approximated by fully connected and non-sequential representations. Variable design parameters alter the electromagnetic characteristics of the interconnect, which creates parameter-dependent temporal dynamics that require sequence-aware architectures to resolve the evolving interactions within the transient response. The results based on a 14-dimensional variable design parameter scenario show that while autoregressive TX+RX feedback suffers from severe phase drift and error propagation under variable conditions, non-autoregressive TX-only inference leads to stability. To overcome the structural limitations of standard decoders, a recurrent Early Fusion LSTM is proposed, which injects design parameters at the initial encoding stage. This approach achieves superior prediction accuracy, with an RMSE of 31.0 mV and an R2 of 99.51% for transient waveform prediction, an RMSE of 30.7 mV and an R2 of 99.57% for eye-height prediction, and an RMSE of 19.5 ps and an R2 of 99.94% for eye-width prediction. These results demonstrate that neural seq2seq surrogates are accurate for transient response modeling and signal integrity analysis in complex variable design parameter spaces.

Comment
12 pages, 13 figures, 5 tables. This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

Closest papers

Nearest neighbours by meaning across the whole index.

Topology-Adaptive Seismic Response Prediction of Interconnected Structural Systems Using Reduced Order Model Embedded Graph Neural Network

eess.SP ·2026-10-20 ·Huangbin Liang, Beatriz Moya, Francisco Chinesta, Eleni Chatzi
similarity 0.55
Abstract

Electrical substation equipment is commonly interconnected by busbars and flexible conductors. Such interconnected infrastructures exhibit complex dynamic interactions, where the response of each component is influenced by local structural properties, mechanical coupling, system topology, and transient excitation. High-fidelity FE models can capture some of these effects, but their computational cost limits their use for real-time prediction. Purely data-driven models offer faster inference, yet they struggle to generalize, requiring additional simulations and retraining for each new configuration. This work presents a ROM embedded Graph Neural Network (ROMeGNN) for topology-aware seismic digital twins of interconnected structural systems. The system is represented as a graph, where structural components are treated as nodes and mechanical interconnections as edges. Each high-fidelity component model is first reduced to a reduced-order modal representation, which forms a differentiable dynamics operator within the GNN. Rather than learning the full response directly, the GNN estimates topology-dependent interaction forces that enter the differentiable ROM solver as coupling inputs for modal state advancement. This hybrid formulation preserves the known component-level physics and uses data-driven message passing to learn complex inter-component forces across varying system layouts. The framework is demonstrated on interconnected electrical substation equipment subjected to randomized seismic inputs. It delivers rapid predictions of response quantities relevant to seismic damage assessment while remaining applicable across varying layouts, component combinations, and excitation scenarios. These results highlight the potential of embedding physics within graph learning architectures for real-time, interpretable, topology-adaptive seismic digital twins of interconnected engineering systems.

0.22

SAFTAC: Simulation-Augmented Fine-Tuning of Open-Source LLMs for Analog Circuit Design

cs.AR cs.AI ·2026-11-05 ·Junsheng Huang, Yifan Sun, Zhuoer Zhang, Ning Wei, Yening Liu +5 more
top venue similarity 0.55
Abstract · Accepted to NeurIPS 2026

Circuit design for analog integrated circuits (ICs) is challenging because circuit topology, device sizing, and circuit performance are tightly coupled. Existing large language model (LLM)-based methods either rely on inference-time correction around frozen models or train on limited circuit types without directly using simulation outcomes as training signals. A key bottleneck is that existing datasets do not provide sufficient task information for training LLMs on end-to-end specification-conditioned design. To fill this gap, we first construct a large-scale simulation-grounded dataset with 8,626 design tasks across 10 different types of analog circuits, where each task includes a textual description, labeled I/O ports, loading condition, target specifications, a testbench, and a reference netlist. Using this dataset, we present SAFTAC, a simulation-augmented fine-tuning framework that trains LLMs to generate and revise analog circuit design. SAFTAC combines three-stage supervised fine-tuning, which progressively builds the capabilities required for analog circuit design and feedback-guided correction, with simulation feedback-augmented reinforcement fine-tuning, which further optimizes models using simulation-grounded rewards. We evaluate SAFTAC under single-pass generation and two-pass generation with simulation feedback, showing improvements over the strongest closed-source LLM by 15.9% and 7.8%, respectively.

0.39

End-to-End Neural Modeling of EM Response and Design Performance for Free-Form RFIC Passives

eess.SP cs.LG ·2026-10-25 ·Yuhao Mao, Chenhao Chu, Martin Vechev, Hua Wang
publisheddatasetcode/data similarity 0.55
Abstract · NeurIPS'26

Passive matching networks are critical components in radio-frequency integrated circuits (RFICs), but their design is bottlenecked by expensive finite-difference-based electromagnetic (EM) simulation. We propose an end-to-end neural framework for free-form RFIC passives that predicts both EM response and downstream design performance under varying frequency and circuit contexts, combining a frequency-conditioned neural simulator with a circuit-conditioned neural solver. To improve design performance prediction, the simulator outputs a neural EM response consisting of both the explicit EM response and a complementary response, together with a dependence regularizer that encourages the two responses to capture orthogonal information. To evaluate the proposed framework, we construct a large-scale dataset of free-form passive layouts, synthesized from both expert-designed contours and random paths. Our 21M-parameter model achieves high accuracy across a broad frequency range, circuit contexts and passive matching settings, with $R^2>0.98$ for almost all targets, while providing orders-of-magnitude faster evaluation than traditional EM simulation. Code available at https://github.com/ETH-IDEAS/RFIC-NeuralSim.

0.37

Empirical Boundaries of Reservoir Computing for Few-Shot Sequence Pattern Tasks

cs.LG cs.AI ·2026-10-14 ·Mario Mallea, Angela Nebot, Franscisco Mugica
similarity 0.54
Abstract · 4th International Workshop on Reservoir Computing (RC 2026) 35th International Conference on Artificial Neural Networks (ICANN 2026)

Efficient sequence modeling remains a fundamental challenge in machine learning. Despite the success of Transformers, recurrent neural networks (RNNs) have recently re-emerged as efficient alternatives. Particularly, Echo State Networks (ESNs) offer a compelling framework of randomized RNNs that have been extensively studied for time-series forecasting and dynamical systems. This paper presents an empirical analysis of distributional, architectural, and optimization variants of ESNs evaluated on few-shot sequence-to-sequence (seq2seq) pattern tasks. These synthetic tasks utilize discrete symbol sequences, characterized by delays, inactive phases, and triggered markers to isolate and evaluate memory and pattern recognition capabilities. The minimality of these tasks is crucial to understand the strengths and limitations of machine learning models. Furthermore, when the input signal utilizes a one-hot encoding, ESN dynamics are governed strictly by their weight distributions, offering an ideal lens through which to study reservoir computing. Our findings map the performance boundaries of ESNs relative to state-of-the-art (SOTA) models. We show that preserving a linear state regime is vital for memory tasks, such as pattern completion or simple copy. We propose a data-dependent modulation mechanism for nonlinear input injection into the reservoir (G-ESN). G-ESN functions as a statistical filter capable of solving tasks that conventional ESNs cannot (the adding problem and bracket matching). Finally, for Deep ESNs, we evaluate a shared readout mechanism across layers that outperforms conventional concatenated readouts on structural tasks, including selective copy, sorting problem, and bracket matching.

0.13

Prospective Coding Improves Learning in Deep Continuous-Time Recurrent Networks

cs.LG cs.NEq-bio.NC ·2026-09-03 ·Shivang Rawat, Mirko Morello, Flaviano Morone, David J. Heeger
similarity 0.54
Abstract

Temporal integration gives continuous-time recurrent networks memory, but in deep stacks it also delays bottom-up signals and attenuates top-down errors. We compensate for this delay by making each layer's bottom-up input prospective, and we develop Recursive Quadrature Filters (RQFs), biologically motivated temporal band-pass filters that are a special case of diagonal state-space models (SSMs). Starting from an energy model, we derive the RQF dynamics and show that each RQF is a band-pass filter whose learnable parameters control its tuning frequency and bandwidth. We then make each layer's bottom-up input prospective using a parameter-free two-tap update that leaves the recurrent transition and parallel scan unchanged. We extend this correction to general diagonal SSMs and show that it mitigates depth-dependent gradient attenuation when temporal gradients are truncated, i.e., spatial-only backpropagation. We evaluate the performance of RQFs, S5, and ORGaNICs (a nonlinear gated RNN with built-in attentional modulation and recurrent normalization) trained using full backpropagation through time (BPTT) and spatial-only backpropagation. Under full BPTT, the prospective variants of these models match or outperform their non-prospective controls in every configuration. A non-residual width-32 six-layer RQF achieves 96.09% accuracy on raw-audio Speech Commands with 31.9k parameters; a width-64 six-layer RQF achieves 83.36% on the 16,384-step Path-X task. We also introduce selective RQFs (sRQFs), which make each filter's input gain and, optionally, its bandwidth and tuning frequency input-dependent while retaining the parallel scan. With the input gain alone, the same six-layer model achieves 86.31% on Path-X; with all three input-dependent, a four-layer prospective sRQF solves Selective Copying (99.83%).

0.23

History-informed Lagrangian Neural Networks

cs.LG ·2026-08-13 ·Tianshuo Zhang, Xianglei Xing, Wenzhe Zhai, Jia Gao, He Cao
publishedcode/data similarity 0.54
Abstract · 15 pages, 5 figures. Accepted to the 9th Chinese Conference on Pattern Recognition and Computer Vision (PRCV 2026) as an oral paper

Forecasting the long-horizon evolution of mechanical systems from position-only observations is a pivotal yet difficult task, as hidden velocities and trajectory-specific physical properties must be inferred simultaneously. Although physics-guided neural networks like Lagrangian Neural Networks (LNNs) guarantee physical plausibility, they generally require complete state inputs and lack adaptability to changing system parameters. To break these limitations, we introduce History-informed Lagrangian Neural Networks (HiLNN). Grounded in the insight that temporal position sequences implicitly encode underlying dynamics, HiLNN employs a recurrent encoder to extract a latent context from history. This context not only reconstructs the unobserved initial velocity but also adaptively modulates the mass matrix, potential energy, and damping coefficients of a structured Lagrangian system. By leveraging a differentiable RK4 rollout scheme, the entire pipeline is optimized end-to-end under multi-step trajectory supervision and energy-consistency regularization. Empirical evaluations across conservative, dissipative, and heterogeneous variable-parameter systems show that HiLNN delivers superior long-term prediction accuracy and maintains precise energy profiles compared to state-of-the-art baselines. The source code is publicly available at https://github.com/yingtian22/History-informed-LNN.

0.77

ReAl: Refine neural operators via aligning dynamical flow

cs.LG ·2026-10-14 ·Jing Xu, Zenglin Xu, Li Yi, Ruoxi Jiang, Yuan Qi
similarity 0.53
Abstract · 20 pages, 8 figures

Neural partial differential equation (PDE) surrogates trained with mean squared error (MSE) can capture dominant dynamics but often lose high-frequency information and fine-scale structures. Generative models (e.g., Flow Matching) can capture the distribution of fine-scale details, yet stochastic errors may accumulate during autoregressive rollouts and compromise long-term stability. To address these limitations, we introduce Refine and Align(ReAl), a model-agnostic plug-in that augments pretrained PDE surrogates to improve the reconstruction of high-frequency structures associated with complex physical phenomena. In the refinement stage, a conditional flow-matching model learns the residual distribution around the deterministic base prediction, recovering missing fine-scale structures while retaining the dominant dynamics. In the alignment stage, to mitigate the generative discrepancies amplified in the autoregressive rollout, particularly in chaotic systems, we generate multiple trajectories from the same input and reinforce the refiner with trajectory-level rewards, thereby achieving long-horizon dynamical alignment. Experiments across diverse surrogate architectures and PDE tasks demonstrate that ReAl consistently improves high-frequency fidelity, forecasting accuracy, and long-horizon stability.

0.25

Symbolic Neural ODEs: Learning interpretable models from time-series data

cs.LG eess.SYmath.DSstat.ML ·2026-08-22 ·Nibodh Boddupalli, Jeff Moehlis
similarity 0.53
Abstract · Submitted to the SIAM J. Dynamical Systems

We present a machine learning framework for identifying sparse, interpretable models of dynamical systems directly from time-series data. Our approach parameterizes the underlying vector field using a neural architecture and trains it by minimizing a multi-step prediction loss over a finite horizon. To ensure numerical tractability, we optimize a mean absolute error objective averaged across prediction steps, and progressively increase the horizon during training. A key feature of this formulation is that it enforces consistency under repeated composition of the learned dynamics. As a result, the identified models exhibit significantly improved stability compared with approaches based on one-step regression of the vector field. When combined with sparsity-promoting regularization, this leads to parsimonious models that generalize beyond the training data. We demonstrate accurate recovery of systems exhibiting a wide range of behaviors, including stable and unstable fixed points, periodic orbits, and chaotic attractors. For chaotic systems, while long-term trajectory prediction is inherently limited by sensitivity to initial conditions, we show that multi-step training yields models with accurate short-term dynamics and strong agreement in long-time statistical properties, including mean, variance, and Lyapunov exponents. Moreover, we establish theoretical bounds linking trajectory error to statistical accuracy, providing a step toward a principled explanation for this behavior.

0.15