CS Paper Radar

StarBOA: Real-Time Mamba State-Space Unrolling for Sparse Radar Micro-Doppler in ISAC Networks

Mustafa Bora Çelik, Ceren Çelik, Orhan Gazi

cs.LG cs.ITcs.NI ·submitted 2026-09-27 09:37 UTC · v1

Abstract

In Integrated Sensing and Communications (ISAC), radar sensing must operate under chirp subsampling with up to 90\% missing data. An attention-based baseline, limited to a 52~ms buffer, collapses toward maximum uniform entropy ($H=2.584$ bits) as sparsity increases, failing to capture long-range gait-cycle context. We propose StarBOA, which replaces attention with a causal Mamba state-space model that updates incrementally on a per-window basis without re-scanning past reconstructions. By maintaining a persistent state, StarBOA integrates over $100\times$ more temporal history at no additional per-step computational cost. StarBOA outperforms the baseline's published results across all sparsity levels, with SSIM gains increasing from $+0.0379$ at 50\% missing data to $+0.2472$ at 90\%. Each window is processed in 1.53~ms with zero lookahead, demonstrating efficient causal reconstruction under extreme chirp subsampling.

Comment
5 pages, 2 figures

Closest papers

Nearest neighbours by meaning across the whole index.

WM4ISAC: World Model for Proactive ISAC Under Dynamic Blockage

eess.SP ·2026-10-06 ·Zichao Xiao, Linlong Wu, Bhavani Shankar Mysore R
publishedtheory similarity 0.56
Abstract · Accepted to IEEE ISAC 2026

Dynamic blockage severely degrades vehicular integrated sensing and communication (ISAC), since narrow millimeter-wave beams must be adjusted before the line-of-sight (LoS) link is blocked or misaligned. This paper proposes WM4ISAC, a proactive ISAC framework built on a world model that learns a reusable latent dynamics model of the traffic environment from downlink radar heatmaps, rather than directly mapping observations to beam indices. The proposed framework uses a vision (V) module to compress sensing observations, an action-conditioned memory (M) module to predict latent environment evolution, and lightweight event heads to evaluate LoS alignment, blockage, and scatter-assisted non-line-of-sight (NLoS) alignment for candidate beams. A codebook-level controller then uses these event predictions to proactively switch between LoS and NLoS beams without knowing the future user or blocker states. Simulations under dynamic blockage show that WM4ISAC improves the mean rate by $28.9\%$ over current LoS tracking, raises the 5\%-tile rate from $0.9$ Mbps to $30.5$ Mbps, and reaches $88.7\%$ of the perfect-information upper bound.

0.32

Coverage-Verified Sparse Attention: Closed-Loop Quality Control for Long-Context LLM Decoding

cs.LG cs.CL ·2026-11-07 ·Yan-Cheng Li, Chun-Yi Lee
top venue similarity 0.56
Abstract · Accepted to NeurIPS 2026. 35 pages, 12 figures, 35 tables

Sparse attention accelerates long-context decoding by reading a subset of the KV cache, but existing methods are open-loop: the kernel commits to its selection with no signal indicating whether enough attention mass was preserved and no recovery path when it was not. The needed signal already exists inside the kernel. The fraction of softmax mass on the selected tokens, which we call coverage, satisfies an exact algebraic equality with per-step output error and serves a dual role as the acceptance criterion and the interpolation weight for recovery. Coverage-Verified Sparse Attention (CVSA) turns coverage into a training-free, closed-loop verify-then-correct decode loop that accepts high-coverage drafts and recovers only the heads that fall short, with no sampling, no draft model, and no speculative-decoding infrastructure. Quality varies by only $0.14$ points across the threshold sweep; budget and scheduling ablations characterize the deployed operating point. On LongBench at 7B and 70B, CVSA comes within $1.13$ points of dense attention, statistically matching it at 70B, and it loses $0.8$ points on RULER; measured median decode-step speedup reaches $6.21\times$ at 128K context.

0.39

CoWindow Attention: Full Causal Coverage Is a Collective Property

cs.AI ·2026-09-26 ·Jingze Shi, Zhangyang Peng, Xianduo Li, Yanlin Qi, Xiaotian Lin +4 more
benchmark similarity 0.56
Abstract

FullAttn repeatedly exposes the complete causal history to every attention head, creating substantial redundant computation and memory traffic even with IO-efficient dense kernels. We introduce CoWA, a structured attention architecture that distributes access to the causal history across KV heads. All heads share near-diagonal and prefix-sink windows, while complementary long-range windows partition the remaining history. Their union provides full causal coverage although each head attends sparsely to distant tokens. This position-defined attention pattern requires no learned router or indexer, is used consistently during training and inference, and aligns with KV-head tensor parallelism. A window-matched ablation at 8K isolates the effect of complementary long-range allocation: CoWA with 100% collective coverage reaches 89.73% accuracy, compared with 89.97% for FullAttn, while duplicated long-range windows perform substantially worse. Across a broader controlled associative-recall comparison with matched token budgets, CoWA closely tracks FullAttn as the context grows, whereas other sparse patterns lose a substantial fraction of the associations. In an attention-operator benchmark at 128K tokens with tensor parallelism, CoWA reduces forward and backward latency during training by 7.4x and 8.6x and decoding latency during inference by 3.0x over FullAttn. Its per-rank peak operator memory matches FullAttn during training and is 7.6x lower during decoding. Across scaling-law training from 0.6B to 14B parameters, CoWA closely tracks FullAttn in perplexity while reducing total training FLOPs. The resulting 14B models and 32B models from separate continued training achieve comparable knowledge, reasoning, and long-context retrieval scores to FullAttn. These results show that full causal coverage can be a collective property of the head ensemble rather than a duplicated property of every head.

0.24

BF1: A Causal Dyadic Sparse-Attention Retrofit for Efficient Long-Context Transformers

cs.LG cs.AI ·2026-08-19 ·Hina Dixit
similarity 0.56
Abstract

Dense causal attention remains expensive at long context even when implemented with highly optimized exact kernels. We study BF1, a deterministic block-aligned dyadic sparse-attention route that combines a small exact local neighborhood, a global first block, and logarithmically spaced historical blocks. The route is related to prior log-sparse and dilated attention patterns; our contribution is a correctness-gated pretrained-model retrofit, a matched topology-control study, and a systems characterization that connects per-layer sparsity to whole-model latency. For fixed block width, every converted layer uses O(n log n) selected token interactions and has O(log n) graph communication depth. On an NVIDIA RTX PRO 6000 Blackwell GPU, an optimized BF16 implementation crosses dense attention between 2K and 4K tokens and reaches a 10.91x per-layer prefill speedup at 32K. Retrofitting eight of 28 Qwen3-0.6B attention layers lowers warm whole-model time to first token by 7.7%, 11.3%, and 15.3% at 8K, 16K, and 32K, respectively, while the remaining dense layers keep the complete model asymptotically quadratic. Under a matched 1,000-step, 16.384M-token adaptation protocol, BF1 ranks first across three training seeds: mean report perplexity is 1.68639 versus 1.69154 for a matched static-random nonlocal graph, 1.69258 for dense continued training, and 1.81505 for equal-budget local sliding. At seed 1234, the packed-report paired interval places Dense-CT 0.3169-0.4055% above BF1 and static-random graph 17 0.2441-0.3642% above BF1. These results establish BF1 as a reproducible sparse operator and selective retrofit primitive with real long-context systems value. This paper evaluates numerical correctness, selected-interaction scaling, kernel performance, partial-model inference, and matched next-token language modeling.

0.13

CacheLink: Functional KV Transport for Zero-Prefill Cross-Model Context Handoff

cs.LG cs.AI ·2026-10-11 ·Haomiao Qiu, Yining Tang, Zijia Song, Ruizi Han, Ziyue Qiao +1 more
similarity 0.56
Abstract

KV caches make long-context serving efficient by reusing past computation, but model switching breaks this reuse and forces the receiver to prefill the context again. We study \emph{zero-prefill cross-model context handoff}: translating a sender cache into a receiver-compatible state so that the receiver can continue directly without prefilling same context. Existing affine transport methods show that receiver KV states can be substantially reconstructed from sender caches. However, through extensive analyses, we find that reconstruction fidelity is a poor proxy for receiver utility. Similar K/V reconstruction errors can lead to substantially different attention patterns, predictive distributions, and downstream accuracy, because conventional reconstruction objectives overlook the query-dependent functional importance of K and V in receiver attention. We thus introduce CACHELINK, which learns a coupled K/V correction through the receiver behavior directly. Across four independently trained sender--receiver pairs and seven evaluation panels, CACHELINK improves the equal-weight mean over all methods for every pair. In matched diagnostics, CACHELINK changes K/V squared error by less than 0.4% while substantially changing receiver attention and next-token behavior. At 32K context, it reduces handoff latency by up to $7.27\times$ relative to receiver re-prefill. Our findings verify that reconstruction fidelity alone is insufficient and that preserving the receiver computation induced by the transported cache is important for effective cross-model KV transport.

0.42

Kairos: Toward a Byte-Level Foundation Model for Every Modality

cs.LG cs.AIcs.CL ·2026-09-26 ·Fabien Furfaro
code/data similarity 0.55
Abstract · 15 pages

Small language models trained on a single local machine leave little room for architectural trial and error. Kairos combines bidirectional gated-DeltaNet linear attention and sliding-window attention over shared projections (LiZAttention2), block-wise Attention-Residual aggregation, a sparse Mixture-of-Experts (MoE) feed-forward layer and a multi-scale byte-level codec, trained with a uniform-noise denoising objective over one byte space shared by text, image, audio, video, lidar and control streams; this report asks whether the combination optimizes at all before asking whether it is useful. We give code-derived algorithms for each component, including a cross-session recurrent-state memory gate, then run convergence sanity checks: overfittinga single 440-byte sentence at 1--15M parameters, text only, with three seeds for codec and attention choices and single-run sweeps for seven further factors. The two attention variants tested at 3\,000 steps (LiZAttention2 and window attention alone) reach a minimum loss near $10^{-3}$. After 600 steps, the mean minimum loss ranges from 0.018 (patch codec) to 0.354 (depthwise convolutional codec) with an identical ranking on three seeds. An apparent advantage of shared over separate attention projections closes with more steps or more diverse data and reverses when the projections are frozen: it is a convergence-speed effect, not a capacity effect. These checks suggest that the implementation optimizes; they say nothing about generalization, multimodal training or comparison with existing models, which a planned pretraining run is meant to address. The Discussion sizes a 200M-total/25M-active target analytically; none of its throughput figures is measured. Code is available at https://github.com/fabienfrfr/Kairos . Python package at https://pypi.org/project/kairos-fm/ .

0.34

Task-Based Evaluation of Raw Radar Data Compression: A Pre-Registered Study of Where Classical Codecs Fail to Preserve Target Detection, and Why

eess.SP ·2026-08-18 ·Eric Michael Chrabot
code/data similarity 0.55
Abstract · 16 pages, 9 figures, 5 tables. v2: corrects the retention-only counterfactual (Secs. I, III-A, V-C); states the criterion's commit chronolog…

Synthetic aperture radar (SAR) systems collect raw I/Q echo data at rates that exceed downlink capacity; fielded systems compress onboard with block-adaptive quantization (BAQ/FDBAQ). Proposed replacements, including learned compression, are evaluated with image-quality metrics (PSNR, SSIM, SQNR); none measures whether the data still supports its operational use. We introduce a task-based evaluation methodology for raw radar compression, with a published pre-registration trail: codecs are scored after SAR focusing against a two-sided criterion -- a CFAR detection-retention floor and a spurious-detection budget at matched threshold -- using frozen task models trained once on uncompressed data. On Sentinel-1 stripmap Level-0 data the evaluation brackets the fielded FDBAQ operating point at the resolution of the BAQ grid (3-bit BAQ sustains utility at 6.12 bits per complex sample; 2-bit does not), with a reported lattice artifact found to change retention by at most 0.004. Under the final plane-mapping rule no classical configuration sustains utility below 4.86 bits per complex sample on this scene. Energy concentration after focusing delivers the predicted retention gain (0.888 vs 0.691 at 2 bits) but converts it into target-adjacent false alarms for wavelet and block-transform codecs alike: a retention-only rule certifies focused-domain JPEG2000 at 4 bits while it produces 2.5 times the tolerable spurious count. On AFRL Gotcha GMTI data (airborne, never compressed onboard) the frontier is bracketed at 7.4-8.0 bits per complex sample and the same trade reappears; on an Umbra spotlight image JPEG2000 passes the retention floor at 2, 1, and 0.5 bits while producing 10-14 times the spurious budget. We report the full pre-registration trail, including the chronology of the criterion's two clauses, one retracted overclaim, and a bounded negative result for a small learned codec.

0.28

Prediction-Induced Sparsity for Tracked FMCW Radar: A Track-Conditioned Event-Gap FPGA Architecture

eess.SP ·2026-10-30 ·Huy Trinh
similarity 0.55
Abstract

Tracked FMCW radar already carries a prediction of the next target state, yet the downstream digital hardware is commonly provisioned for a fixed spectral search. We present prediction-induced sparsity (PIS), a tracked-mode architecture that uses the prior before event formation and hardware scheduling. The predicted beat is derotated to an innovation-centred coordinate, while tracker covariance is propagated to a bounded residual support K. Sparse level-crossing packets are then executed by an exact event-gap resonator engine with a shared complex processing element and K-dependent state/coefficient memory. On a public FMCW dataset, causal prior-only con- ditioning reduces event records by 33.1% on average, and the representative fixed-point stream is bit-exact in RTL. And on an Artix-7 implementation, reducing physical support from 129 to 23 states lowers LUT and BRAM use by 65.0% and 88.1%, respectively, and reduces measured VCCINT power by 19.9% at matched throughput. The results show how tracking uncertainty can become a hardware-capacity implication for future adaptive radar accelerators.

0.28