CS Paper Radar

Fundamental Limits of Joint Target Detection and Parameter Estimation - Characterizing Mixed-State Sensing Limits via Posterior Entropy Volume

Dazhuan Xu, Nan Wang, Han Zhang

cs.IT eess.SP ·submitted 2026-09-09 03:35 UTC · v1

Abstract

The development of integrated sensing and communication calls for a unified theoretical foundation for sensing. This paper models target-presence patterns and continuous physical parameters as a mixed discrete-continuous state $Ξ$ on a branched reference measure, and treats posterior entropy volume and joint mutual information as two complementary representations of the same limit. Entropy volume carries physical units, can be compared with engineering scales such as resolution cells, and remains meaningful when the number of active targets varies; mutual information is dimensionless, invariant to coordinates and units, and additive through the chain rule. We define entropy number, entropy volume, and mixed entropy volume for discrete, continuous, and mixed states, respectively. The maximum-entropy principle for the uniform distribution on a support of fixed measure explains the measure-theoretic meaning of the exponential entropy scale, while the main limit follows from a mixed asymptotic equipartition property and a posterior probability-volume inequality through conditional typical sets. For asymptotically reliable high-probability sensing regions, the minimum achievable first-order posterior mixed entropy volume equals the prior mixed entropy volume multiplied by $2^{-I(Ξ;Y)}$, where $I(Ξ;Y)=I(V;Y)+I(X_V;Y\mid V)$. Thus, detection and estimation contributions multiply in the volume domain and add in the bit domain, and one sensing bit halves the posterior effective measure. We further prove that posterior-preserving cascades attain the direct-inference limit, while arbitrary intermediate compression incurs the exact information loss $I(Ξ;Y\mid Z)$. Numerical results for a single-target presence-range model illustrate the information composition, posterior entropy-volume contraction, and cascade-interface loss.

Closest papers

Nearest neighbours by meaning across the whole index.

Source Entropy-Guided Adaptive Transmission for Communication-Driven Multi-View Sensing

cs.IT eess.SP ·2026-09-16 ·Mingjie Yang, Guangming Liang, Dongzhu Liu, Lei Zhang, Xiaonan Liu +1 more
similarity 0.55
Abstract

Communication-driven multi-view sensing relies on routine communication transmissions for sensing acquisition, while the resulting sensing data at distributed devices must be uploaded to an edge server under limited communication resources. This creates a unique coupling between sensing acquisition and edge inference: the communication interval determines the source information, whereas the uplink condition determines how much information can be delivered to the server for sensing inference. To account for this coupling, we propose a source entropy-guided adaptive transmission framework. Specifically, we characterize the entropy of packet-triggered channel state information (CSI) as a function of the communication interval using a multi-output Gaussian process. The resulting analytical bound is compared with the available bit budget, determined by the transmission rate and latency requirement, to select between original-data and task-oriented transmission. For task-oriented transmission, we formulate the communication-constrained inference problem based on the information bottleneck and decompose it into adaptive distributed encoding and multi-view inference (ADE-MI), which avoids alternating optimization between the devices and the edge server. Experiments on the Widar3.0 multi-view CSI gesture recognition dataset show that the analytical bound closely follows the normalizing-flow numerical estimate, while ADE-MI outperforms task-oriented benchmarks under the same bit budget and the proposed framework further improves recognition accuracy under time-varying channels.

0.20

Distributional statistics of nonequilibrium

cs.IT cond-mat.stat-mechmath.PRphysics.data-an ·2026-10-24 ·Harrison Hartle, Aanjaneya Kumar, David H. Wolpert
similarity 0.55
Abstract · 23 pages, 5 figures

We establish a reference modeling framework for random probability distributions subject to constraints. Generalizing the hyperensemble approach of Crooks, we formulate Jaynesian priors of maximal uncertainty over the unit simplex of categorical distributions. This framework is entirely general, but we primarily investigate models with constraints on physically relevant quantities, namely, average energy and Shannon entropy. A constraint on the exact value of average energy uniquely determines a Boltzmann-Gibbs equilibrium, but also defines a hyperplanar subset of the probability simplex consisting of all distributions with that value of average energy. The associated hyperensemble has a uniform probability density across all such distributions, regardless of distance to equilibrium. Such reference models make predictions of generic nonequilibrium properties such as the mean and modal microstate distributions and the expected free energy of a random distribution, which we examine analytically and via exact sampling algorithms. Moreover, introducing constraints on Shannon entropy permits parametric access to tunably nonequilibrium regimes. The approach follows conventional Jaynesian modeling logic and is compatible with standard Bayesian inference, and reduces to Boltzmann-Gibbs statistics when Shannon entropy is maximized. We examine the physical predictions of this scheme, and demonstrate its wide compatibility with other approaches to nonequilibrium modeling. We illustrate the framework in three scenarios: (i) comparison to superstatistics quasi-equilibrium modeling, (ii) generation of random nonequilibrium steady states, and (iii) Bayesian inference under a prior hyperensemble. We highlight numerous prospects for theoretical extensions and empirical application.

0.25

When Information Is Not Enough: Accuracy-Constrained Thermodynamic Costs of Binary Classification

cs.IT ·2026-09-25 ·Xuening Wu
theory similarity 0.54
Abstract

How much entropy must a physical classifier produce to achieve a prescribed accuracy? Rate--distortion theory specifies the minimum information required, but does that information threshold suffice to determine the physical cost? We show that it does not, even for a binary task and a two-state memory. For a uniform binary target observed through a finite symmetric experiment, replacing the classification-error constraint with its necessary mutual-information threshold strictly lowers the infimum of entropy production under a common operation time, integrated mobility budget, and sufficiently large finite transition-rate cap. The separation holds whenever the target error lies strictly between the Bayes error of the observations and chance. Two results establish this physical gap. First, ordering observations by posterior confidence gives exact transport--risk and transport--information frontiers. Observations with the same Bayes error can have different cost frontiers. Second, we construct bounded-rate protocols that realize prescribed encoders with write probabilities below one, starting from exact reset, with an explicit excess cost above the transport bound. An achievable information-constrained cost then falls below a lower bound valid for every task-feasible protocol. Examples with repeated noisy observations illustrate the separation. The results identify a limitation of information-only benchmarks for physical classification: task accuracy and kinetic constraints must be retained explicitly. The cost analyzed is total entropy production during memory writing, excluding data acquisition, controller operation, and subsequent reset.

0.35

Redundancy and synergy in multivariate Gaussians via the Blackwell order

cs.IT stat.ML ·2026-10-05 ·Artemy Kolchinsky
theory similarity 0.54
Abstract

The goal of the partial information decomposition (PID) is to quantify the redundant and synergistic information that multiple sources provide about a target. PID has many applications in machine learning, neuroscience, and other fields, but defining and computing it for high-dimensional continuous systems remains challenging. Here, we define a PID for multivariate Gaussian systems based on the Blackwell order, which formalizes when one channel is more informative than another. We prove that Gaussian channels are optimal for extracting both redundant and union information, yielding an intuitive geometric interpretation and an efficient numerical algorithm for the PID. Our union information and synergy coincide with the well-known BROJA measures, and we derive closed-form expressions for both in the case of two sources. We also argue that Blackwell redundancy (which differs from BROJA) is the only existing redundancy measure that satisfies a set of natural desiderata. We demonstrate the scalability of our method on systems with up to a thousand dimensions or sources. Our approach is illustrated on an optimal control problem, where it identifies redundant and synergistic interactions between sensor and memory.

0.32

Fisher Information and Support Complexity of Gaussian Mixtures

cs.IT ·2026-10-15 ·Luca Barletta, Alex Dytso
theory similarity 0.53
Abstract · 24 pages, single-column

We study lower bounds on the Fisher information of Gaussian location mixtures and their applications to estimation problems. First, for a discrete mixing distribution, we derive a universal positive-semidefinite lower bound on the Fisher information matrix in terms of the Rényi entropy of order two. For a mixing distribution supported on $K$ points, this bound scales as $\log(K)/K^2$, improving by a logarithmic factor on the support-size dependence obtained from Stam's inequality. We then develop dimension-aware trace bounds using classical Sobolev inequalities. These bounds are expressed in terms of Sibson's $α$-mutual information and yield the scaling $K^{-2/n}$ in dimension $n$. A complementary bound involving the $α$-mutual information of order $1/2$ is obtained using the sharp Young convolution inequality. The derived inequalities are further specialized to rotationally invariant mixing distributions supported on discrete spherical shells. In this setting, an intrinsic-dimensional bound on Sibson mutual information leads to lower bounds on the Fisher information in terms of the number of occupied shells. As applications, we study least favorable priors for bounded Gaussian mean estimation. In the scalar case, we show that the least favorable prior on $[-R,R]$ has at least $Ω(R\sqrt{\log R})$ support points and that each of its probability masses is of order at most $1/R$. In the vector case, we show that the number of occupied shells grows at least linearly with $R$. Finally, Brown's identity and the I-MMSE relationship are used to translate the Fisher-information inequalities into upper bounds on the MMSE and mutual information.

0.28

Remote State Estimation with Unreliable Communication: Information Asymmetry and Belief Structure

eess.SY ·2026-09-21 ·Ioannis Tzortzis, Themistoklis Charalambous
similarity 0.53
Abstract · 6 pages, conference paper

In this paper, we study remote state estimation under unreliable forward and feedback communication between a smart sensor and a remote estimator. When the sensor cannot perfectly reconstruct the filtering state maintained by the remote estimator, an information asymmetry arises between the two sides of the network. To analyze this asymmetry, we first characterize the internal state maintained by the remote estimator and its evolution under the packet reception process. The sensor's uncertainty about this state is then captured through a belief conditioned on its information set, and we derive a recursive update under noisy acknowledgment feedback. Finally, we show that the resulting belief admits a finite Gaussian mixture representation whose number of components grows at most linearly over time, ensuring computational tractability. Simulation results illustrate the impact of information asymmetry on the estimation performance and demonstrate the effectiveness of the proposed framework.

0.25

Inverse Design of Finite-State Channels by Dynamic Measure Matching

cs.IT ·2026-11-02 ·Lav R. Varshney
similarity 0.53
Abstract

Inspired by the optimization approach to biology, we formulate an inverse problem for communication with memory: construct a finite-state channel for which a given signaling behavior supports capacity-achieving codes. Dynamic measure matching is introduced to turn a directed-information converse into conditions on the channel dynamics. These conditions lead to a new notion of dynamic surprise: the log ratio of physical to test output probabilities with a continuation correction for future signaling opportunities. The matching inequalities bound its conditional mean. For fixed architecture, test law, and potential, channel row synthesis under convex physical restrictions is convex. For every signaling constraint represented by a finite irreducible constrained graph of positive entropy, we construct a channel law under which undesired inputs remain available and behaviorally distinct while incurring a strict information penalty. A noisy refractory family has an exact capacity plateau, followed by an interval in which Shannon and zero-error feedback capacities differ. Explicit zero-error codes attain capacity in the graph construction and on the plateau. In this family, a Gibbs choice maximizes the penalty and makes dynamic surprise equal its conditional mean on every transition, yielding an exact trajectory-wise likelihood identity, a finite-block bound on successful decoding with premature requests, and an exponential strong converse. An exact gap decomposition into action residuals and output-law divergence constrains every reliable capacity-approaching code. Within the strict plateau, positive discrimination exponents for unused dynamics require a positive rate loss, while sparse probing permits consistent estimation at asymptotic capacity. A chemical channel illustrates how premature stimulation can alter future responsiveness while leaving the immediate output law unchanged.

0.21

Entropy-Gated Belief Coordination for Decentralized Multi-Agent Search Under Intermittent Communication

cs.RO ·2026-10-05 ·Mohamed Abdelnaby, Kevin Leahy
similarity 0.53
Abstract

We study decentralized multi-agent target search where homogeneous agents communicate intermittently at Poisson-distributed times. Standard unconditional belief fusion wastes communication opportunities by synchronizing agents during high-entropy exploration, when diverse independent beliefs provide better coverage than a premature consensus. We introduce \emph{entropy-gated belief coordination}, in which agents skip fusion while their collective entropy ratio exceeds a threshold~\(θ\) and merge only during exploitation, consistent with the bifurcation structure of nonlinear opinion dynamics and the submodular structure of the per-step information gain objective. We further derive \(\Istep(α,β)\), the expected mutual information per observation step between two agents' binary sensors, as an interpretable, communication-free measure of sensor informativeness that motivates the gating design and guides system-level analysis. Experiments across 103{,}680 trials (nine grid sizes up to \(100{\times}100\), Poisson communication timing, four target movement patterns) show that the Entropy-Gated Trust-Decay Planner (\textsc{EG-TDP}), which adds a detection-probability planner switch in exploitation mode, achieves mean belief quality \(\bar{Q}=0.300\) (mean belief mass at the true target cell, averaged across all trials and steps), a \(58.9\%\) gain over arithmetic mean and a \(37.4\%\) gain over visit-weighted fusion. On representative configurations, EG-TDP also outperforms a joint-Bayesian reference that uses all agents'~observations at every step, despite operating under random intermittent contact only.

0.19