CS Paper Radar

Enforcing a Strict Safety Margin in LLM Text Generation via Barrier Lyapunov Control

Anand Singh, Shubham Singh, Anjali Tiwari, Katsuki Fujisawa

eess.SY ·submitted 2026-10-13 08:16 UTC · v1
theory

Abstract

Large language models are increasingly deployed without formal guarantees against toxic text generation. Existing control barrier function (CBF) based safety filters can keep the generation trajectory within a toxicity-free region, but do not enforce a positive distance from its boundary, allowing formally safe trajectories to approach the toxicity threshold arbitrarily closely and leaving little buffer against modelling errors or disturbances. We address this limitation with a Barrier Lyapunov Function (BLF) safety filter that enforces a prescribed clearance margin throughout generation while retaining the continuous-time transformer dynamics, including feedforward layers. The resulting safe input set is a half-space defined by a constraint affine in the control input, and is non-empty under certified surjectivity and classifier-nondegeneracy conditions. For margin-compatible initial conditions we prove that the clearance margin is never violated and that the prescribed clearance is restored exponentially, yielding an explicit clearance floor, and show that, as the margin vanishes, the admissible trajectories satisfy the exponential second-order CBF condition. We further derive an explicitly computable sufficient disturbance budget under which the clearance guarantee degrades gracefully. Simulations on a small transformer illustrate the resulting improvement in safety clearance.

Closest papers

Nearest neighbours by meaning across the whole index.

Robust Dynamic Safety Margins are Robust Control Barrier Functions

eess.SY ·2026-10-27 ·Victor Freire, Saber Jafarpour, Marco M. Nicotra
similarity 0.66
Abstract · 15 pages

This paper establishes robustness properties for control barrier functions (CBFs) constructed using dynamic safety margins (DSMs). We show that DSMs can act as robust CBFs by leveraging input-to-state stability for Lyapunov-based constructions, and contractivity for trajectory-prediction-based approaches. Additionally, we derive closed-form DSM-based robust CBFs (RDSM-RCBFs) specifically for linear systems. Simulations highlight the improved robustness of the proposed RDSM-RCBFs compared to nominal DSM-CBF baselines.

0.17

Bounded Reachability & Jailbreak Detection via Contraction-Constrained State Space Models

cs.AI ·2026-10-02 ·Omanshu Thapliyal
theory similarity 0.64
Abstract · 21 pages, 18 figures, AIMS Workshop @ COLM 2026

Safety heads are lightweight classifiers attached to pretrained language models for flagging harmful inputs before generation. Their empirical detection performance has been studied, but their formal robustness properties remain largely unexplored. We ask when a State Space Model (SSM)-based safety head can be certified to produce the same prediction for all inputs within a bounded embedding-space perturbation. We prove that the answer turns on a single condition: the $l_\infty$ norm of the state transition matrix must satisfy $\norm{A}_\infty<1$ (the \emph{contraction condition}), which enables exact interval bound propagation (IBP) certification for linear time-invariant classifiers. When the contraction condition holds, the reachable output interval has bounded steady-state width and examples can be certified as robustly classified. When it fails, the interval grows exponentially with sequence length and certification is impossible at any practical perturbation radius. We enforce contraction with a hinge penalty and show on toxic comment data that certified fraction improves from 41\% to 59\%, with a sharp empirical phase transition at $\norm{A}_\infty=1$ matching the theory. Applying a contraction-regularized S4 head to jailbreak detection on JailbreakBench, we achieve a zero-shot transfer to AdvBench (DR=0.994) and HarmBench (DR=0.988). A logistic regression on mean-pooled Mamba-130M embeddings matches or exceeds the S4 head on every detection metric, confirming that harmful intent is already linearly separable in the embedding space. The S4 safety head's contribution is not superior discrimination but the formal certification that no probe-based approach provides.

0.19

Neural Barriers: An Online Certifiable Learning-enhanced Adaptive High Order Safety Critical Control

cs.RO ·2026-10-04 ·Lishuo Pan, Mattia Catellani, An Cao, Lorenzo Sabattini, Nora Ayanian
similarity 0.64
Abstract · 14 pages, 11 figures, 3 tables

Control barrier functions are an effective model-based tool to formally certify the safety of a system. However, transferring their theoretical guarantees to real-world robotics systems requires high model fidelity. For example, payloads or wind disturbances can cause significant model perturbations to an aerial vehicle, leading to safety compromises. In this work, we propose a certifiable online learning-enhanced robust adaptive control barrier function, which adapts to disturbances using a Neural ODE and quantifies its adaptation uncertainty with conformal prediction. Our approach guarantees safety at all time under unknown time-varying model disturbances. It adopts a conservative strategy when the adaptation uncertainty is high; and efficiently adapts to reduce controller conservativeness as it receives more data. Our approach provides a provable safety guarantee with a probability bound under suitable Lipschitz smoothness assumptions on the underlying model and trajectory. These results demonstrate the potential of our method as a practical safety controller for robotics system operating under model perturbations.

0.23

The Space-Time Transform: Memory-Augmented Control Barrier Functions

eess.SY ·2026-08-31 ·Avinash Malik
theory similarity 0.62
Abstract · 12 pages, 1 figure

Control Barrier Functions (CBFs), their High-Order variants (HOCBFs) and Exponential CBFs (ECBFs) are standard geometric tools for enforcing nonlinear safety constraints. CBFs, and their variants, offer an elegant geometric framework for nonlinear safety, yet mathematically, they reduce to continuous-time convolutions restricted by zero-memory kernels. In the presence of high-frequency measurement noise, these memoryless operators act as improper filters, leading to significant control chattering and the potential loss of active control authority due to Quadratic Program (QP) infeasibility. To address this structural limitation, this paper introduces a space-time transform that embeds dynamic temporal filtering directly into the safety constraint synthesis. By designing a proper spatio-temporal kernel, this approach inherently attenuates high-frequency noise while preserving affine control authority. Crucially, we prove the robust forward invariance of the designed STT-CBF. Monte Carlo simulations of a third-order system demonstrate that the proposed framework achieves a 100% safety rate while reducing control total variation by over 99% compared to conventional parameterized barrier methods, mitigating hardware hazards and enabling reliable deployment on physical robotic platforms.

0.18

Decoupled Safety Control: A Safety-Control Algorithm for Training-Free Safety Guidance

cs.CV ·2026-10-15 ·Huilin Zhou, Ruoxi Cheng, Yuhang Wang, Yuming Liu, Minghao Sun +2 more
top venue similarity 0.62
Abstract · Accepted to NeurIPS 2026

Diffusion models achieve strong performance in text-to-image generation, but they can still produce unsafe content. Training-free safety guidance offers a practical inference-time alternative that intervenes during sampling without modifying model weights. However, many existing safeguards still rely on a coupled safety-control chain. In this chain, the same unsafe condition simultaneously specifies what should be avoided, indicates the current unsafe signal, constructs the intervention, and determines when that intervention remains active. This coupling can work when unsafe factors are explicit, but becomes less reliable once harmful and benign semantics are entangled in the current generation state, often leaving residual unsafe content or unnecessarily degrading benign-generation quality or prompt fidelity. We address this problem with Decoupled Safety Control (DSC), a plug-in safety-control algorithm for training-free safety guidance. DSC reformulates training-free safety guidance as an explicit state-dependent control process, so the executed intervention is determined from the current generation state rather than inherited directly from a single unsafe condition. Experiments on standard safety benchmarks show that DSC improves representative latent- and text-space safeguards, achieving stronger unsafe-content suppression while preserving benign-generation quality and maintaining efficient inference.

0.33

Control Barrier--Value Functions under Partial Observability: Safety Guarantees via Conformal Prediction

eess.SY ·2026-08-13 ·Niloofar Jahanshahi, Mo Chen
similarity 0.61
Abstract

This paper studies safety analysis and controller synthesis for partially observable nonlinear control systems. We extend the control barrier--value function (CBVF) framework, which combines Hamilton--Jacobi reachability and control barrier functions, to settings where full state information is not available and control is based on an estimated state. Given an estimator, we apply conformal prediction to the estimation error and obtain an error bound at a user-chosen miscoverage level. We incorporate this bound into the estimator-space safety analysis and define a CBVF-based safety certificate for partially observable systems. We then derive a finite-horizon probabilistic safety guarantee for the true system state. Finally, we propose a QP-based online safety filter for systems affine in the control and disturbance, whose solution enforces the CBVF safety condition in real time against bounded disturbance. The proposed framework is illustrated on a partially observable obstacle-avoidance case study.

0.04

Robust Safe Control Under Uncertainty: Estimation, Contraction, and Regret Bounds

eess.SY math.OC ·2026-11-11 ·Changrui Liu, Liang Wu, Anil Alan, Shengling Shi, Bart De Schutter
similarity 0.60
Abstract · 15 pages, temporary, (optional) simulation to be added

Disturbance uncertainty requires safety filters based on control barrier functions (CBFs) to leave a robustness margin, which can alter the nominal control input and degrade closed-loop performance. This paper studies safety and the resulting performance loss for discrete-time nonlinear systems with additive disturbances and polytopic input constraints. We develop a causal disturbance observer and construct two robust barrier conditions. The first uses a time-dependent bound on the estimation error. The second uses a constant margin when the disturbance increments are uniformly bounded and moves the requirement on the initial error from the online filter to an explicit initialization condition. For affine barriers, both filters are quadratic programs. We bound their input deviations from an oracle filter with access to the current disturbance and derive sufficient conditions for uniform contraction of the oracle closed loop. The contraction analysis accounts for state-dependent actuation, unmatched disturbances, and active physical input limits. Combining the sensitivity and contraction estimates gives finite-time dynamic regret bounds that quantify the effects of observer convergence, disturbance variation, and robustness margins. With sublinear cumulative certified disturbance variation and observer innovation error, the bounds yield sublinear regret.

0.35

Regions of Attraction of CBF-Based Safety Filters for Stable Planar Linear Systems

eess.SY ·2026-10-15 ·Adam K. Kiss, Pol Mestres, Andras Bartfai, Shima Sadat Mousavi, Aaron D. Ames
similarity 0.60
Abstract

In this paper we study the dynamical properties induced by safety filters based on control barrier functions (CBFs). These are obtained by minimally modifying a nominal controller with the goal of rendering it safe. We consider the simple setting of a planar linear plant with a stable linear nominal controller and an affine constraint. We show that even in this simple setting, the filtered system can oscillate or diverge while remaining safe. We fully characterize the parameters for which the origin is globally (exponentially or asymptotically) stable. For all other parameters, the filter creates a saddle on the constraint boundary, and we characterize the region of attraction of the origin. For underdamped nominal dynamics, its boundary is an unstable periodic orbit, a homoclinic loop, or the saddle's stable manifold, depending on whether the CBF gain is below, at, or above a homoclinic transition value. A vehicle sideslip example and two three-dimensional examples illustrate the results and what changes beyond planar dynamics.

0.18