CS Paper Radar

How Evaluation Choices Change the Measured Benefit of Cooperative Perception: Evidence from Three V2X Benchmarks

Pincan Zhao, Yili Tang, Xinrui Zhang

cs.CE ·submitted 2026-10-01 03:56 UTC · v1
benchmark

Abstract

Cooperative perception, in which connected vehicles and roadside infrastructure share sensor information, is a candidate enabler of automated mobility, and benchmark accuracy is the evidence cited when roadside deployment is considered. This paper audits that evidence base across one simulated and two real-world vehicle-to-everything (V2X) benchmarks. In simulation, two widely studied robustness axes leave almost no recoverable headroom: an infrastructure-anchored pose correction returns about one accuracy point at every error level, and corrupting a partner costs 0.7 points. On real data, measurement choices govern the conclusion. An apparent seventeen-fold advantage of infrastructure in partner-poor frames falls below four-fold once the split is broadened, and an ad-hoc class definition measures a far smaller benefit than the official protocol reports. Cooperation is worth 7 to 15 accuracy points, yet 27% of frames on one split offer no partner and almost none do on another, so every regime-conditioned claim must name its split.

Comment
International Conference of Hong Kong Society for Transportation Studies (HKSTS) 2026

Closest papers

Nearest neighbours by meaning across the whole index.

CoMET: Tracking the Shared Pose Error of Roadside Messages for Asynchronous Vehicle-Infrastructure Cooperative 3D Detection

cs.CV ·2026-11-06 ·Shuwei Sun, Jian Huang, Hui Cao
benchmark similarity 0.67
Abstract · 25 pages, 4 figures. Code and experimental results archived at https://doi.org/10.5281/zenodo.23999418

A roadside sensor can detect vehicles hidden from the ego vehicle, but a pose error shifts every detection in the same message. We study asynchronous vehicle-infrastructure cooperative 3D detection on V2X-Seq using only information available at decision time, without ground truth, future frames, or per-pair calibration offsets at inference. Objects seen by both sensors reveal the shared translation, but even at zero added delay, 38% of validation messages have no matched pair. We propose CoMET (Common-Mode Error Tracking), which estimates this translation over time. At each message arrival, CoMET matches vehicle and roadside detections, estimates the offset from mutually nearest pairs, and updates a Kalman filter for that sender. When no pair matches, the filter carries its estimate forward. The correction applies to all roadside boxes, including those unseen by the ego vehicle. The estimator has no learned parameters; a separate frozen head ranks the merged detections. Across four delays from 0 to 400 ms on 21 validation sequences, CoMET averages 66.63 bird's-eye-view AP at IoU 0.7, compared with 63.18 for the same late fusion using uncorrected online poses and 62.96 for the best intermediate-fusion baseline. Across five detectors from three architectures, CoMET gains 2.2 to 3.5 AP points over online poses and 0.3 to 0.6 over estimating the offset from the current message alone. We find that the benchmark uses a zero offset as a placeholder in 28% of validation messages and that its offset search reaches the boundary in 45% of the rest. These offsets affect the labels for objects seen only from the roadside. Under two alternative label references, CoMET improves on uncorrected online poses in every evaluated population. Retraining intermediate fusion with CoMET poses and corrected labels improves detection on all three architectures tested, with statistically significant gains on two.

0.29

Towards Collaborative Joint Perception and Prediction: Framework, Baseline Evaluation, and Deployment Perspectives

cs.CV ·2026-08-10 ·Lei Wan, Hannan Ejaz Keen, Alexey Vinel
published similarity 0.66
Abstract · 28 pages, 4 figures, post-publication of conference paper, accepted at journal SN Computer Science

Connected Autonomous Vehicles (CAVs) increasingly exploit Vehicle-to-Everything (V2X) communication to exchange multi-source sensor information, enabling advanced Collaborative Perception (CP) capabilities. Extending beyond these capabilities, this work focuses on Collaborative Joint Perception and Prediction (Co-P&P), a paradigm that unifies CP with motion prediction to mitigate two persistent challenges: the accumulation of perception errors and visual occlusions. We present a conceptual framework for Collaborative Joint Perception and Prediction (Co-P&P) that improves motion prediction of surrounding road users, thereby enhancing situational awareness in complex and dynamic traffic environments. Building upon our preliminary study, this extended version compares the performance of different fusion strategies and establishes baseline performance for a modular design of perception and prediction. Experimental results show that prediction-level fusion leads to a decline in overall system performance compared to detection-level or tracking-level fusion. We further implement a minimal end-to-end Co-P&P prototype that couples collaborative point-cloud sharing via the RENO neural codec with joint detection-forecasting via FutureDet, showing that collaboration improves forecasting accuracy while neural compression preserves this benefit at roughly 34x lower communication bandwidth.

0.25

VIPS: Vehicle-Infrastructure Cooperative Planning Benchmark via Pseudo-Simulation

cs.CV ·2026-09-02 ·Hoonhee Cho, Jae-Young Kang, Giwon Lee, Hyemin Yang, Heejun Park +1 more
top venuebenchmarkcode/data similarity 0.65
Abstract · Accepted by ECCV 2026 Spotlight

End-to-end autonomous driving in urban environments requires robust decision-making under partial observability and complex multi-agent interactions. Severe occlusions and dense traffic at intersections limit the perception capability of single-agent systems, motivating recent efforts on Vehicle-to-Infrastructure (V2I) cooperation for perception and planning. However, existing evaluation protocols face a fundamental trade-off: open-loop evaluation fails to capture error accumulation and recovery from deviations, while closed-loop evaluation is costly, difficult to scale, and often relies on simulated environments that may suffer from domain gaps. To bridge this gap, we propose VIPS, a benchmark for cooperative autonomous driving in V2I settings based on pseudo-simulation. VIPS extends pseudo-simulation by integrating vehicle and infrastructure observations. This enables scalable yet realistic evaluation of robustness and error propagation without full simulation. We further present CoS-V2X, a cooperative planning framework based on sparse representations. CoS-V2X models vehicle-infrastructure interactions using compact features for efficient communication and robust decision-making under heterogeneous observations. Code and dataset are available at https://vips2026.github.io.

0.66

SV2V-RSim: A Comprehensive Benchmark for Self-Selective V2V Cooperative Perception with Near-Realistic Data

cs.CV ·2026-09-26 ·Yulu Wu, Chao Wei, Jujun Cheng, Zhangkai Ni, Haowen Wang +4 more
benchmark similarity 0.65
Abstract

Vehicle-to-Vehicle (V2V) cooperative perception enhances autonomous driving by enabling vehicles to share information beyond their direct line of sight. However, existing V2V datasets are limited by a small number of participating agents, static collaborator selection strategies, and a significant domain gap between simulated and real-world environments. To overcome these challenges, we introduce SV2V-RSim, a large-scale, multi-modal, near-realistic simulation dataset engineered to elevate agent diversity and realism. Additionally, we present the Select Vehicles Adaptively (SVA) module, which optimizes collaborator selection to balance perception performance against communication bandwidth constraints. Our dataset is generated using the Unreal Engine 5-based simulator that integrates high-fidelity 3D assets, diverse environments, and intricate traffic scenarios. All vehicles within a specified range of the ego vehicle are equipped with sensor suites, enabling dynamic and adaptive collaborator selection. SV2V-RSim encompasses four maps, four weather conditions, six time periods from sunrise to night, 203K LiDAR frames, 402K RGB frames, and 788K annotated 3D bounding boxes across 17 object classes, supporting a range of cooperative perception tasks such as 3D object detection, segmentation, and depth estimation. Benchmarking on recent cooperative perception algorithms demonstrates that SVA achieves a superior performance-bandwidth trade-off, while sim-to-real experiments and No-Reference Image Quality Assessment validate the dataset's high realism and practical effectiveness. Our dataset and code will be publicly available.

0.27

Understanding and Repairing Cooperative Perception under Adverse Weather

cs.CV ·2026-10-26 ·Mengxu Ma, Linshan Yan, Kailong Zhang, Ruiyang Guo, Dagang Shen +2 more
benchmark similarity 0.62
Abstract · 27 pages including supplementary material. Expanded the mechanism analysis, updated the experiments and figures, and revised the author list

A cooperative detector can lose a correct vehicle detection when surrounding LiDAR measurements change, even if the returns on the vehicle remain unchanged. We study this failure as Weather-Induced Context Interference. On our CoInfra development set, controlled removal outside annotated object boxes turns 22.1% of V2X-ViT's previously correct detections into misses. Restoring network features around the objects to their values before removal recovers 98.6% of these misses. The same restoration in each of three equally sized regions excluding the objects recovers none. Candidate analysis finds accurate boxes that are not selected, while other targets lack well-localized candidates. With paired reference features unavailable at inference, Adverse-Weather Cooperative Repair (AWCR) repairs candidates from current observations. A lightweight Local Correction head generates bounded alternatives, and Quality Selection ranks them alongside original boxes with a correction weight. In V2X-R simulation, AWCR also filters peer returns before detection using Point Classifier trained on generated-point labels. Candidate repair improves mean car BEV AP@0.7 by 4.22 points across three fits on natural adverse-weather CoInfra development inputs and vehicle AP@0.7 by 5.00 points on a rain-affected public recording. It also improves released HEAL, FadeLead, and V2X-DGW detectors with their pretrained weights fixed. On the full V2X-Radar-C validation benchmark, HEAL with AWCR achieves state-of-the-art LiDAR-only cooperative detection performance of 68.22 vehicle BEV AP@0.7.

0.26

ITS Fairy: Occlusion Assistance Selected Against a Recipient's Own Perception Reports

cs.NI cs.DC ·2026-09-25 ·Yenan Wang, Oscar Karlsson, Elad Michael Schiller, Francesco Raviglione, Claudio Casetti
similarity 0.60
Abstract · submitted to VTC2027-Spring

Cooperative perception can expose object state beyond a vehicle's onboard sensors, but sensing occlusion can still leave a local safety application without the objects its collision computation needs. To tackle this challenge, we present the ITS Fairy, an infrastructure-side Server Local Dynamic Map (S-LDM) service whose decision unit is the pair (recipient, missing conflict-relevant object): among objects absent from a recipient's CPM-derived reported awareness, it sends only those relevant to a Time of Closest Approach (TCA) conflict test. Comparable services predict what a vehicle can perceive; the ITS Fairy instead reads what it has already reported. The recipient inserts the selected state into its local LDM and uses its unchanged collision-avoidance controller. We evaluate this application-level mechanism in SUMO--ms-van3t--S-LDM emulation, since extended as VaN3Twin, using a sensing-occluded lane merge and four-way intersection scenario. At every main-sweep speed, the smallest assisted per-encounter minimum TCA exceeds the largest local-only value in the archived data. Additionally, assisted medians remain in the multi-second range where local-only operation repeatedly approaches zero. In the lane-merge robustness data, the median benefit persists at 80% configured assistance omission with 10 and 5 Hz analysis, but largely disappears at 100-120 km/h when 80% omission is combined with 1 Hz analysis. These results demonstrate the application-level value of supplying object state selected against what a recipient has itself reported. They are not a vehicular wireless-channel evaluation, and they do not quantify what selectivity saves relative to forwarding every nearby object.

0.29

The Role of Collective Perception and 5G NR-V2X Sidelink in Road Safety

cs.NI eess.SP ·2026-09-01 ·Vittorio Todisco, Mattia Andreani, Maria Luisa Merani, Alessandro Bazzi
published similarity 0.60
Abstract · Accepted for publication in IEEE Communications Magazine. 7 pages, 5 figures

Vehicles and roadside infrastructure are increasingly equipped with sensors capable of perceiving their surroundings. Sharing this information through vehicle-to-everything (V2X) communications is a key enabler of Day-2 applications and is supported by the ETSI collective perception service (CPS). While CPS is expected to play a fundamental role in future intelligent transportation systems, its operation may significantly increase channel load, posing challenges in terms of radio resource utilization, communication reliability, and information management. This paper reviews the current status of CPS standardization and investigates its impact in dense deployment scenarios where connected vehicles communicate through fifth-generation (5G) New Radio-V2X (NR-V2X) sidelink (SL) communications. The main contribution is a realistic evaluation of communication reliability, latency, channel occupancy, and information usefulness under different object-selection strategies for collective perception messages. The analysis is conducted through a network-level simulation framework integrating empirical object traces derived from real-world datasets, thereby avoiding the limitations of synthetic traffic models. Results show that perception message generation and radio access mechanisms are tightly coupled and should be jointly designed to maximize the benefits of collective perception services.

0.37

From Echoes to Evidence: Cooperative Fusion for Integrated Sensing and Communication

cs.NI ·2026-10-07 ·Xingqin Lin
similarity 0.59
Abstract · 13 pages, 10 figures, 4 tables

Cooperative integrated sensing and communication (ISAC) can support shared situational awareness for unmanned aerial vehicles (UAVs), road vehicles, and industrial mobile robots such as automated guided vehicles (AGVs). Yet multipath can make nodes agree on a virtual target while useful weak echoes remain unexploited. This paper develops cooperative fusion that separates association confirmation, state refinement, and residual recovery. A cellular reference signal model accommodates arbitrary node counts, three-dimensional motion, monostatic and bistatic links, nuisance parameters, and correlated errors. We characterize report distinguishability under bounded bias and shared-reflector ambiguities that survive additional nodes. Minimax estimation yields directional weak-report refinement that preserves confirmed associations and limits bias-sensitive innovations; acquisition accounts for request and upload costs. Controlled experiments accompany UAV evaluations under a Third Generation Partnership Project (3GPP) stochastic channel model and a ray tracing environment representing San Francisco. In the latter environment, matched-budget fusion raises detection from observable site selection's 88.75% to 92.46% and reduces the false-output fraction from 11.06% to 0.40%. Against the strongest full-band fixed site, the 90th-percentile position error on commonly detected targets falls from 8.54 to 3.50 m. Association controls, local rejection ablations, and refinement studies distinguish the sources of these gains.

0.48