CS Paper Radar

Where Generated Floor Plans Stop: Calibrated Sample-Level Checks Against a Built Baseline

Yiliang Shao

cs.CV ·submitted 2026-10-13 15:29 UTC · v2
unusual

Abstract

Floor plan generators are judged mainly by Compatibility, a graph edit distance to the requested adjacencies that is near saturation and blind to room shape. Our sample-level protocol calibrates each threshold no standard states at a declared false-rejection rate on real samples and grades them with the same checks. It reports each sample at its first failure, counts samples without a verdict apart, and attributes a stop to the generator or to its representation where a control exists. We apply it, with a production layout solver's checks, to four published generators against two built corpora, RPLAN and Modified Swiss Dwellings (MSD). A squareness check set per room type refuses 5 per cent of RPLAN apartments and 33.7 per cent of House-GAN++ plans. The gap survives resolution, tracing and orientation controls. Pooled over rooms, a Wasserstein distance on squareness orders the generators nearly as the check does but separates House-GAN++ from the built corpora by far less. Taken per plan on the check's worst-room margin, it separates them about fivefold to sevenfold. Within the GAN generators, Compatibility barely predicts which plans pass. We release the checker, which reproduces the solver's first failing check on 3,998 held-out RPLAN plans.

Comment
v2: retitled and reframed around a calibrated sample-level check protocol; main text shortened and revised, with supporting detail moved to the appendices. 30 pages, 8 figures. Checker released as floorcheck v0.1.1, https://doi.org/10.5281/zenodo.23129970. Supplementary material 1 (transfer specification) is the ancillary file anc/specification.pdf

Closest papers

Nearest neighbours by meaning across the whole index.

Hard-Gate Candidacy in a Deployed Validator Suite

cs.LG cs.AI ·2026-09-30 ·Xin Xu
publishedpositiontheory similarity 0.57
Abstract · 7 pages, 1 figure, 2 tables. NeurIPS 2026 Workshop: Can We Trust the Judge? (JUDGe)

Before a validator can be promoted to a hard gate on a deployment pipeline, it has to be shown that its firing separates outputs that reach users in working order from those that do not. We run that screen on 13 validators in a deployed generative agent, against 550 runtime and 350 static builds labelled by downstream outcome, and report each check's marginal separation $J=\mathrm{TPR}-\mathrm{FPR}$ with Newcombe intervals and Fisher exact tests. Two checks survive correction for multiple comparisons, two more are nominal only, and the remaining nine are not distinguishable from zero, three of them because they never fired on any sampled build. Execution itself is not random with respect to the property being gated, and this replicates: across four runs covering 1,867 builds and ten distinct runtime checks, probes were skipped on 144 of 895 broken builds and 1 of 972 acceptable builds (per-run rates 15.6% to 16.6% against at most 0.3%), every skip carrying the same unsafe-to-probe reason. Because a skipped check is recorded as a pass, this imposes a ceiling that no check quality can lift: a check that needs a live artifact cannot operationally detect more than about 84% of broken builds in this harness. For the one check with construct-specific labels, a detector built for blank output fires on 0 of 90 human-labelled blank builds (95% upper bound on sensitivity 3.3%), and the global frame statistic it approximates separates the classes only weakly (AUC 0.59), so the gap is not a threshold that needs tuning. The same gap appears one layer up: on a census of tens of thousands of judge-scored builds, 32.5% of rejections carry no recorded issue at all. We argue that evaluation records must distinguish a check that ran and passed from one that did not run, must carry the evidence for a rejection, and that an inventory of checks is not evidence about a gate.

0.36

Evaluating AI Agents for Industrial-Level Chip Floorplanning: A Framework and Empirical Study

cs.AI ·2026-11-09 ·Nova-Silicon Team
similarity 0.57
Abstract

Floorplanning is an early step in turning a logical circuit into a physical chip: it positions large circuit modules and constrains the space available for subsequent logic placement and wiring. These decisions affect congestion and timing, but their physical consequences emerge through downstream implementation. For AI agents, the task requires translating engineering constraints into spatial decisions whose quality cannot be judged by successful tool execution alone. We present an evaluation framework that connects submitted layouts to a prescribed downstream implementation flow, checks geometric validity, measures physical quality, and reports resource use. On one industrial design whose 99 macros occupy approximately 71\% of a fixed L-shaped layout region, we compare our specialized system Nova-SI with general-purpose engineering agents and agents restricted to file access, obtaining complete physical measurements for 39 layout outputs. Under our 0--100 composite quality score, Nova-SI achieves a mean of 57.97 without online feedback from the prescribed power-grid and placement evaluation, compared with 31.17 for the strongest measured general-purpose configuration, GPT-6 Astra. The difference is supported by raw congestion and timing measurements and persists across scoring-sensitivity checks. Layout-level analysis further shows that similar global utilization can conceal substantially different local congestion. Together, the protocol and case study assess agents through the physical consequences of their delivered layouts and provide evidence about system performance on this industrial instance.

0.23

Trinity: One Differentiable Physics for Training, Refining and Scoring Generative Floorplanners

cs.LG cs.AR ·2026-10-04 ·Shih-Ying Yeh, Tzu-Sian Wang, Xuehai Wang, Jia-Hua Lee, Daniel Z. Kaplan +5 more
code/data similarity 0.57
Abstract · Shih-Ying Yeh and Tzu-Sian Wang contributed equally. 85 pages, 65 figures, 67 tables. Project page: https://kohaku-lab.github.io/Trinity/ Co…

Floorplanning arranges the blocks of a chip and decides their shapes under objectives that press blocks together, short wirelength and a small outline, and constraints that hold them apart, non-overlap, clusters, MIB shapes and boundary blocks. Recent diffusion placers train on reference layouts alone and leave this coupled system to guidance, post-hoc loops and a legalizer, reporting only the endpoint, which hides what the generator contributes. We re-implement four of them under one recipe on FloorSet, score raw, refined and legalized layouts on one scale, and propose Trinity, a flow-matching floorplanner whose six differentiable functions for the constraints and objectives are its training loss term, the energy of a closed-form refiner after sampling and the base of a soft cost for every stage. The network thus learns the correction prior placers apply in their samplers, and sampling needs no guidance. Stage by stage, the training term lowers a plain transformer's raw soft cost by 26% and matters most at short budgets, the shared refiner decides more of the final cost than the generator and matches a ported placer's loop in 16 to 660 times fewer steps, Trinity's refined soft cost is 36% below the best ported pipeline, the soft cost ranks settings as the contest's hard cost does, and on the FloorSet val set the pipeline reaches a mean hard cost of 1.014 in 1.63 s per case.

0.40

When Should a Network Emit Geometry, and When Should It Detect It? Readout, Reconciliation, and Representation in Floorplan Vectorization

cs.CV ·2026-08-26 ·He Zhang
benchmarkcode/dataunusual similarity 0.56
Abstract · 21 pages, 4 figures. Code and benchmark: https://github.com/Cyprinus12138/fpvec-lab

A network trained to recover the walls, openings, and rooms of a rasterized floorplan can produce its output in two ways: by emitting the geometry as an autoregressive coordinate sequence, or by detecting it on dense junction and centerline heatmaps and assembling a graph. We compare the two readouts on the same trained network. On real scans (CubiCasa5K) detection is better on every wall measure (+2.7 wall F1 at tolerance 0.05, +5.1 at 0.015; paired bootstrap intervals exclude zero), and reading an opening heatmap the decoder never used raises opening F1 by 2.6x without retraining. Within real scans the readout's advantage grows with plan size and reverses on small plans; on clean vector renders sequence decoding is better by 5 to 8 points where its training covered the render style, while under full domain shift the readout, given calibrated thresholds, stays ahead; neither ink density nor plan size explains the reversal. With matched data and recipe, a room-centric system with a reconciliation step and a wall-first sequence model reach comparable wall quality, so the output representation matters less than is usually assumed. A prior from the other family helps at the output but not at the input: deterministic fusion of the two outputs raises wall F1 by 7 points, whereas conditioning one model on the other's output gives no gain in three forms, including two ground-truth-content controls. We also provide an edit-cost metric that scores a draft by the human work needed to correct it, corrected CubiCasa5K annotations, and ResPlan-FP, a CC BY 4.0 benchmark of 16,998 plans with frozen splits and three baseline tracks. Code, the benchmark, and the corrected annotations are available at https://github.com/Cyprinus12138/fpvec-lab

0.41

Freeze, Validate, Report: Auditing Urban Station Plans with Common Evidence

cs.CY ·2026-09-30 ·Julian Teusch, Oliver Keszöcze
similarity 0.55
Abstract · Author preprint. Accepted for publication in the proceedings of the 4th ACM SIGSPATIAL International Workshop on Advances in Urban-AI (Urban…

Transport authorities comparing urban station plans need to distinguish plan differences from differences in evaluation inputs. Reconstructing spatial units, included trips, or candidate blocks from each plan's access outcomes can make scores incomparable. Freeze--Validate--Report fixes an evaluation contract: target trips, proxy groups, reporting cells, candidate pools, and a lexicographic selection rule. A two-point example shows that plan-specific observation selection can reverse the target mean ordering. We compare seven generators spanning clustering, facility location, fairness-oriented adaptations, and a grid control. All plans are scored on common validation evidence using endpoint distance: the sum of origin and destination distances to their nearest stations. A five-metric rule selects one plan for a single test report. In Porto, it selects IFkCO, an adaptation of individually fair $k$-center with outliers; test overall and worst-group 90th percentiles are 805 m and 872 m. In Chicago, it selects Grid; values in a later test window on the same day are 1404 m and 1656 m. Post hoc checks show input sensitivity: expanding candidates from 300 to 600 changes selection in both cities, while holding the hour fixed across three Chicago dates selects Priority. A proportional mean fairlet diagnostic shows that plan-specific proposal pools can change diagnostic ranks; admissibility and solver bounds apply only to the sampled pool. The package supplies code, hashes, decision logs, and proposal pools. We establish auditability within a declared contract, not stable performance after deployment; proxy definitions and metric priorities remain the authority's choices.

0.31

RenoLayout: Unified Floorplan Renovation and Furniture Layout for Constraint-Aware Residential Design

cs.CL ·2026-10-15 ·Jingguo Liu, Yuanqing Liu, Chong Zhang, Yue Yang
benchmark similarity 0.55
Abstract

Residential design aims to transform existing homes into functional living spaces while satisfying diverse design preferences and physical constraints. However, existing floorplan generation methods typically assume empty building boundaries as input, whereas renovation requires reasoning over existing floorplans. Furthermore, floorplan renovation and furniture layout are commonly addressed as separate tasks, overlooking their inherent spatial dependency. Consequently, practical residential design must preserve immutable structural components while transforming editable spatial elements. It must also optimize furniture placement under design objectives and physical constraints. To address these challenges, we formulate residential design as a design-point-guided conditional generation task and propose RenoLayout, a framework that translates a pre-design residential state together with a design-point set into an executable Geometry-as-Code program. To enable controllable supervision, we construct a Design Map comprising 123 fine-grained design points covering structural renovation and furniture layout. We further introduce Difference-Grounded Design-Point Annotation to derive design-point sets automatically from before--after design pairs with VLM-based consistency verification. RenoLayout is trained using a three-stage CPT--SFT--RL pipeline, progressively improving spatial reasoning, instruction following, and constraint compliance. We also introduce the RenoLayout Benchmark, a set of 200 real-world before--after renovation cases with complete furniture layouts. To the best of our knowledge, it is the first benchmark for unified residential design. These cases include design-critical structural and building-service constraints.

0.11

Evidence-gated multimodal parsing and vectorization of architectural floor plans

cs.CV ·2026-09-22 ·Hongxuan Chen, Wenda Wang, Jiachen Lu, Qirui Shen, Zilong Huang +3 more
benchmark similarity 0.54
Abstract · 33 pages, 43 figures, 27 tables

Architectural floor plans remain a high-friction barrier to archive digitization and early design-model preparation because heterogeneous graphics encode spatial semantics and editable geometry together. We introduce SALI-FP, an evidence-gated multimodal pipeline that converts a plan into reviewable semantic maps, objects, vectors, and relation records while constraining local revisions by image evidence. In a full production audit of 11,534 heterogeneous plans, SALI-FP produced structured outputs for every plan, including 752,510 valid polygon-bearing objects. The same output form has supported initial drawing digitization and design-model preparation in practical design work. Public-benchmark calibration is paired with a 30-case matched visual evidence set in Appendix F, where room-scale coverage, openings, oblique boundaries, and circulation continuity can be inspected directly. SALI-FP offers an engineering-oriented interpretation-to-geometry workflow for reviewed CAD/BIM preparation and existing-building information recovery.

0.16

Sampling-based Certified Planning with Graphs of Convex Sets

cs.RO ·2026-08-30 ·Peng Xie, Amr Alanwar
similarity 0.53
Abstract

Planners on graphs of convex sets return trajectories that are collision-free by construction, provided the convex regions are collision-free. The region generator only promises that property probabilistically, and no planner in the family verifies it. We report the first measurement of what the gap costs. On a scaled 14-DOF bimanual library, $3.2\%$ of interface samples are in collision, and a search-based GCS planner (\gcsstar) turns that volume error into a $62\%$ answer error: $18$ of $29$ pick-and-place queries return trajectories that drive the arms through the shelves, up to $91$\,mm deep, reported as successes. Repairing the library does not work; a ten times stricter acceptance contract, sums-of-squares certified regions, and uniform margins each destroy the connectivity planning needs before they deliver soundness. We instead build a planner that certifies its answers. It samples the overlaps and shared faces of the decomposition, prunes with an admissible informed bound, and verifies the one candidate each search round proposes, continuously, by a chain of clearance certificate balls with no resolution parameter; failures are repaired with local in-region detours, and the convex polish is re-verified. Head-to-head on all $29$ task queries it delivers zero invalid answers against $21$ for the reference, reaches its first certified answer in $0.11$\,s against $1.59$\,s for the reference's unverified one, and reproduces the reference optimum exactly on every query whose reference answer is physically valid.

0.14