CS Paper Radar

Generalizing Soft Tissue Deformation and Force Prediction Across Material Stiffness and Geometry

Madina Kojanazarova, Sidaty El Hadramy, Philippe C. Cattin

cs.AI cs.CGcs.CV ·submitted 2026-08-21 10:39 UTC · v1

Abstract

Accurate soft tissue simulation is essential for surgical training, pre-operative planning, and haptic feedback systems. While learning-based surrogate models trained on data using the finite element method (FEM) offer a promising path to real-time inference, their reliability depends on well-calibrated constitutive models. Existing approaches neither provide systematic guidance on model selection across stiffness levels, nor generalize across different tissue stiffnesses or geometries. We perform a comprehensive calibration of hyperelastic constitutive models in the SOFA Framework using gravity-loaded silicone beams with different stiffnesses. Using calibrated simulations as training data, we use a softness conditioned equivariant graph neural network, enabling deformation and force prediction across multiple tissue types and unseen geometries. Our model achieves sub-millimeter mean deformation accuracy at 0.010s inference time, while showing that force prediction quality is directly tied to upstream calibration consistency.

Closest papers

Nearest neighbours by meaning across the whole index.

FEM-Validated Real-Time Modelling of Soft Tactile Deformation

cs.RO ·2026-10-12 ·Silvia Terrile, Kaichen Shi, Taejun Kwon, Jiseok Lee, Nathan Lepora +3 more
similarity 0.72
Abstract

Accurate modelling of soft tactile sensors remains difficult because finite element methods (FEM) are computa- tionally expensive, while real-time simulators often lack fidelity for hyperelastic deformation. Large physical datasets are also impractical to collect because repeated testing can damage fragile sensors. We present a data-efficient framework that combines limited real-world validation, high-fidelity FEM, and graph neural networks (GNNs) for accurate real-time prediction of two-dimensional tactile deformation in a planar soft tactile structure. The key idea is to decouple validation from training: 82 camera-tracked contact configurations are used only to tune and validate an ANSYS FEM model, which then generates 768 synthetic contact scenarios for GNN training. We evaluate both forward prediction from marker deformation to contact localisation and inverse inference from contact configuration to marker deformation. The validated FEM achieves sub-0.5 mm error in more than 90% of validation cases, while the learned GNN surrogate reaches a mean absolute error of 0.32 mm with millisecond-scale inference, compared with minute-scale FEM simulation. Models trained entirely on synthetic FEM data retain sub-millimetre accuracy on real measurements from the 2D tactile structure, demonstrating strong sim-to-real transfer within the tested planar setting. We further integrate the learned model into a real-time visualisation pipeline, enabling rapid deformation prediction for virtual prototyping and simulator-based design exploration without extensive physical testing.

0.24

Observation-Referenced Tissue Deformation Forecasting with Tool-Driven and Residual Dynamics

cs.RO ·2026-10-09 ·Tom Olesch, Nan Xiao, Xiongye Xiao, Jonathan C. DeLong, Fei Liu
similarity 0.64
Abstract · 8 pages, 6 figures, 1 table. Submitted to ICRA 2027

Forecasting tissue deformation from future instrument motion could support predictive planning and increasingly autonomous surgical systems. We study this problem using a scene-specific differentiable surface model fitted to an observed tool-tissue interaction window. Rather than forecasting absolute simulated positions, we introduce an \textit{observation-referenced} formulation that anchors each tissue point to its last valid observation and adds only the deformation induced by the known, preplanned future tool trajectory. This reduces sensitivity to reconstruction, initialization, and persistent simulation offsets while preserving the predicted deformation response. The physical model uses differentiable, mesh-free position-based dynamics with scene-specific rigidity, attachment, region scale, and grasp coupling. We further introduce an optional \textit{observation-referenced residual model} combining graph-spectral spatial modes with periodic harmonic dynamics for structured motion not explained by the tool input. We evaluate the framework retrospectively on 12 surgical manipulation clips from three datasets. Observation referencing provides the largest gain, with a median within-clip error ratio of $0.598$ relative to the corresponding absolute simulation forecast. The optional periodic residual further improves forecasting when the remaining motion exhibits periodic structure. These results support observation-referenced deformation prediction as a practical building block for future surgical world models, digital twins, and generative simulators that must predict how tissue evolves under instrument actions.

0.23

Learning coarse-step dynamics and internal mechanical response with graph networks

cs.LG ·2026-09-24 ·Vinay Sharma, Olga Fink
similarity 0.63
Abstract

Modern sensing records the motion of physical systems, but often leaves the forces and mechanical response governing that motion unobserved. Inferring these quantities from discretely sampled trajectories is especially difficult at coarse time scales, when mechanical response evolves between observations and interactions propagate across the system. Here we introduce Newmark-\b{eta}-DGN, a graph neural network-based framework that combines two structures inspired by computational mechanics. First, a semi-implicit update inspired by the Newmark-\b{eta} method uses learned momentum fluxes and matrix-valued response operators to advance the state over each observed interval. Second, an operator-weighted virtual hub provides system-wide coupling through a sparse set of connections. The learned quantities thus determine the predicted motion and remain accessible for mechanical analysis. Across a deformable beam, human motion and protein dynamics, Newmark-\b{eta}-DGN supports long-horizon prediction at time steps for which explicit learned simulators deteriorate. Without force, moment or constitutive relation supervision, forces inferred from walking kinematics track independently derived hip and knee joint moments, while response operators learned on the beam recover the relative spatial and directional structure of its finite-element stiffness tangent. Newmark-\b{eta}-DGN therefore links coarse-step prediction to the inference of mechanical quantities that were never observed during training.

0.15

Element-Wise Femoral Stress Prediction: A Hybrid Graph Neural Network Surrogate for Finite Element Analysis

cs.LG ·2026-11-18 ·Sikha O K, Abdollah Moslemi, Elham Alizadeh, Ludovic Humbert, Miguel A. Gonzalez Ballester +1 more
code/data similarity 0.62
Abstract · This paper is submitted to Frontiers in Artificial Intelligence

Hip fractures represent a significant clinical challenge because they cause excess disability and mortality, and have a growing incidence in aging populations, as bone fragility increases. Although finite element analysis (FEA) provides biomechanical assessment of femoral strength, its clinical applicability is mainly limited by high computational cost. Conventional machine learning (ML) approaches have been explored as surrogate models for FEA; predictions are fast but fail to capture the spatial and topological structure of finite element meshes. To address these limitations, this study proposes a hybrid Graph Neural Network (GNN)-based framework for femoral stress prediction using graph-structured finite element modeling (FEM) data. The proposed GCN-SAGE-Residual architecture combines graph convolution, neighborhood aggregation, and residual learning to model spatial dependencies and stress propagation across mesh elements. We systematically evaluated 14 models in a primary comparison, spanning classical ML methods and baseline GNN architectures, complemented by a targeted architectural ablation that isolates the contribution of each component of the proposed design. Evaluation results demonstrate that the proposed hybrid architecture achieves the strongest predictive performance among all evaluated models. The proposed hybrid model achieves the best performance with an R^2 score of 0.8022 and mean absolute error of 2.879 MPa, highlighting the importance of incorporating mesh topology in biomechanical prediction tasks. The proposed framework provides a scalable and computationally efficient alternative for FEM-based orthopedic analyses and fracture risk assessment. The code is publicly available on GitHub.

0.34

Synthetic Dataset Generation, Physical Consistency and Active Learning for Shape-Informed Surrogate Modeling of Hemodynamics

cs.CE physics.flu-dyn ·2026-10-19 ·Francesco Romor, Richard Schussnig, Charles A. Taylor, Gerhard A. Holzapfel, Alfonso Caiazzo
similarity 0.61
Abstract

Model order reduction has the potential to enable real-time patient-specific assessment of cardiovascular flows. However, it still faces significant challenges stemming from the geometric variability of vascular anatomies. Building upon the SynthAorta dataset (Bosnjak et al., IEEE Trans. Med. Imag. 45(1), 2026) of physiological aortic geometries, we generate an extensive dataset of physiologically consistent computational fluid dynamics solutions through an automatic boundary-condition adjustment procedure. A common reference geometry allows all patient-specific anatomies to be represented by displacement fields, providing point-to-point correspondence without the need for geometric registration. Based on this dataset, we develop Graph U-Net and Transformer U-Net surrogate models to predict velocity and pressure fields at peak systole. We further investigate two strategies to enhance data efficiency and prediction accuracy: active learning and differentiable physical consistency constraints based on the finite element residual. The results show that active learning is strongly regime-dependent: while it offers little benefit over random sampling during early training, it improves performance during fine-tuning through gradient- and subspace-based acquisition strategies. Similarly, physical consistency constraints prove to be substantially more effective as a fine-tuning objective than as a regularizer applied throughout training. Finally, out-of-distribution studies demonstrate that the primary limitation of surrogate models lies in the geometric support of the underlying parametrization rather than in the neural network architectures themselves. The proposed framework combines synthetic dataset generation, geometry-aware surrogate modeling, physics-informed optimization, and active learning into a scalable workflow for inter-patient hemodynamic prediction.

0.03

Physical-Field-Bridged Material Parameter Inference from Multi-View Deformation Videos

cs.CV cs.RO ·2026-10-13 ·Linrui Shou, Jie Li, Yu Liu, Tao Huang
similarity 0.61
Abstract

Estimating simulation-ready material parameters from visual observations is crucial for deformable-object manipulation but challenging because material properties are only indirectly revealed through physical responses. We introduce physical-field-bridged material inference, a single-pass framework that uses dense physical responses to connect multi-view RGB deformation videos with constitutive-type classification and continuous parameter regression. Unlike inverse-physics methods requiring per-scene reconstruction, online tuning, or simulation-in-the-loop optimization, our model predicts force/contact masks, projected motion-flow fields, and projected stress-response maps, then conditions material inference on these fields to reduce reliance on appearance or category shortcuts. We construct DeformFieldBench, a 3DGS MPM learning environment comprising 5,000 simulations across 100 object shapes and five mechanically informative loading modes, with dense pixel-aligned physical supervision. Our method achieves the best median errors on all four continuous parameters, improves stress-hotspot recall from 0.0762 to 0.5121, and attains 0.8676 SSIM/36.82 dB PSNR in same-simulator replay on unseen objects. Under a protocol-matched GSO evaluation, inference and future-state prediction take approximately 30 seconds, compared with 15-120 minutes for per-scene optimization. The method also yields measurable replay agreement on five real-world sequences. These results support dense physical fields as an effective bridge for fast material inference, while cross-simulator and real-world tests reveal remaining domain and identifiability gaps.

0.10

Single-View RGB-D Force--Deformation Estimation for Robotic Manipulation of Elasto-Plastic Materials

cs.RO ·2026-11-11 ·Dezhi Sun, Marijn van Hilten, Kenan Niu
published similarity 0.61
Abstract · 7 pages. Accepted at IEEE ROBIO 2026

Persistent deformation complicates elasto-plastic manipulation by coupling physical interaction with spatially distributed shape changes. We investigate the force--deformation relationship using a standard robot, a single eye-in-hand RGB-D camera, and intrinsic force estimates. A 7-DoF Franka Emika FR3 performs normal indentations while an Intel RealSense L515 captures pre- and post-contact surfaces. Point-cloud processing localizes deformation and estimates displaced volume. Force--volume characterization includes 27 measurements over nine force levels. A compact multilayer perceptron (MLP), trained on 52 force--volume pairs at four levels, achieves a held-out RMSE of 1.857 N and $R^2=0.440$. A separate comparison shows lower error for a quadratic model at 16 N and for the MLP at 19 and 23.5 N. An eight-step experiment at 4 N per interaction demonstrates cumulative deformation localization from the second indentation onward. These results establish a practical measurement basis for deformation-aware manipulation using intrinsic force estimates and single-view geometry.

0.22

Deep Learning-based Mechanical Characterization of Synthetically Generated Plant Fibers under Transverse Compression

cs.CV ·2026-10-12 ·Nikolaos Kegkeroglou, Bilal Sabillah, Myrto Inglezou, Vincent Placet, Céndric Clevy +1 more
published similarity 0.60
Abstract

Plant fibers are increasingly used as sustainable reinforcements in composites, but the intrinsic variability of their microstructure causes substantial scatter in transverse mechanical behavior, complicating composite design. Characterizing this behavior relies on finite element (FE) simulations requiring several minutes of high-performance computing per fiber, making high-throughput characterization across realistic fiber populations impractical. In this study, we propose a deep learning framework replacing this FE bottleneck with a fast pipeline. It includes two coupled recursive U-Nets predicting the step-by-step evolution of fiber deformation and internal stress fields under transverse compression, followed by a regression CNN estimating the transverse Young's modulus from the final stress field. Unlike prior approaches predicting stress fields for fixed configurations or idealized geometries, our framework recursively resolves the full temporal stress evolution for synthetic fibers derived from real hemp cross-sections, with or without a lumen. Trained on 1,000 synthetic fiber geometries with FE ground truth, it reproduces the stress field sequence with a Structural Similarity Index Measure (SSIM) of $0.9574 \pm 0.0074$ and a Root Mean Squared Error (RMSE) of $0.0345 \pm 0.0079$. It estimates transverse Young's modulus with an $R^2$ of $0.938 \pm 0.024$, a Mean Absolute Error (MAE) of $24.31 \pm 1.23$ MPa, and a Mean Absolute Percentage Error (MAPE) of $5.25 \pm 0.91\%$. Inference requires under one second per fiber versus five minutes per FE simulation, drastically reducing computational cost. This offers a fast, reliable tool for mechanical characterization of synthetic plant fibers, with promising applications in designing natural fiber-reinforced composites.

0.32