CS Paper Radar

Variational Monte Carlo for Quantum Excited States via Nested Low-Rank Approximation

Minchan Jeong, J. Jon Ryu, Se-Young Yun, Gregory W. Wornell

cs.LG physics.chem-phphysics.comp-ph ·submitted 2026-11-16 17:22 UTC · v1
top venuecode/data

Abstract

The electronic Schrödinger equation encodes a molecule's electronic structure and quantum properties, but solving it scales exponentially with the number of electrons. Solving this equation with neural-network variational Monte Carlo (VMC) has reached chemical accuracy on the ground state of small molecules; extending this success to excited states is constrained by two existing paradigms. Penalty-based methods need $K$ Laplacians per step but require tuning the overlap-penalty weights against the energy gaps they aim to compute. Natural excited states VMC (NES-VMC) is penalty-free, but it combines the $K$ ansatzes into one determinant, whose local energy requires $K^2$ Laplacians per step. We resolve this trade-off via low-rank approximation (LoRA) reparameterization of the rank-$K$ variational objective. The reparameterized objective admits a VMC-compatible stochastic gradient estimator via MCMC sampling from the per-state Born densities, and a sequential nesting scheme recovers the lowest $K$ eigenstates in eigenvalue order. The resulting algorithm, NestedLoRA-VMC, inherits a global optimality guarantee from the LoRA principle. On the first-row atoms Li through Ne at $K=10$, its accuracy is comparable to that of NES-VMC and of a state-of-the-art penalty-based method.

Comment
Accepted for NeurIPS 2026. The first two authors contributed equally. 41 pages, 6 figures, 9 tables. Code is available at https://github.com/MinchanJeong/NestedLoRA-VMC

Closest papers

Nearest neighbours by meaning across the whole index.

Gradient-estimator design overcomes trainability barriers in neural-network-based variational optimization

cs.LG cond-mat.dis-nncond-mat.str-elphysics.chem-ph+1 ·2026-09-16 ·Yi-Ran Xue, Rui Wang, Baigeng Wang, Chenan Wei
similarity 0.69
Abstract · 10 pages, 4 figures; partially supersedes arXiv:2606.13912

Neural networks provide expressive representations for scientific computing. However, even sufficiently expressive networks can suffer training failure in weak-gradient regimes, limiting their practical use in quantum many-body physics and ab initio quantum chemistry. Here we derive an unbiased direct gradient estimator and introduce the adaptive minimum-variance phase (AMVP) estimator for neural-network variational optimization. By improving the signal-to-noise ratio of weak gradients, these methods enable reliable scientific calculations where training previously failed, while substantially reducing computational cost. The framework enables compact networks to outperform larger and fine-tuned default standard-estimator models with over an order of magnitude less GPU time on correlated flux models, and ultimately exceed the density matrix renormalization group (DMRG) accuracy. It further achieves chemical accuracy in N$_2$ bond breaking and, for the first time, in heavy-element I$_2$ with explicit spin-orbit coupling. These results demonstrate that gradient-estimator design expands the capabilities of neural-network variational methods for accurate scientific computing.

0.36

NucleoNet: A Nuclear-Aware Determinant Ansatz for Multi-Geometry Neural Variational Monte Carlo

cs.LG physics.chem-ph ·2026-10-09 ·Qiao Gao, Yang Huang, Enze Hou, Yuzhi Liu, Jingrun Chen +1 more
hot direction similarity 0.66
Abstract · 10 pages, 7 figures

Neural-network variational Monte Carlo provides an accurate route to solving the electronic Schrödinger equation, but many neural wavefunctions are optimized for a single nuclear geometry, requiring separate calculations to map out a potential energy surface. We introduce NucleoNet, a nuclear-aware determinant ansatz in which electrons and nuclei form a unified particle set propagated through a shared electron--nucleus backbone that jointly evolves one-particle and two-particle representations. Nuclei carry learned representations that evolve alongside the electronic representations and condition orbital construction, while antisymmetry is imposed only by electronic determinants. On equilibrium small-molecule benchmarks, NucleoNet achieves accuracy comparable to established neural-wavefunction baselines with substantially fewer parameters. For each molecular system, a single model optimized jointly across geometries describes the N$_2$ dissociation curve, Li displacement in LiCN, and the ethane and formamide minimum-energy paths for bond dissociation. Sparse-geometry training generalizes to unseen geometries for N$_2$ and LiCN without further optimization, and N$_2$ ablations show that nuclear streams substantially improve this interpolation. These results show that a compact wavefunction with jointly evolved nuclear representations can describe the geometries of a molecular system with a single set of parameters.

0.34

Learning the Kohn-Sham map with neural operators for quasi-linear scaling density functional theory

cs.AI physics.chem-ph ·2026-08-24 ·Danish Khan, Maurice D. Hanisch, Nikolai Argatoff, Evan Xie, Sandeep Sharma +1 more
similarity 0.64
Abstract

Kohn--Sham density functional theory (DFT) underpins electronic-structure simulations, but repeated orbital diagonalizations lead to cubic scaling, restricting quantum calculations to modest scales only. Eliminating these auxiliary orbitals while retaining Kohn--Sham accuracy is the central goal of orbital-free DFT, but both analytical and machine-learning methods have so far fallen short. Prior learning approaches either try to learn the variational kinetic-energy functionals, which are ill-conditioned, or directly predict the ground state, which extrapolate poorly to larger systems. Instead, we identify the Kohn--Sham map as the right learning target for orbital-free DFT. It maps a Kohn--Sham potential directly to the corresponding density and noninteracting kinetic energy, quantities otherwise obtained through an orbital diagonalization. Focusing on the density component in this work, a domain-invariant $\mathrm{SE}(3)$-equivariant Fourier neural operator learns to predict it from the potential as input on real-space grids, enabling stable quasi-linear scaling SCFs. Trained jointly on 8,504 molecules and solids, a single model generalizes to out-of-distribution organic molecules, insulators, and metals. For the first time, the same method converges SCFs across these systems without explicitly constructing Kohn--Sham orbitals, while reproducing densities, electronic spectra, and structural observables at Kohn--Sham DFT accuracy. Linear-scaling SCFs additionally allow converging magnesium dislocation densities containing up to 82,500 valence electrons on a single GPU.

0.35

All-electron machine-learned orbital-free density functional for periodic CHNO systems

cs.LG physics.chem-phcond-mat.mtrl-sciphysics.comp-ph ·2026-10-13 ·Marc K. Ickler, Andreas Hermann, Fred A. Hamprecht
similarity 0.63
Abstract · 37 pages, 7 figures, 3 tables (including Supplementary Information). Supplementary Data 1 will be available with the journal version

We introduce STRUCTURES-P, a machine-learned all-electron orbital-free density functional for periodic CHNO systems. Electrostatics are evaluated analytically in an atom-centered Gaussian basis, while an equivariant network learns the kinetic and exchange-correlation energy from energies and gradients of non-ground-state densities. Minimizing the functional from a superposition of atomic densities recovers the Kohn-Sham ground state: on held-out crystals, the density error falls from 6.7% to 0.4% of the electron count and the energy error reaches 0.25 mHa per atom, half that of a same-architecture interatomic potential. A single functional can be trained for both isolated molecules and periodic systems, and the model generalizes to larger unit cells. It largely preserves relative-energy rankings and reproduces convex-hull vertices on the tested H-N composition slice. Together, these results demonstrate the viability of machine-learned all-electron orbital-free DFT for variational density optimization and energy evaluation in fixed-geometry solids.

0.17

Neural-Network Solutions to Real-Space Charge Density and Generalization

cs.AI cond-mat.mtrl-sci ·2026-09-14 ·Yuxuan Zeng, Tong Xie, Taoyuze Lv, Zhicheng Zhong
theoryhot direction similarity 0.62
Abstract

The Hohenberg-Kohn theorem establishes that, in principle, the ground state (GS) charge density contains all GS information of a many-electron system, such that all GS observables can be expressed as functionals of the GS charge density. Conventional Kohn-Sham density functional theory requires iterative solution of the self-consistent-field equations at substantial computational cost, motivating the development of deep learning surrogates for electronic structure calculations and, in turn, accelerating computer-aided materials design. Here, we propose AIDEN, an Atomic-Interaction Density Equivariant Network for solving real-space charge density. AIDEN separates the element-dependent one-center density from environment-induced density redistribution and represents the latter through complementary atom- and edge-centered tensor correlations. A continuous low-rank Gaussian decoder then reconstructs the density at arbitrary spatial coordinates while reusing atomic encodings independently of the evaluation grid. AIDEN achieves state-of-the-art accuracy on periodic crystal benchmarks while remaining competitive for molecular systems, and further demonstrates zero-shot transferability across several structurally distinct out-of-distribution case studies. Furthermore, AIDEN provides substantially faster inference than both baseline models and full SCF calculations, enabling efficient charge density reconstruction for large-scale electronic structure calculations.

0.26

Efficient Classical Algorithms for Ground Energy Estimation of Fermions with Conjugate-Pair Orbital Interactions

cs.DS quant-ph ·2026-11-19 ·Ziyi Yang, Yexin Zhang, Yuexin Su, Xinzhao Wang, Xiaoyang Wang +1 more
theory similarity 0.62
Abstract · 41 pages, 1 figure

Estimating the ground energy of interacting fermions is central to quantum many-body physics, and recent quantum algorithms provide polynomial-time guarantees for some structured families. Classical approaches commonly rely on quantum Monte Carlo, where the sign problem is a major obstacle. However, even when a nonnegative expansion without sign problem is available, rigorous guarantees for rapid mixing are still far from well understood. In this paper, we give an efficient classical randomized algorithm for approximating the ground energy of fermionic Hamiltonians with conjugate hopping matrices and conjugate-paired orbital interactions, which includes the attractive Hubbard models. This guarantee not only holds without a physical spectral gap or a weak-coupling assumption, but also covers interactions beyond onsite density attractions. Technically, we first reduce ground-energy estimation to partition-function estimation and then use a discretization with controlled energy error to obtain a nonnegative weighted sum of squared determinant moduli and then apply the Chen--Liu log-concave counting theorem. In addition, we obtain a sharper arithmetic bound by controlling how many independent sampling runs and matrix updates are needed, and using sparse matrices to reduce the cost of each update.

0.32

Where the Error Lives: Spectral Representations of Learned Kohn-Sham Hamiltonians

cs.AI physics.chem-ph ·2026-10-27 ·Fang Sun, Hekai Cheng, Ruoyan Li, Yuanzhou Chen, Wei Wang +2 more
similarity 0.62
Abstract

Kohn-Sham density functional theory (DFT) is the standard method for computing the electronic structure of molecules and materials, but its self-consistent-field (SCF) iterations make it expensive for large systems and high-throughput screening. Machine-learned Hamiltonian models offer a shortcut: an equivariant network predicts the Kohn-Sham Hamiltonian matrix in one forward pass, and diagonalizing the prediction yields orbital energies, the HOMO-LUMO gap, molecular orbitals and the electron density. These models are trained to match the reference matrix entry by entry, yet a small entry-wise error does not guarantee accurate eigenvalues or eigenvectors. Two physics-informed alternatives go partway: a recently proposed wavefunction-alignment loss adds a spectral penalty without diagonalizing the prediction, and matching the electron density of the diagonalized prediction supervises it directly. Neither is complete: by representing the prediction error in the eigenbasis of the reference Hamiltonian, we show that each sees only part of the error, and that shifting the predicted orbital energies leaves the electron density exactly unchanged. The same analysis identifies a complete training signal: the cumulative local density of states (cumulative LDOS), the number of electrons at each point in space with energy below a given threshold. The cumulative LDOS is a single physical observable that contains the electron density as a special case, responds to every component of the error, determines the Hamiltonian uniquely, and yields gradients that do not vanish for large orbitalenergy errors. Fine-tuning three Hamiltonian networks on QH9 in this way, which we call FermiScope, reduces the HOMO-LUMO gap error without increasing the element-wise error. The gains carry over to out-of-distribution and molecular-dynamics splits, where the wavefunction-alignment loss helps less.

0.19

VESPER: Online Learning of Free Energies with a Multi-Tempered Variational Objective

cs.LG physics.chem-phcond-mat.stat-mech ·2026-10-30 ·Jay L. Kaplan, Gustavo R. Pérez-Lemus, Mengjian Hua, Juan J. de Pablo, Eric Vanden-Eijnden
theory similarity 0.62
Abstract · 38 pages, 6 figures

Computing molecular free-energy landscapes over collective variables (CVs) is central to understanding molecular mechanisms, but poses a difficult learning problem without training data available a priori. Samples of the marginal CV distribution must be generated by molecular dynamics (MD), whose trajectories can remain trapped in metastable states and rarely cross the free-energy barriers governing conformational changes or chemical reactions. We introduce VESPER, which couples the generation of these samples to neural-network-driven free-energy learning: MD supplies configurations for learning, while the evolving model biases the MD to accelerate exploration and generate further training data. VESPER minimizes a single variational objective that is convex in the free energy and can combine several tempering levels, each flattening the free-energy landscape to promote barrier crossing. Every level has the same physical free energy as its minimizer, allowing data from all levels to train one shared model without reweighting. Learning uses the difference in mean parameter gradients between biased MD configurations and auxiliary walkers that explore the flattened model in CV space. We prove conditional convergence of the coupled overdamped population dynamics without replica exchange under log-Sobolev and Polyak-Lojasiewicz assumptions. VESPER matches or improves on established enhanced-sampling methods on alanine dipeptide and yields self-consistent free-energy reconstructions from three to six CVs on alanine tetrapeptide. For methane dehydrogenation on Ni(511) with a machine-learned interatomic potential, it recovers two-CV Boltzmann marginals and a reactant-to-saddle free-energy difference along a three-CV path, both qualitatively consistent with the lower-dimensional reference. It also samples RMSD-defined folded and unfolded regions of chignolin while biasing seventeen CVs.

0.21