CS Paper Radar

IWOO: Wave Optics Optimizer Improved with Hybrid Strategies for Numerical Optimization and Engineering Applications

Rui Du, Yaming Zhang, Yongpeng Wen, Linghong Cai, Nanqing Liu

cs.NE cs.AI ·submitted 2026-10-15 03:39 UTC · v1
benchmarkunusual

Abstract

The Wave Optics Optimizer (WOO) incorporates optical diffraction and interference into numerical optimization and has shown competitive performance in benchmarks and engineering applications. However, it can converge slowly, become trapped in local optima, and lose search effectiveness in later iterations. This paper proposes an Improved Wave Optics Optimizer (IWOO) that integrates four complementary strategies. First, a good point set and opposition-based learning are combined in GPS--OBL initialization to improve population quality and diversity. Second, an E-DM nonlinear perturbation mechanism is embedded in temporary triangle-based search to develop the TriEDM multi-path strategy and enhance search capability. Third, Correlation-Guided Groupwise Orthogonal Learning (CGOL) leverages relationships among decision variables to improve search efficiency while reducing computational overhead. Fourth, an adaptive stagnation-aware Runge--Kutta correction is introduced to mitigate premature convergence. IWOO is evaluated on the IEEE CEC2019, CEC2022, and CEC2017 benchmark suites against representative and high-performing optimizers, with ablation studies assessing the contribution of each strategy. Within the representative algorithm group, IWOO achieves Friedman ranks of 1.8000, 1.5833, and 1.4483 on CEC2019, CEC2022, and CEC2017, respectively. Tests on six constrained engineering optimization problems further demonstrate its competitive accuracy, stability, and practical applicability.

Closest papers

Nearest neighbours by meaning across the whole index.

MOON-RL: Multi-Objective Optimization via Objective Space Navigation with Reinforcement Learning

cs.LG ·2026-11-11 ·Andrii Artomov, Soheyl Massoudi, Jürg Schiffmann
similarity 0.53
Abstract · 66 pages, including appendices. Code, data and supplementary video links are provided in the manuscript

Many engineering design problems involve multiple conflicting objectives and strict feasibility constraints. They are typically solved with population-based optimizers that require many evaluations and offer limited online control over where the search is focused. We present MOON-RL, a reinforcement-learning-based optimization framework that formulates constrained multi-objective search as preference-directed navigation in the objective space. In MOON-RL, a lightweight PPO policy receives objective-space and constraint-related observations and acts as an instance-specific adaptive search process. It learns how to update the design so that the current solution advances along a user-specified trade-off direction, while a simple meta-algorithm periodically resets the policy, resamples starting designs from a continuously updated archive of non-dominated solutions, and adjusts step-size and penalty schedules. We evaluate MOON-RL on real-world actuator-design problems and additional convergence-hard constrained benchmarks, comparing against established evolutionary algorithms under matched evaluation budgets. In focused search scenarios, MOON-RL achieves competitive performance in the region of interest, and ablation studies show that both the RL-driven adaptive sampling process and the meta-algorithm contribute to this behaviour, suggesting that repurposing RL training as objective-space navigation is a viable building block for interactive, preference-guided design tools. Additional experiments show that the framework also accommodates adaptive non-RL samplers, while PPO remains a strong choice for fixed-target, preference-directed objective-space navigation.

0.26

DiffRayve: Differentiable Ray-Wave Method for Polarized and Unpolarized Diffractive-Refractive Optical Systems

cs.CE ·2026-09-14 ·Samuel Audia, Shrey Patel, Dinesh Manocha, Matthias Zwicker
similarity 0.51
Abstract

Current deep optics simulations struggle to balance high fidelity with computational efficiency, particularly for complex polarized and diffractive systems. To address this, we introduce a fully differentiable Shooting and Bouncing Ray (SBR) algorithm that simultaneously models geometric and physical optics fields. Unlike standard wave optics methods, our approach enables accurate, gradient-based optimization of polarized compound refractive-diffractive systems without the computational cost of full-wave simulations. We validate our method against analytical Fraunhofer diffraction patterns and state-of-the-art Fourier optics and wave optics methods. We showcase the practical utility of our differentiable engine through one application: designing a wide field-of-view achromatic lens with multiple Diffractive Optical Elements (DOEs).

0.27

HeuFouFT: Task-Guided Metaheuristic Coordinate Search for Fourier Fine-Tuning

cs.LG cs.CL ·2026-10-05 ·Ruiheng Wang, Yubo Hou, Yakun Zhu, Tianle Shen, Tao Wan +1 more
code/dataunusual similarity 0.50
Abstract

We introduce Heuristic-Guided Fourier Fine-Tuning (HeuFouFT), a task-guided framework for selecting trainable frequency coordinates in Fourier fine-tuning. Existing uniform and Gaussian band-pass schemes allocate a limited spectral budget through fixed, task-agnostic rules. HeuFouFT instead searches for coordinates using downstream performance. A coarse intensity map from lightweight block-level probes initializes three metaheuristic optimizers: Genetic Algorithm with Simulated Annealing (GA-SA), Particle Swarm Optimization (PSO), and Cuckoo Search (CS). During search, a Random Forest filters each population so that only the top 30% of candidates proceed to proxy fine-tuning. On E2E with GPT-2-Medium, all three variants outperform random-uniform FourierFT, Gaussian band-pass FourierFT, and LoRA across five metrics. PSO further outperforms LoCA, the best-performing baseline, on four metrics while using 37.6% fewer trainable spectral coefficients. Once coordinates are selected, HeuFouFT requires only 15--18% FLOPs of Full FT. These results show that task-guided search allocates limited spectral capacity more effectively than fixed sampling. Our code is publicly available.

0.36

Adapting Nonstationary Multi-output Gaussian Processes to Bayesian Optimization

cs.LG cs.AI ·2026-09-26 ·Zikai Xie
similarity 0.49
Abstract

Multi-objective Bayesian optimization (MOBO) commonly relies on independent Gaussian processes (GPs) with stationary kernels, limiting its ability to represent nonstationary structure and share information between objectives. However, expressive nonstationary GPs do not necessarily make reliable BO decisions. We study this mismatch for the multi-output low-rank nonstationary (MO-LRN) GP: strong training fit can coexist with large off-design errors and optimistic acquisition predictions. We introduce MOLRN-BO, which combines a regularized shared-spectral surrogate with objective-specific residuals, prequential mean correction and tempered covariance scaling, and Pareto-local qLogEHVI optimization with periodic global search. Experiments on 12 deterministic bi-objective benchmarks show that MOLRN-BO substantially improves upon the original MO-LRN and achieves the best average problem ranks for final normalized hypervolume and normalized inverted generational distance among nine evaluated algorithms. It also achieves the strongest adverse-tail performance while remaining competitive with the leading baselines in anytime optimization. Ablation studies further show that the shared spectral construction improves off-design prediction, the local--global decision policy improves optimization performance, and hierarchical calibration reduces systematic candidate bias. These results demonstrate that nonstationary multi-output surrogates can deliver strong and robust MOBO performance when their structure and use are explicitly adapted to the demands of sequential optimization.

0.26

When is global evolutionary search useful for variational quantum algorithms? A landscape-first study

cs.NE quant-ph ·2026-09-13 ·Vojtěch Novák, Ivan Zelinka
benchmarkhighly cited similarity 0.48
Abstract

Variational quantum algorithms recast state preparation as classical nonconvex optimization, but it is often unclear when multistart local search suffices and when population-based global search justifies its evaluation cost. Using a landscape-first design, controlled QAOA experiments identify two mechanisms making local search unreliable: parameter reuse across circuit layers and competition between 2-local and 3-local cost terms. Increasing QAOA depth alone does not replicate this effect. We test these mechanisms across eight unseen spin glasses, fresh $N=10$ and $N=12$ instances, and standard MaxCut, transverse-field Ising, and Heisenberg models. On all eight unseen spin glasses, adaptive differential evolution (DE) achieves lower median error than both multistart BFGS and multistart Powell on the two difficult constructions, whereas the independent-depth control does not. The parameter-reuse effect transfers to MaxCut at both sizes, while standard VQE models remain favorable to local search. A pre-benchmark landscape score combining random-start local outcomes and 1D parameter slices is fixed from confirmation data before evaluating new optimizers. It predicts whether adaptive DE outperforms multistart BFGS by over one spectral-range percentage point on 50 new quantum objectives with 80--86% condition-level accuracy. The clearest indicator of global-search utility is that local search frequently traps in inferior basins, rather than circuit depth or curvature anisotropy. The findings motivate whether quantum circuit complexity can be traded for harder classical optimization when robust global search is available.

0.47

Reinforcement Learning-Based Laser Cutting Machine Parameter Optimization

cs.AI ·2026-08-11 ·Khanh Quan Pham, Majid Kundroo, Geunwoo Ban, Seongho Bae, Taehong Kim
publishedhighly cited similarity 0.48
Abstract · 21 pages, 8 figures. Accepted manuscript published in Journal of Intelligent Manufacturing (2025). DOI: 10.1007/s10845-025-02619-z

Achieving high accuracy in laser-based cutting of optical films requires careful tuning of parameters such as focal length and laser power beam, adjusted according to the specific properties of each film type. Trial-and-error based traditional methods are used to find the most suitable cutting parameters for various films, but they are slow and inaccurate. To address this issue, this paper presents the Reinforcement Learning for Laser Cutting (RL$^{2}$C) algorithm, which uses Q-learning with an epsilon-greedy policy to dynamically optimize cutting parameters, significantly reducing taper size and film wastage. Additionally, RL$^{2}$C incorporates a dynamic environment space adaptability mechanism to allow it to adapt to new states encountered during the learning process over multiple batches of experiments. Experimental results demonstrate that RL$^{2}$C requires fewer steps and less time to find optimal cutting parameters compared to various RL-based optimization methods. Specifically, RL$^{2}$C reduces the number of optimization steps by up to 12.5\% and processing time by up to 81.8\% compared to existing methods. This study demonstrates the potential of RL in industrial laser-cutting processes by improving cut quality, reducing time and film wastage, and minimizing manual interventions.

0.65

A Quadratic Lens on Muon's Polar Update: Benefits, Pitfalls, and the Role of Newton-Schulz

cs.LG ·2026-10-21 ·Egor Shulgin, Sam Laing, Antonio Orvieto, Peter Richtárik
published similarity 0.48
Abstract · 47 pages, 13 figures. A shorter version was presented at the ICML 2026 Workshop on High-dimensional Learning Dynamics

Muon updates matrix-valued parameters along approximately orthogonalized directions and often trains large language models faster than AdamW, yet it remains unclear when and why orthogonalization helps. We study PolarGD, the orthogonalized update at the core of Muon, on matrix quadratics, where optimizers can be analyzed in closed form, and compare update directions under line search to remove the effect of learning-rate tuning. Orthogonalization pays off when the gradient is far from low rank and its largest singular directions see high curvature. PolarGD reaches the minimizer in one step whenever the rows of the error are orthogonal with equal norms, for any Hessian, whereas gradient descent needs all Hessian eigenvalues to be equal; and unlike sign descent, PolarGD is unaffected by rotations of the problem. Over many steps, PolarGD acts as gradient descent preconditioned by the current iterate, so its speed is governed by the conditioning of the iterate rather than of the Hessian. This explains fast regimes as well as a slow one, caused by tiny singular values of the iterate, in which PolarGD is much slower than gradient descent. Finally, the few Newton-Schulz iterations used in Muon treat these tiny singular values as gradient descent does, so fewer iterations can converge faster than exact orthogonalization; in a transformer trained with Muon, about a quarter of the singular values of the attention matrices fall in this regime.

0.21

ORACLE: Optimizer-Relative Alignment for Constrained LEarning

cs.LG ·2026-10-06 ·Utkarsh Grover, Wyatt Mackey, Kaixun Hua, J. Morris Chang, Xiaomin Lin
similarity 0.48
Abstract

Constraint handling methods typically intervene before the optimizer acts, by modifying the objective or the gradient. Yet momentum, adaptive scaling, and structured preconditioning can substantially reshape that signal before it becomes a parameter update. We formulate optimizer relative constrained learning, where constraint compatibility is assessed on the post optimizer update. Building on this view, we introduce ORACLE, which evaluates the native optimizer's realized step through a joint endpoint linearization of heterogeneous constraint families, constructs the resulting alignment in the optimizer's own geometry, bounds its authority, and commits it only after validation. We evaluate ORACLE across eight Partial Differential Equation benchmarks and four optimizers spanning Euclidean, diagonal adaptive, and structured preconditioned geometries, where it improves or matches native optimizer in 94% of configurations. Cross model analysis shows the same behavior in 92% of configurations, while matched comparisons show improvements over alternative constraint-handling methods acting at the objective, gradient, and post-optimizer levels.

0.15