CS Paper Radar

Evolving Towards Better Codes: LLM-Guided Search for High-Distance Binary Linear Codes

Amal Seddas, Vladyslav Shashkov, Maryna Viazovska, Emmanuel Abbe

cs.IT cs.AIcs.NE ·submitted 2026-09-29 08:59 UTC · v1

Abstract

Evolutionary program search driven by large language models (LLMs) has produced record-breaking constructions for open problems in combinatorics and beyond. We apply this approach to the longstanding problem of improving the best-known bounds for binary linear codes. Building on the EvoTune evolutionary framework and the ShinkaEvolve codebase, we introduce LinCodeEvolve, which evolves code-construction programs against an exact minimum-distance evaluator. A strategy loop combines diversity-driven search and expert supervision: when progress plateaus, new strategies are used to redirect the search. LinCodeEvolve discovers seven record-breaking codes, $[172,21,66]$, $[173,20,68]$, $[176,21,68]$, $[181,21,70]$, $[184,21,72]$, $[189,22,72]$ and $[200,21,77]$, six of which have concise quasi-cyclic descriptions. With standard code modification techniques, they improve $22$ entries of the tables. Every code is verified by exhaustive enumeration. These results suggest that LLM-guided search can help find improved codes and complement existing methods in coding theory.

Comment
17 Pages, 3 Figures, 3 Tables

Closest papers

Nearest neighbours by meaning across the whole index.

New upper and lower bounds on covering codes K_q(n,R) for alphabets of size 5 <= q <= 21

cs.IT math.CO ·2026-08-20 ·Mark Marosi
theory similarity 0.67
Abstract · 14 pages, 1 figure. v3: revised exposition; certificate hygiene (only certificates improving the tabulated bound are included); 84 improveme…

Let K_q(n,R) denote the minimum cardinality of a q-ary code of length n with covering radius R. We improve the known bounds on K_q(n,R) in 83 cases (82 distinct cells). On the upper-bound side we give 25 improved bounds for 5<=q<=15 -- twenty-four found by search and one propagated by monotonicity -- using two complementary methods: an engineered focused local search seeded with structural constructions, and a large-neighbourhood search driven by exact full-space coverage transforms that evaluates every candidate codeword position simultaneously. These are, to our knowledge, the first improvements to any upper bound on K_q(n,R) with q >= 5 since the 2011 revision of Keri's tables; several bounds decrease by more than 20%, e.g. K_6(8,4)<=166 (previously 216) and K_8(10,5)<=1883 (previously 2461). On the lower-bound side we give 58 improved bounds for 6<=q<=21, obtained from the semidefinite programming hierarchy of Gijswijt and Polak, whose published results cover q<=5, by combining an exact-arithmetic reimplementation of the reduced program with a multiprecision solution pipeline. Every new lower bound is certified by a rational dual solution validated by a standalone exact-arithmetic checker; no floating-point computation is part of the trusted base. The same pipeline also gives strong numerical evidence of limits: on a dozen further cells the certified value of the relaxation, which the solver reports as optimal to within its working precision, lies below the best known bound, indicating that no improvement is available there at this level of the hierarchy. One cell is improved from both sides: 441<=K_6(10,4)<=2751, previously 417--2952. All codes and certificates are provided in machine-readable form together with standalone verifiers.

0.20

Coding Agents for Coding Theory

cs.IT cs.AIcs.LG ·2026-09-30 ·Abraham Yeung
publishedcode/data similarity 0.65
Abstract · Accepted at the 6th Workshop on Mathematical Reasoning and AI (MATH-AI), NeurIPS 2026. 20 pages, 1 figure, 2 tables. Code and data: https://…

We spent five weeks using an LLM coding agent on open problems in coding theory: finding large sets of four-letter words, such as DNA barcodes, that stay far apart in edit distance. The agent wrote the verifiers and search code; a human chose the problem and set the verification protocol. Restricting the search to codes with a prescribed symmetry, a classical technique, shrank the problem about fourfold and raised the best known code of length 6 and minimum edit distance 3 from 114 to 120 words ($E_4(6,3) \geq 120$). The same pipeline improved twelve further lower bounds at lengths 6 to 9 and distances 3 to 6. We give the failures equal space. Our own search stopped at 116 and recorded the last symmetry class as topping out at 112; a second agent session, running the same search with a better operator, found the 120. A later verdict that the method did not carry over to length 7 was wrong for the same reason, and an earlier instance cost three weeks. Each time, an intermediate result was written down, never rechecked, and treated as a fact that ruled out further search. Checking final outputs, as our protocol required, does not catch such errors.

0.52

DivAlgo: A systematic evaluation of algorithmic diversity for code generation models

cs.SE cs.CL ·2026-10-13 ·Anubhav Jangra, Smaranda Muresan
benchmark similarity 0.64
Abstract · 24 pages, 18 figures

Code generation models are actively being used in professional and educational settings. However, the competence of large language models (LLMs) to generate algorithmically diverse code remains largely unknown. We propose the DivAlgo benchmark, a large-scale dataset constituting algorithmically diverse solutions to programming problems. We also introduce a lightweight similarity metric to enable large-scale evaluation. Our experiments across 24 modern code generation models found that uncontrolled model-generated code is significantly less diverse than human solutions (capturing ~31% of human diversity), and even the best diverse code generation strategy could achieve only ~70% of human diversity. Moreover, while it was possible to steer the models to generate solutions based on human strategies, they were unable to reproduce the diversity of the human solutions. These findings indicate the limitations of code generation models in capturing the algorithmic diversity humans exhibit, and that overexposure to model-generated code can narrow programmers' algorithmic vocabulary.

0.29

Codoku: Renewable Program-Reasoning Challenges for Frontier Coding Agents

cs.SE cs.AI ·2026-09-28 ·Cong Li, Hao Sun, Zenan Li, Zhendong Su
benchmarkcode/data similarity 0.63
Abstract

Existing program-reasoning benchmarks ask large language models to predict a program's behavior on a given input. Coding agents break two assumptions on which these benchmarks rest: an agent can recover the answer by executing the program instead of reasoning about it, and fixed task sets drawn from existing programs are increasingly exposed to contamination, yet costly to renew. We introduce Codoku (code sudoku), a renewable benchmark in which a solver fills typed cells in a partial program to satisfy global static and dynamic constraints, such as a prescribed control-flow graph and execution path. Because a partial program cannot be executed and valid fillings are sparse in an exponentially large space of interdependent choices, neither tool use nor enumeration can substitute for program reasoning. Puzzles are synthesized from scratch via semantic reification, so fresh puzzles of controllable complexity can be generated on demand, each with a witness that guarantees solvability. We evaluate five frontier models on 300 puzzles through a coding agent free to use any tool within a fixed budget. Small puzzles already challenge open-weight models, whereas even proprietary models solve only about half of the large ones. Codoku thus offers a renewable testbed for program reasoning that can keep pace with rapidly improving coding agents. GitHub: https://github.com/connglli/Codoku.

0.42

Are you Synthesizing or Recalling? Evaluating LLMs on Algorithmic Code Retrieval

cs.LG cs.AIcs.CLcs.PL ·2026-10-01 ·Nickil Maveli, Antonio Vergari, Shay B. Cohen
benchmarkpositioncode/data similarity 0.62
Abstract · 30 pages (preprint)

Large language models (LLMs) have demonstrated strong performance in code generation, where success depends on both recalling relevant algorithmic knowledge and reasoning about how to apply it. However, existing LLM pipelines are opaque, with no explicit separation between these two components. We argue that for well-known algorithms whose canonical implementations are widely accessible in pretraining corpora, code generation is better measured as \textit{parametric code retrieval}: reproducing a named algorithm from internalised knowledge rather than synthesizing a novel one. We introduce AlgoREval, a benchmark of 599 problems spanning classical 77 algorithms across 14 domains, 7 programming languages, and 4 graph-input representations to evaluate this capability in isolation, and assess 15 models (7B--34B parameters) in a zero-shot setting. We find substantial variation in retrieval accuracy across languages and input representations, even for widely documented algorithms and show that prompt augmentation with retrieved code snippets or structured algorithmic hints improve accuracy on complex algorithms, while SFT achieves broader language gains and GRPO achieves larger per-language gains on specific languages. Together, our results establish parametric code retrieval as a distinct, measurable capability and caution against deploying AI-generated algorithmic code without systematic validation.\footnote{Code and dataset are available at https://github.com/Nickil21/AlgoREval

0.32

Constructing Good Abelian Codes via Shift Bounds and Genetic Algorithms

cs.IT ·2026-08-19 ·Cong Yu, Hao Chen, Zhonghua Sun, Shixin Zhu
similarity 0.61
Abstract · 13 pages

This paper investigates the construction of linear codes via abelian codes over finite fields. By exploiting the algebraic structure of multivariate polynomial quotient rings, we derive lower bounds on the minimum distance using a generalized shift bound, which extends the classical van Lint-Wilson bound for cyclic codes. Several infinite families of abelian codes are explicitly constructed, including binary and ternary cases that extend previously known cyclic constructions. To find more abelian codes with good parameters, we apply a genetic algorithm that searches over defining sets represented as binary chromosomes of cyclotomic cosets; the fitness function compares the computed minimum distance against the best known linear code (BKLC) bounds. The search yields multiple record-breaking codes over F_3 and F_4, with improvements over Grassl's tables. Furthermore, the nested structure of these codes enables the application of Construction X, yielding additional linear codes with improved parameters. The results demonstrate that abelian codes, combined with heuristic search, form a viable way for discovering linear codes with unknown parameters.

0.28

Assessing the Impact of Retrieval-Augmented Generation on Algorithmic Problem-Solving

cs.AI cs.HC ·2026-11-06 ·Gabriel Souza Baggio, Gabriel Machado Lunardi, Guilherme Medeiros Machado, Subhankar Maity, Faiza Belbachir +1 more
similarity 0.60
Abstract

Competitive programming problems pose distinctive challenges for Large Language Models, as they demand not only proficient code generation but also advanced algorithmic reasoning. This study presents a Retrieval-Augmented Generation approach specifically designed to enhance the capacity of Large Language Models to address such problems. Our approach integrates an embedding-based retrieval mechanism and a similarity search algorithm to identify analogous problems within a knowledge database, employing a dynamically adjusted threshold to mitigate retrieval noise. We conducted an evaluation using the CodeContests dataset, focusing on the test split problems that exhibit similarity to instances from the training split. The experimental framework considered three conditions: (i) problems provided solely with their original descriptions, (ii) problems supplemented with randomly selected examples from the training split, and (iii) problems augmented with similar examples retrieved through the proposed method. In addition, we incorporated a Min-K membership inference analysis to examine whether the generated code solutions were influenced by potential memorization of training data within the evaluated Large Language Models. This complementary perspective enables a deeper understanding of model behavior by distinguishing genuine generalization through retrieval from implicit recall of pretraining samples. Performance was assessed using both pass rates and the CodeForces Elo rating of the problems. The results provide empirical evidence that similarity-based retrieval substantially enhances Large Language Models performance in competitive programming scenarios, offering an scalable framework for improving code generation in algorithmic problem-solving contexts.

0.05

Three Improved Lower Bounds for Binary Error-Correcting Codes

cs.IT ·2026-10-08 ·Kazuki Ota, Takayuki Osa, Tatsuya Harada
theory similarity 0.60
Abstract

Error-correcting codes are a foundational technology for representing information robustly against noise in communication and data storage. The binary code packing problem, which seeks to maximize the number of codewords at a fixed code length and minimum distance, is a fundamental problem in coding theory that remains open for many parameter choices. We give explicit binary codes with parameters $(n,M,d)=(22,84,9)$, $(24,196,9)$, and $(25,65,11)$, where $n$, $M$, and $d$ denote the code length, number of codewords, and minimum distance, respectively. These establish the lower bounds $A_2(22,9)\ge84$, $A_2(24,9)\ge196$, and $A_2(25,11)\ge65$, where $A_2(n,d)$ denotes the maximum possible number of codewords, improving the respective lower bounds 80, 192, and 64 in the public table of general binary codes. Most notably, the third result improves the lower bound supplied by a lexicographic construction for the first time in 66 years, while the first two improve bounds that have stood for 21 years. The new codes represent more messages without changing the code length or error-correction guarantees, with gains compounding multiplicatively across blocks. We release all codewords and an exhaustive verifier to enable independent verification.

0.24