CS Paper Radar

FlyCNS: Connectome-Grounded Information Organization for Communication-Constrained Embodied Control

Jinchang Zhang, Jiakai Lin, Guoyu Lu

cs.RO ·submitted 2026-09-23 21:51 UTC · v1

Abstract

Robotic bodies are inherently distributed in sensing and actuation, yet learning-based control still commonly relies on centralized information processing. This work studies the problem of information organization in communication-constrained embodied control: which computations should remain local, and which information is worth transmitting for whole-body coordination. We propose FlyCNS, an embodied information-organization framework inspired by the Drosophila brain--nerve-cord connectome. FlyCNS preserves local sensorimotor computation within each limb and enables selective long-range communication through separate ascending and descending routing pathways. From a real connectome, FlyCNS extracts the directional structural complexity of these two pathway types and uses it as a weak prior over communication allocation, while message content, transmission timing, and locomotion policies remain task-adaptive and are learned through reinforcement learning. In Unitree Go1 simulation, FlyCNS exhibits more graceful performance degradation as the communication budget is tightened. Under the most restrictive setting, it uses only about 21--22\% of the communication of the full-communication reference, while still maintaining a tracking score of approximately 0.882 under both command protocols, with a gap of no more than 6.1\% from the full-communication reference. These results indicate that real neural connectomes can inform not only the structural design of control networks, but also provide transferable inductive biases for information organization across embodiments, guiding robots in balancing local computation and long-range coordination under limited communication resources.

Closest papers

Nearest neighbours by meaning across the whole index.

Communication in modular robotic motor control: Bilateral controllers under realistic constraints

cs.RO ·2026-08-14 ·Jingwen Li, Levin Kuhlmann, Jason Friedman, Gideon Kowadlo
similarity 0.65
Abstract · 15 pages, 8 figures

Robotic motor control in musculoskeletal systems requires fast, accurate movement and robust postural stabilization under signal-dependent noise (where motor command variance scales with command magnitude) and energetic cost. Modular controllers can distribute these competing demands across interacting submodules, but it remains unclear whether they outperform monolithic architectures under realistic constraints, and how inter-module communication shapes the resulting strategy. Inspired by the bilateral hemispheric organization of the brain, we introduce a recurrent controller of two GRU-based modules connected by a learnable, delayed inter-hemispheric channel, trained end-to-end in a differentiable two-arm musculoskeletal simulator. Across reaching and holding tasks, the modular architecture substantially outperforms a capacity-matched monolithic baseline. Compared to a matched modular controller without communication, learned inter-hemispheric communication reshapes the solution: improved endpoint precision, lower energetic cost in non-zero-delay regimes, and reduced muscle co-contraction. Our findings show that for robotics, biologically inspired modular controllers offer a practical route to robust movement under noise and energetic constraints, with inter-module communication providing a mechanism to tune trade-offs between precision, stability, and actuation cost.

0.40

How much of fly walking is written in the wiring?

cs.NE q-bio.NC ·2026-09-29 ·Isabel Guan, Yuntian Zhao, Dingyuan Zhang, Shipeng Lyu, I-Ming Chen
similarity 0.64
Abstract · 34 pages, 5 figures; Supplementary Information with 4 figures and 9 tables

Connectome models of the fly nerve cord generate walking-like motor rhythms, but oscillation alone does not show that the specific wiring matters. Here we provide, to our knowledge, the first test of which features of motor output depend on the specific wiring. We simulated the leg motor systems of two independent Drosophila connectomes, with synapse counts as fixed weights and glutamatergic synapses treated as inhibitory, and compared each with six families of rewired networks that preserve progressively more of its structure, using pre-registered criteria. We find that rhythm is generic but antagonist coordination is not: many rewired networks were more rhythmic than the real ones, yet the real wiring coordinated antagonistic motor pools more strongly than every rewired network, most of all at the thorax--coxa joint. We trace this specificity to how premotor input is allocated between antagonistic pools. Both connectomes carry Sherrington's reciprocal innervation---neurons that excite one pool inhibit its antagonist---and no rewired network does. Reassigning premotor inputs between the pools abolished coordination even when motor neurons' typical input strength changed little (all pre-registered criteria met in one connectome; same direction in the other). Coordination, not rhythm, therefore reveals whether a connectome model's wiring matters.

0.24

A Drosophila Whole-Connectome Network Can Learn Human-Designed Cognitive Tasks

cs.LG ·2026-10-07 ·Joonghui Cho, Minchan Kang, Daeshik Kim
code/data similarity 0.61
Abstract · 14 pages, 4 figures. Code: https://github.com/joonghui0926/drosophila-connectome-cognitive-tasks

Can a biological wiring diagram serve as a useful computational substrate beyond the behaviors for which it evolved? We use the publicly released MaleCNS v1.0 connectome, reconstructed from a single adult male Drosophila specimen, as the fixed recurrent topology of an artificial network. We train separate models for bounded addition and for a controlled grounded relational language task built from a fixed 100-word lexicon. In both models, one scalar is learned per anatomical edge. The anatomical graph reaches 92.77% mean accuracy on held-out addition, compared with 67.93% for directed degree-preserving rewires. On the strict paired language endpoint, which matches original and order-reversed scenes to their corresponding descriptions, it reaches 61.59% across four fixed interfaces, compared with 44.17% for matched rewires. At the canonical interface, it ranks first in a fixed 21-graph comparison. On the matched 48-group intervention subset, shuffling task-defined sensory features reduces its score from 60.94% to 19.27%. Together, these results show that higher-order MaleCNS wiring provides a reusable inductive bias for bounded addition and grounded relational language.

0.74

Brain-Inspired Hierarchical Modularity for General Continual Learning

cs.LG cs.AI ·2026-09-21 ·Hongwei Yan, Kanglei Zhou, Qi Cheng, Weiyi Dong, Chunyan Lan +5 more
similarity 0.60
Abstract · 50 pages

Continual learning, the ability to learn from sequential experience while retaining and adapting prior knowledge, is central to intelligent systems operating in changing environments. However, conventional continual learning is typically studied with offline task-wise training and clear task boundaries, leaving a substantial gap from general continual learning under online, uncertain, and evolving data streams. In this regime, intelligent systems must separate conflicting experience to reduce interference while integrating compatible experience to promote generalization. Inspired by the organization of the Drosophila learning and memory system, we identify a hierarchical modular principle that coordinates both functions through expert specialization and ensemble integration. We instantiate this principle as lightweight modular adaptation of pretrained foundation models, combining brain-inspired random expansion for expert routing and diversified modular integration across spatial and temporal scales. Across visual recognition, vision-language understanding, ego-exo video understanding, and embodied vision-language-action learning, our method consistently improves learning under online and uncertain data streams, with gains exceeding 50 percentage points over replay-free alternatives in embodied manipulation. These findings support hierarchical modularity as a biologically grounded path for learning from dynamic experience.

0.21

Bridging Body and Brain: Gene-Driven Morphology--Control Co-Design

cs.LG ·2026-09-25 ·Fu Feng, Ruixiao Shi, Yucheng Xie, Jing Wang, Xin Geng
similarity 0.59
Abstract

Morphology--control co-design jointly optimizes an agent's body structure and control policy as an integrated embodied system. However, existing methods typically model morphology design and control with separate networks coupled only indirectly through a shared task objective, limiting explicit high-level coordination. Inspired by natural genes that coordinate biological development, we introduce \textbf{Morphogene}, a compact latent blueprint that bridges an agent's body and brain. Through AdaConcat, Morphogene jointly conditions morphology and control generation at the limb level, allowing its variations to induce coordinated changes in both components. Building on this representation, we propose \textbf{GeCode}, which formulates co-design as exploration in the compact Morphogene space. Each Morphogene anchors a local design region in which nearby body--brain designs are explored, while performance-guided updates move these anchors toward promising regions for more efficient exploration of the broader design space. This process combines local refinement with global exploration while preserving body--brain compatibility. Extensive experiments across diverse 2D and 3D co-design tasks demonstrate that GeCode consistently outperforms existing state-of-the-art methods, achieving substantially faster convergence and higher final performance.

0.26

Intrinsic Goals for Autonomous Agents: Hierarchical Exploration Captures Future Volitional Action in Drosophila

cs.AI q-bio.NCcs.LGcs.RO ·2026-10-25 ·Declan Kutscher, Reece Keller, Alyn Kirsch, Felix Pei, Aran Nayebi
published similarity 0.59
Abstract · 27 pages, 5 figures

Animals have a remarkable capacity for autonomy---driven by intrinsic motivation---without external sensory cues or extrinsic objectives, yet the computational mechanisms behind this ability largely remain a mystery. We combine whole-brain recordings in the fruit fly (Drosophila melanogaster), which reveal neural representations of spontaneous exploratory decisions more than 10 seconds in advance, with a neuromechanical digital twin to test whether optimizing intrinsic goals yields realistically embodied artificial agents that quantitatively match fly behavior and internal representations of future volitional action during exploration. Our hierarchical policy selects from a discrete library of low-level motor primitives, consistent with ethological theories of behavioral syllables. We train agents without external reward using 20 intrinsic motivation algorithms spanning curiosity, entropy, and competency methods. The agents are evaluated in a virtual tethered-ball assay modeled on the fly experiment, comparing spontaneous locomotor statistics and internal representations and decoding future turn direction from kinematics and neural activity on the same timescales observed in flies. DIAYN, a hierarchical competency algorithm learning discrete policies that maximize behavioral entropy and the separability of induced sensory observations, achieves the strongest joint behavioral and neural prospective coding performance relative to flies. Its learned policies closely capture individual variability in fly exploration strategies, suggesting that this diversity serves to maximize state-space coverage at the population level. DIAYN's latent activity also closely captures the sum-difference rule for interhemispheric encoding of kinematics in biological flies. These results establish hierarchical, intrinsically motivated agents as a powerful framework for reverse-engineering animal autonomy.

0.38

Sensorimotor behaviour from an untrained brain-and-nerve-cord connectome

cs.NE q-bio.NC ·2026-10-24 ·John R. Minnick, Jesus Gonzalez-Ferrer, Jinghui Geng, Jason K. Eshraghian, Mohammed A. Mostajo-Radji +2 more
similarity 0.58
Abstract · 42 pages: the manuscript with six figures, and the Supplementary Information (4 figures, 8 tables) appended

Connectomes now map the neurons and synapses of an adult fly's brain and nerve cord, but how much of behaviour follows from the wiring is unknown. Here we turn one such connectome into a spiking network of 172,433 neurons with a published brain model's untuned parameters, and run it alone and inside a simulated body. Two fixed rules join them: odours and looming objects drive sensory neurons, and motor neurons move the legs. Alone, the network passes a signal to the motor neurons it is known to drive when the pathway supplies about 2% or more of their input. In the body, the fly navigates around obstacles to 95% of the odour sources. A rewiring that keeps each neuron's connection counts and signs reaches 18%, and the fly's leg commands replayed with the senses off reach almost none, so navigation needs the measured wiring and sensory feedback. Dopamine-gated weakening of the mushroom body's output synapses turns approach to an odour into avoidance, which requires the pairing and is odour-specific once one olfactory synapse class is scaled. An untrained connectome thus supports a behaviour and its learned reversal, and the pathways it cannot drive mark what the diagram leaves out.

0.47

Humanoid Locomotion with a Fly-Inspired Recurrent Controller

cs.RO ·2026-09-22 ·Isabel Guan, Yuntian Zhao, Dingyuan Zhang, Shipeng Lyu
similarity 0.58
Abstract · 19 pages: 8 main text, 1 references, 10 supplementary material; 5 main and 10 supplementary figures. Simulation study

We investigate humanoid locomotion with a fly-inspired recurrent controller and identify the pathways supporting its deployed behavior. The controller couples 3,609 continuous neural states to a simulated Unitree G1 through body-observation projections, a motor-neuron-labelled readout, and joint servos. We formulate this neural-body feedback system and evaluate a fixed checkpoint across seven terrain instances, three speeds, and three initial yaw offsets. It completes 61/63 conditions under a survival-and-forward-progress criterion; a privileged reference completes 62/63. At nominal yaw, resetting the recurrent motor state before every policy call changes success from 19/21 to 0/21. Conversely, depth and upstream-state substitutions at 252 recorded states leave actions unchanged, with zero measured descending output throughout the intact rollouts. Recorded trajectories and state-matched images connect these findings to sustained movement, lateral drift, and termination events. The study characterizes an embodied recurrent control system whose tested locomotion is supported by direct body-and-command input and carried motor state, providing a concrete basis for subsequent comparisons of circuit structure and control resources.

0.26