CS Paper Radar

In-Orbit Computing for Remote Sensing: Task-Oriented Processing and Transmission

Yi Zhang, Zesong Fei, Jingxuan Huang, Hua Dang, Jihao Luo, Wenyu Liang, Haoran Zhang, Xinyi Wang

eess.SP ·submitted 2026-10-22 04:03 UTC · v1

Abstract

The growing volume and timeliness requirements of remote sensing data are exposing the limitations of the conventional "transmit-then-process" architecture, particularly under intermittent satellite-ground connectivity, constrained downlink bandwidth, and limited onboard computing resources. This article presents a semantic-aware space-ground collaborative remote sensing (SSGC-RS) framework, in which remote sensing data are processed to different semantic depths according to task requirements and available communication-computing resources. Three operating modes are considered, ranging from fully onboard task inference to semantic representation delivery and space-ground split inference. A land-cover recognition case study illustrates how these modes address different communication and computing bottlenecks. Finally, emerging challenges and future directions for intelligent remote sensing systems are discussed.

Closest papers

Nearest neighbours by meaning across the whole index.

Joint DNN Partitioning and Resource Allocation for Satellite-Terrestrial Collaborative Inference Systems

eess.SP ·2026-09-28 ·Wenyu Liang, Zesong Fei, Peng Liu, Xinyi Wang, Ming Zeng
similarity 0.65
Abstract · 5 pages

This letter investigates a satellite-terrestrial collaborative inference system for remote sensing information processing, where a ground station (GS) serves multiple low Earth orbit (LEO) satellites running heterogeneous deep neural network (DNN) inference tasks. By partitioning the DNN between the satellite and the GS, each satellite executes the front-end layers locally, transmits the resulting intermediate features to the GS, thereby offloading the remaining layers to the GS for inference completion. We jointly optimize DNN partitioning, satellite and GS computing resources, satellite-ground bandwidth allocation, and satellite transmit power to minimize the average task completion latency under per-satellite energy constraints. To address the coupling between discrete partitioning decisions and continuous communication-computing variables, we propose a two-layer optimization algorithm. The inner layer performs closed-form updates and efficient nested bisection searching to update the continuous resource variables, while the outer layer employs random-restart coordinate descent to refine the partitioning decisions. Simulation results show that the proposed algorithm effectively reduces task completion latency compared with conventional binary offloading.

0.16

A large-scale climate-aware satellite image dataset for domain adaptive land-cover semantic segmentation

cs.CV ·2026-10-15 ·Songlin Liu, Linwei Chen, Li Zhang, Jun Hu, Ying Fu
publishedcode/datahighly cited similarity 0.60
Abstract

A few well-annotated datasets for land-cover semantic segmentation have recently been introduced to advance the field of earth observation technologies. However, these datasets overlook the significant diversity among geographic areas with different climates, which can greatly impact and diversify land cover. Consequently, this leads to a domain gap in remote sensing images and severe performance degradation of the segmentation models. To enhance land-cover semantic segmentation with improved generalization ability, we conducted the first investigation into the impact of climate on this task. In this paper, we present a unique large-scale Climate-Aware Satellite Images Dataset (CASID) specifically designed for domain adaptive land-cover semantic segmentation. It consists of 980 satellite images with a size of 5000 x 5000 pixels, collected from 30 different regions around Asia, covering over 24,500 square kilometers. These images are gathered from four distinct climate zones, namely temperate monsoon, subtropical monsoon, tropical monsoon, and tropical rainforest. It includes four sub-datasets/domains, each representing one of the aforementioned climate zones. This characteristic makes CASID the first climate-aware land-cover semantic segmentation dataset with multiple domains. Additionally, we provide a comprehensive analysis of the samples from the four climate zones, emphasizing differences in global image features, image texture, category distribution, spectral value, and object shape. These analyses offer valuable insights for subsequent research in this field. Moreover, we conduct extensive experiments to evaluate the latest semantic segmentation and unsupervised domain adaptation methods on the CASID dataset. These results serve as a robust baseline for future research endeavors. Our dataset will be made publicly available at https://github.com/Linwei-Chen/CASID.

0.65

Satellite Intelligence: Distributed Training, Collaborative Inference,and LLM Adaptation in LEO Constellation

cs.NI cs.AI ·2026-10-26 ·Zheng Lin, Zhanwei Wang, Yuxin Zhang, Yafei Wang, Ons Aouedi +7 more
similarity 0.60
Abstract · 38 pages, 16 figures

The proliferation of orbital sensing data and the real-time demands of emerging global services are pushing low Earth orbit (LEO) satellite networks from bent-pipe relays toward intelligent onboard processing. This shift confronts a fundamental tension, where modern artificial intelligence (AI) training paradigms require intensive computation, abundant memory, and stable connectivity, all of which are scarce under the dynamic topologies, intermittent links, and severe size, weight, and power (SWaP) constraints of satellite networks. Addressing this tension demands rethinking AI workflows, from training and inference to the emerging deployment of large language models (LLMs), under a constraint-aware design philosophy. To the best of our knowledge, this paper provides the first survey that jointly covers all three, whereas prior surveys examine these aspects in isolation. We begin by identifying the deployment challenge of satellite intelligence (SI) and deriving design principles for SI. We then examine three advancing paradigms: i) distributed training, where federated learning (FL) and split learning (SL) enable satellite-ground co-training under resource limitations; ii) collaborative inference, which exploits single-satellite, multi-satellite, and satellite-ground architectures to meet real-time service demands; and iii) on-orbit LLM adaptation and serving, which tackles the frontier challenge of deploying LLMs under severe orbital constraints and resource-aware serving. Finally, we identify open challenges and future directions. By bridging the AI and satellite networks, this paper provides a research roadmap for the implementation of space-native AI technologies.

0.50

Resource-Aware Federated Mixture-of-Experts with Adaptive Pruning for Onboard Learning in LEO Satellite Constellations

cs.LG cs.CV ·2026-09-25 ·Mohamed Shaaban, Mohamed Elmahallawy, Marius Bernahrndt, Tobias Hecking
similarity 0.58
Abstract

Low-Earth-orbit (LEO) satellites are increasingly expected to perform onboard learning for applications such as disaster response and environmental monitoring. However, conventional federated learning (FL) is ill-suited to onboard satellite learning, as it assumes computational, memory, and communication resources beyond the capabilities of resource-constrained LEO platforms, often necessitating the transmission of raw imagery to ground stations. We present COSMIC-FL, a resource-aware FL framework for efficient onboard learning in LEO satellite constellations. COSMIC-FL introduces two complementary Mixture-of-Experts (MoE) architectures: a Sliced design that shares backbone representations while activating task-specific channel subsets, and a Modular design that employs lightweight gating to route inputs to physically separated expert networks. A semantic class-to-expert mapping enables each satellite to train, update, and communicate only the expert paths relevant to its local data. To further improve efficiency, COSMIC-FL integrates staged optimization with three structured pruning strategies: server-side pruning, client-side fixed-ratio pruning with mean-vote aggregation, and adaptive client-side per-layer pruning based on aggregated importance and a MAD-based gap criterion. Combined with semantic expert routing, these techniques jointly adapt computation and model sparsity to both data semantics and layer importance, yielding a favourable accuracy--efficiency trade-off for heterogeneous space platforms. Experiments on six image classification benchmarks under highly non-i.i.d. settings show that COSMIC-FL maintains competitive accuracy while reducing communication, computation, and energy consumption by up to 80% over SOTA FL methods. We further validate COSMIC-FL on an NVIDIA Jetson AGX Orin, confirming its efficiency gains under realistic embedded deployment constraints.

0.08

The Last Remote Sensing Model Built by Humans? Casting Any Earth Observation Task as Recursive Self-Improvement

cs.CV cs.CL ·2026-10-13 ·Sijie Zhao, Zeqi Zhou, Heli Qi, Xuanchao Fu, Zhuo Zheng +4 more
benchmark similarity 0.56
Abstract · Ongoing project

Earth observation (EO) models are still built by hand. For each new task, experts design a training recipe and tune it against a benchmark. We show that this loop can be handed to an agent. Any verifiable task can be cast as a harness and a verifier, where the harness defines what the agent may use and the verifier defines what counts as success. Every EO task can be made verifiable, through labeled benchmarks, independent sensors, physical models or the repeated observation of the same place. Given only these two components, a general-purpose coding agent builds the EO model and improves it recursively on its own outputs. Settings long treated as separate research problems, from learning with a handful of labels to adapting across domains, become choices of harness and verifier. On six EO benchmarks spanning optical, SAR and multispectral time-series imagery, with outputs that range from land-cover maps and ship instances to canopy heights and answers about large images, agent-built models surpass the state of the art on every one, and on land-cover mapping, they do so from 11% of the training labels. This establishes a new paradigm for EO, in which people design harnesses and verifiers and agents build the models, so EO models improve as agents do.

0.46

StarMind: Challenges and Opportunities in Orbital Computing

cs.NI eess.SY ·2026-10-17 ·Zisheng Gong, Zhaoyu Liu, Houtianfu Wang, O. Tansel Baydas, Liu Cao +2 more
similarity 0.56
Abstract · This work has been submitted to the IEEE for possible publication. 7 pages, 4 figures

Space-based artificial intelligence (AI) is moving beyond isolated onboard processing toward constellation-scale computing over optical inter-satellite links (OISLs). Yet current infrastructures remain fragmented, making end-to-end (E2E) coordination across heterogeneous and multi-vendor systems difficult. This article examines the StarMind vision and develops a reference framework for distributed orbital computing. It organizes the system into five layers and defines six standardizable interfaces that link mission intent to resource conditions and trustworthy result delivery. The framework also clarifies the operational constraints that determine whether orbital cooperation is worthwhile. In a representative synthetic aperture radar/interferometric SAR (SAR/InSAR) case study, the framework reduces E2E latency to 41-min, compared with 61-min for localized onboard computing and 146-min for ground-based processing. This gain does not rely on faster processors in orbit. Instead, it comes from reducing contact waiting and urgent Earth downlink traffic through resource-aware task placement and gateway selection. Feasibility analysis shows that the proposed framework is more effective when source datasets are large, output products are compact, and optical inter-satellite link capacity is sufficient. When these conditions are absent, conventional processing may remain preferable. Finally, we discuss research opportunities in joint task partitioning and cross-domain orchestration, hierarchical federated intelligence, and large model-enabled intelligence to advance an interoperable space-ground computing continuum.

0.26

AgenticSwarm: Semantic Perception and Adaptive Task Allocation for Heterogeneous Multi-UAV Missions

cs.RO ·2026-09-18 ·Muhammad Ahsan Mustafa, Yasheerah Yaqoot, Faryal Batool, Roohan Ahmed Khan, Valerii Serpiva +1 more
similarity 0.56
Abstract

Multi UAV missions in complex environments require the system to understand both the surrounding scene and the intent of a human operator while maintaining feasible task allocation as mission conditions change. This paper presents AgenticSwarm, an agentic framework for semantic perception and adaptive task allocation in heterogeneous multi UAV missions. An agent interprets aerial imagery and natural language instructions to construct a grounded mission representation that links perceived objects and regions with task requirements, capability constraints, and mission dependencies. This information augments a constrained task allocation process in which obstacle aware path feasibility, energy consumption, and protected return home requirements are incorporated before assignment. During execution, changes such as UAV failure, battery degradation, or task modification trigger residual mission reconstruction from the current system state, while completed work and reconnaissance progress are retained. AgenticSwarm is evaluated across five diverse Gazebo environments and an indoor real test environment, demonstrating its ability to connect semantic reasoning with constrained allocation and adaptive multi UAV mission execution. Compared with a Grounding DINO+SAM~2.1 perception baseline, the SAM3-based pipeline improves class-aware recall by 25.2 percentage points (pp) and semantic label accuracy by 29.5 pp. Ablating residual mission replanning increases mean repeated work from 0% to 61.7% and post-event recovery time by 58.6%, highlighting the contribution of adaptive replanning to mission execution.

0.18

Hierarchical Asynchronous Federated Learning over Space-Air-Ground Integrated Networks

cs.LG ·2026-10-31 ·Kai Wang, Chee Wei Tan
publishedbenchmark similarity 0.56
Abstract

With the emerging 6G paradigm where AI services operate over decentralized and resource-constrained edge infrastructure, performance of distributed learning algorithms remains a significant challenge. This paper proposes HAFL, a Low Earth Orbit (LEO) satellite-assisted hierarchical asynchronous Federated Learning (FL) framework, enabling resource-limited terrestrial clients to collaborate via Ground-Satellite Links (GSLs). Within this framework, LEO satellites serve multiple roles: as edge servers aggregating and broadcasting models, as clients accelerating training, and as high-throughput relays managing inter-satellite routing through Inter-Satellite Links (ISLs). Unlike conventional synchronous Jacobian-type updates, HAFL employs asynchronous Gauss-Seidel-type updates to enhance convergence speed. We provide theoretical convergences for convex, strongly convex, and nonconvex objectives, respectively, and formulate optimization problems to jointly determine optimal hyperparameters to minimize global training latency. Evaluations demonstrate that HAFL achieves faster initial convergence and comparable final performance for benchmark DNNs and datasets, offering promising FL systems across remote areas with 6G technologies, but much less global rounds and communication cost.

0.45