Generative AI Agents With Large Language Model for Satellite Networks via a Mixture of Experts Transmission
Генеративные агенты искусственного интеллекта с большими языковыми моделями для спутниковых сетей посредством передачи на основе смеси экспертов
2024-09-12
SCID: 54.1/gajasjdd
Discuss with AI
generative AI agentslarge language modelsmixture of expertsretrieval-augmented generationsatellite communication networks
Figures from the paper
Abstract (AI)
In response to the needs of 6G global communications, satellite communication networks have emerged as a key solution. However, the large-scale development of satellite communication networks is constrained by complex system models, whose modeling is challenging for massive users. Moreover, transmission interference between satellites and users seriously affects communication performance. To solve these problems, this paper develops generative artificial intelligence (AI) agents for model formulation and then applies a mixture of experts (MoE) approach to design transmission strategies. Specifically, we leverage large language models (LLMs) to build an interactive modeling paradigm and utilize retrieval-augmented generation (RAG) to extract satellite expert knowledge that supports mathematical modeling. Afterward, by integrating the expertise of multiple specialized components, we propose an MoE-proximal policy optimization (PPO) approach to solve the formulated problem. Each expert can optimize the optimization variables at which it excels through specialized training through its own network and then aggregate them through the gating network to perform joint optimization. The simulation results validate the accuracy and effectiveness of employing a generative agent for problem formulation. Furthermore, the superiority of the proposed MoE-ppo approach over other benchmarks is confirmed in solving the formulated problem. The adaptability of MoE-PPO to various customized modeling problems has also been demonstrated.
Key Findings
1
MoE-PPO outperforms comparative benchmark methods on the formulated transmission problem and adapts to customized modeling tasks.
2
Retrieval-augmented generation supplies satellite-domain expertise to support accurate mathematical modeling within an interactive LLM-based paradigm.
3
Simulations validate the accuracy and effectiveness of generative-agent-based problem formulation for satellite communication networks.
4
The paper develops generative AI agents using large language models to formulate complex satellite-network optimization models for massive-user scenarios.
5
The proposed mixture-of-experts proximal policy optimization method assigns specialized optimization variables to expert networks and combines their outputs through a gating network.
Research Object
Satellite communication network with satellites and massive ground users (6G global communications context)
Research Subject
LLM-based generative-agent modeling and MoE-PPO transmission-strategy optimization under satellite–user interference
Publication Details
Publication Date
2024-09-12
Journal
Publisher
ISSN
Cited by
219
Access Type
Author Information
Download PDF
Subscribe to digest