Generative AI Agents With Large Language Model for Satellite Networks via a Mixture of Experts Transmission

Генеративные агенты искусственного интеллекта с большими языковыми моделями для спутниковых сетей посредством передачи на основе смеси экспертов
Hongyang Du, Jiawen Kang, Dusit Niyato, Dong In Kim, Abbas Jamalipour, Zehui Xiong, Ruichen Zhang, Yinqiu Liu
2024-09-12

generative AI agentslarge language modelsmixture of expertsretrieval-augmented generationsatellite communication networks
In response to the needs of 6G global communications, satellite communication networks have emerged as a key solution. However, the large-scale development of satellite communication networks is constrained by complex system models, whose modeling is challenging for massive users. Moreover, transmission interference between satellites and users seriously affects communication performance. To solve these problems, this paper develops generative artificial intelligence (AI) agents for model formulation and then applies a mixture of experts (MoE) approach to design transmission strategies. Specifically, we leverage large language models (LLMs) to build an interactive modeling paradigm and utilize retrieval-augmented generation (RAG) to extract satellite expert knowledge that supports mathematical modeling. Afterward, by integrating the expertise of multiple specialized components, we propose an MoE-proximal policy optimization (PPO) approach to solve the formulated problem. Each expert can optimize the optimization variables at which it excels through specialized training through its own network and then aggregate them through the gating network to perform joint optimization. The simulation results validate the accuracy and effectiveness of employing a generative agent for problem formulation. Furthermore, the superiority of the proposed MoE-ppo approach over other benchmarks is confirmed in solving the formulated problem. The adaptability of MoE-PPO to various customized modeling problems has also been demonstrated.
1
MoE-PPO outperforms comparative benchmark methods on the formulated transmission problem and adapts to customized modeling tasks.
2
Retrieval-augmented generation supplies satellite-domain expertise to support accurate mathematical modeling within an interactive LLM-based paradigm.
3
Simulations validate the accuracy and effectiveness of generative-agent-based problem formulation for satellite communication networks.
4
The paper develops generative AI agents using large language models to formulate complex satellite-network optimization models for massive-user scenarios.
5
The proposed mixture-of-experts proximal policy optimization method assigns specialized optimization variables to expert networks and combines their outputs through a gating network.

Satellite communication network with satellites and massive ground users (6G global communications context)

LLM-based generative-agent modeling and MoE-PPO transmission-strategy optimization under satellite–user interference

Publication Details
Publication Date
2024-09-12
Journal
Publisher
ISSN
Cited by
219
Access Type
Author Information
Authors
Hongyang Du
Jiawen Kang
Dusit Niyato
Dong In Kim
Abbas Jamalipour
Zehui Xiong
Ruichen Zhang
Yinqiu Liu
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat
Make a presentation
100%