Deep Learning Enabled Semantic Communication Systems

Системы семантической связи на основе глубокого обучения
Zhijin Qin, Geoffrey Ye Li, Huiqiang Xie, Biing‐Hwang Juang
2021-01-01

DeepSCTransformersemantic communicationsentence similaritytransfer learning
Recently, deep learned enabled end-to-end communication systems have been developed to merge all physical layer blocks in the traditional communication systems, which make joint transceiver optimization possible. Powered by deep learning, natural language processing has achieved great success in analyzing and understanding a large amount of language texts. Inspired by research results in both areas, we aim to provide a new view on communication systems from the semantic level. Particularly, we propose a deep learning based semantic communication system, named DeepSC, for text transmission. Based on the Transformer, the DeepSC aims at maximizing the system capacity and minimizing the semantic errors by recovering the meaning of sentences, rather than bit- or symbol-errors in traditional communications. Moreover, transfer learning is used to ensure the DeepSC applicable to different communication environments and to accelerate the model training process. To justify the performance of semantic communications accurately, we also initialize a new metric, named sentence similarity. Compared with the traditional communication system without considering semantic information exchange, the proposed DeepSC is more robust to channel variation and is able to achieve better performance, especially in the low signal-to-noise (SNR) regime, as demonstrated by the extensive simulation results.
1
DeepSC demonstrates greater robustness to channel variation and better performance than traditional communication systems, particularly in low SNR regimes, per extensive simulations.
2
DeepSC is built on the Transformer architecture to maximize system capacity and minimize semantic errors.
3
Introduced a new evaluation metric called sentence similarity to accurately justify semantic communication performance.
4
Proposed DeepSC, a deep learning based semantic communication system for text transmission that focuses on recovering sentence meaning rather than bit/symbol errors.
5
Transfer learning is applied to make DeepSC adaptable to different communication environments and to accelerate model training.

DeepSC: a deep learning based semantic communication system for text transmission (Transformer-based end-to-end communication system)

Maximizing semantic-level communication capacity and minimizing semantic errors by recovering sentence meaning (robustness to channel variation and performance at low SNR), including transfer learning adaptation and evaluation via a sentence-similarity metric

Publication Details
Publication Date
2021-01-01
Journal
Publisher
ISSN
Cited by
1560
Access Type
Author Information
Authors
Zhijin Qin
Geoffrey Ye Li
Huiqiang Xie
Biing‐Hwang Juang
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat
Make a presentation
100%