Wireless Semantic Communications for Video Conferencing
Беспроводные семантические коммуникации для видеоконференций
2022-11-21
SCID: 54.1/fm44qkzn
Discuss with AI
channel state informationhybrid automatic repeat-requestkeypoint transmissionsemantic error detectorsemantic video conferencing
Figures from the paper
Abstract (AI)
Video conferencing has become a popular mode of meeting despite consuming considerable communication resources. Conventional video compression causes resolution reduction under a limited bandwidth. Semantic video conferencing (SVC) maintains a high resolution by transmitting some keypoints to represent the motions because the background is almost static, and the speakers do not change often. However, the study on the influence of transmission errors on keypoints is limited. In this paper, an SVC network based on keypoint transmission is established, which dramatically reduces transmission resources while only losing detailed expressions. Transmission errors in SVC only lead to a changed expression, whereas those in the conventional methods directly destroy pixels. However, the conventional error detector, such as cyclic redundancy check, cannot reflect the degree of expression changes. To overcome this issue, an incremental redundancy hybrid automatic repeat-request framework for varying channels (SVC-HARQ) incorporating a novel semantic error detector is developed. SVC-HARQ has flexibility in bit consumption and achieves a good performance. In addition, SVC-channel state information (CSI) is designed for CSI feedback to allocate the keypoint transmission and enhance the performance dramatically. Simulation shows that the proposed wireless semantic communication system can remarkably improve transmission efficiency.
Key Findings
1
A keypoint-based semantic video conferencing network dramatically reduces transmission resources while preserving high resolution, primarily sacrificing detailed facial expressions.
2
SVC-channel state information enables feedback-based allocation of keypoint transmissions and dramatically enhances system performance.
3
Simulations show that the proposed wireless semantic communication system substantially improves video transmission efficiency.
4
The proposed SVC-HARQ framework uses incremental redundancy for varying channels and a semantic error detector that measures expression changes beyond conventional CRC detection.
5
Transmission errors in semantic video conferencing alter expressions, whereas errors in conventional video transmission directly corrupt image pixels.
Research Object
wireless semantic video conferencing system based on keypoint transmission
Research Subject
the impact of transmission errors on keypoint-based semantic video communication and its transmission efficiency, error detection, and adaptive resource allocation
Publication Details
Publication Date
2022-11-21
Journal
Publisher
ISSN
Access Type
Author Information
Download PDF
Subscribe to digest