Wireless Semantic Communications for Video Conferencing

Беспроводные семантические коммуникации для видеоконференций
Peiwen Jiang, Chao-Kai Wen, Shi Jin, Geoffrey Ye Li
2022-11-21

channel state informationhybrid automatic repeat-requestkeypoint transmissionsemantic error detectorsemantic video conferencing
Video conferencing has become a popular mode of meeting despite consuming considerable communication resources. Conventional video compression causes resolution reduction under a limited bandwidth. Semantic video conferencing (SVC) maintains a high resolution by transmitting some keypoints to represent the motions because the background is almost static, and the speakers do not change often. However, the study on the influence of transmission errors on keypoints is limited. In this paper, an SVC network based on keypoint transmission is established, which dramatically reduces transmission resources while only losing detailed expressions. Transmission errors in SVC only lead to a changed expression, whereas those in the conventional methods directly destroy pixels. However, the conventional error detector, such as cyclic redundancy check, cannot reflect the degree of expression changes. To overcome this issue, an incremental redundancy hybrid automatic repeat-request framework for varying channels (SVC-HARQ) incorporating a novel semantic error detector is developed. SVC-HARQ has flexibility in bit consumption and achieves a good performance. In addition, SVC-channel state information (CSI) is designed for CSI feedback to allocate the keypoint transmission and enhance the performance dramatically. Simulation shows that the proposed wireless semantic communication system can remarkably improve transmission efficiency.
1
A keypoint-based semantic video conferencing network dramatically reduces transmission resources while preserving high resolution, primarily sacrificing detailed facial expressions.
2
SVC-channel state information enables feedback-based allocation of keypoint transmissions and dramatically enhances system performance.
3
Simulations show that the proposed wireless semantic communication system substantially improves video transmission efficiency.
4
The proposed SVC-HARQ framework uses incremental redundancy for varying channels and a semantic error detector that measures expression changes beyond conventional CRC detection.
5
Transmission errors in semantic video conferencing alter expressions, whereas errors in conventional video transmission directly corrupt image pixels.

wireless semantic video conferencing system based on keypoint transmission

the impact of transmission errors on keypoint-based semantic video communication and its transmission efficiency, error detection, and adaptive resource allocation

Publication Details
Publication Date
2022-11-21
Journal
Publisher
ISSN
Access Type
Author Information
Authors
Peiwen Jiang
Chao-Kai Wen
Shi Jin
Geoffrey Ye Li
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat →
Make a presentation
100%