Research On Multi-Modal Code Stream Transmission Strategy For Cellular D2D Hybrid Network

With the development and popularization of multimedia communications technology,people want to further enhance their sensory experience through touch while pursuing clearer sound and images.Therefore,multi-modal communications has become one of the main ways for people to exchange and communicate information.Multi-modal communications refers to the use of information technology to simultaneously transmit multimodal data including voice,text,image,video,and haptics.Multi-modal communications is not only widely used in daily life,but also plays an important role in industry,education and medical fields.For example,with the support of multimodal communications technology,enterprises can realize remote office,off-site operation and other working methods,which improve the efficiency and flexibility of collaboration;educational institutions can realize online education,which can provide students with richer educational means while expanding the coverage of educational resources and audience groups;medical institutions can realize remote consultation,remote surgery and other services,which can effectively balance medical resources Medical institutions can realize remote consultation and remote surgery,which can effectively balance medical resources and improve the quality of medical services.However,there are some challenges and difficulties in multi-modal communications.Audio and video belong to the existing mainstream modalities,and their transmission requires high bandwidth;while haptics emphasizes more on the real-time and reliability of the signal.The different characteristics among heterogeneous streams make it a challenge to maintain high quality transmission of the code streams of audio,video and touch simultaneously in the multimodal communication process.In order to solve the above problems,this paper investigates the transmission algorithm for multimodal code streams by combining the characteristics of audio-video and haptics and the scenario of wireless cellular-D2 D hybrid network.The specific work of this paper is as follows:(1)This paper discusses and summarizes the challenges and opportunities faced by multi-modal code stream transmission techniques in cellular-D2 D hybrid networks.The characteristics and usage scenarios of common techniques for D2 D communication,non-orthogonal multiple access,scalable video coding and multi-objective optimization algorithms are analyzed,and the significance of combining these techniques to improve the performance and user experience of multi-modal communications systems is pointed out.(2)To solve the inefficient transmission problem caused by the different transmission demands of multi-modal streams,this paper proposes a transmission mode selection framework for multimodal services based on the existing communication paradigm.First,different types of multi-modal services are classified according to the importance and weight of each modal stream in multi-modal services,and three transmission strategies are proposed to meet different transmission demands,and the corresponding mode selection and resource allocation rules are designed.Secondly,an improved multi-objective optimization algorithm is proposed for selecting transmission modes and allocating resources for multi-modal users.Finally,the simulation results show that the method can improve the quality of service for multi-modal users in wireless communication systems and achieve higher resource utilization efficiency.(3)To address the problem of poor user experience during multi-modal code stream transmission,this paper proposes a user experience-driven multi-modal code stream mode selection and resource allocation strategy.The video image is coded into multiple layers by scalable video coding technology,and the multi-modal signals are flexibly combined in different scenarios,and two transmission modes are designed to be transmitted in combination with non-orthogonal multiple access technology.Based on this,a decomposition-based multi-objective evolutionary algorithm is introduced in this paper to optimize the transmission modes and communication resources with the goal of improving the user experience of multi-modal code streams,and the improvement of the described strategy on user experience is demonstrated through simulation experiments.