The Research Of The Real-Time Codec Technology Of HD Game Video Based On The GPU

In recent years, with the rapid development of network technology and the improving ofthe hardware equipment, network game has formed a huge and independent industry, andgradually been growing to the cloud gaming which is a mode in the future. The core of thecloud gaming is that the work of the images rendering is completed by the server side, and theclient is responsible for providing the capacity of the network, video decoding andhuman-computer interaction only. Therefore, in order to adapt to the development of scienceand technology, and solve the competition pressure of the enterprise, many Internetcompanies and Hardware vendors have been updating their software and hardware constantly,to get the video which has high resolution and high frame rate, and the smooth audio.With the video cloud gaming business solution of the AMD company, this paper mostlydeals with some initial research, then develops a series of efficient and professional standardto develop cloud gaming. The Developers need to refer to these APIs only, they will completethe development of related projects. This is an innovative technology, after the Cloud gamingpartners use it, they will get the minimum delay with the lower network bandwidth, what’smore, the game response quickly. At the same time, based on the standard, adopts the efficientreal-time transmission strategy RTSP, designs a remote streaming media transmission systemwhich is based on Live555and FFmpeg streaming media solution, to simulate the cloudgaming’s running mode. By exploring and improving continually, we test the feasibility of thesolution and the ability of the target machine.Firstly, this paper gives the overall designing solution of the system with the idea ofmodular to design, and the system is divided into Server and Client, at the same time, set upthe Network and UserInterface auxiliary modules to support Network transmission and userinput device management capabilities. In order to reduce the coupling between modules,strengthen the reusability of each module, on the basis of the media data’s processing, themodules call the interfaces to interact between them. Then, it introduces the process of eachmodule in detail and gives the functions that the developed APIs support.Secondly, after implementing the system’s basic function, in the codec period, we make full use of the efficient computing power of GPU for the image’s CSC(Color SpaceConversion) processing and hardware acceleration to optimize and improve the performanceof the video codec, and reduce the CPU’s computing pressure at the same time. At the codingphase, we combine with the AMD OpenVideo(OVE) encoding library, use the CPU+GPUtogether to complete encoding task, and transfer the CSC processing to GPU which couldaccelerate the video streaming’s compression in parallel manner. At the decoding stage, wedesign the relevant data structure and calling interface, use GPU and DXVA2.0technology toaccelerate decoding, achieve the video’s post-processing(CSC) and decoding simultaneously.In each module, we design the jitter buffer, and use the shared memory and audio/videosynchronization technology (timestamp) to optimize the system’s performance.Finally, we test the function and performance of the system, then give the client andserver modules’ performance testing and analysing results. The experimental tests show thatthe system simulats the running mode of cloud gaming successfully, the interoperabilitybetween modules is wonderful: the clarity and smoothness of the Client’s image looks well,has obtained the good effect of video playback and has good real-time performance andreliability. The system’s decoding speed have improved largely, the CPU/GPU/memory’susage rate is low. Under30FPS frame rate,1080p resolution, Server can transmit4videostreaming at the same time, namely a target Server can serve4common devices. Good testingresults demonstrate that the standard has pass the actual application’s testing, and thetechnology has extensive development in the video game and other multi-media industry atthe same time, and contributes to push the industry which surround the cloud gaming todevelop continuously.