Design Of Remote Binocular Vision System Based On Virtual Realty

In recent years,virtual reality technology has been developing day by day,and it can be seen everywhere in the fields of public safety,games and entertainment.The realization of virtual reality is to integrate virtual and reality through a variety of technologies to increase the user's simulation experience in the senses of sight,hearing,smell,and touch.Among them,the first sensing channel between the virtual world and the real world is the visual channel,which is inseparable from the stereoscopic display technology.Through this technology,the virtual system is provided with a data source of visual information,so that the user can feel the obvious stereoscopic visual effect.However,the stereoscopic display technology of the virtual reality system needs to rely on certain high-precision equipment and complex computer processing,the imaging technology is difficult and the cost of the equipment is also high.The human brain has the function of automatically synthesizing stereo images.The brain can synthesize the left and right eye views to generate stereo images and generate depth perception.Based on the principle of human binocular vision,this paper proposes a remote binocular vision system design scheme based on virtual reality.Using binocular cameras to simulate human eyes to acquire images,the acquired video images are processed and forwarded to the remote client through the streaming media server,and placed in the mobile phone box for viewing,so that the left and right eyes can view the two images with deviations through the brain The left and right eye images are merged to generate a stereo image.Compared with the current popular video playback technology,this design method achieves the effect of remotely watching live video and a realistic sense of immersion.The binocular vision system is built according to the server side and the client side,specifically:(1)The server is mainly constructed by binocular cameras and robot controllers,and the two are connected via USB.The specific server-side design can be divided into video image acquisition module,video image correction module,video image encoding module and streaming media service module.First,perform real-time correction processing on the images collected by the binocular camera to reduce the effect of the binocular camera on the stereoscopic image synthesized by the brain due to vertical parallax,and enhance the stereo imaging effect.The corrected left and right images are combined into a single image for transmission.The binocular synchronization is improved.Using H.264 encoding technology to compress video,and the secondary development of the Live555 platform,real-time forwarding of H.264 data stream,to achieve the real-time performance of the client and server.(2)The client is an Android mobile player,and the main design can be divided into a video image decoding module and a rendering display module.Use FFMPEG technology to decode the received code stream data,and then use Open GL technology to render and display,set up multithreading between decoding and rendering and display,and use the queue for buffer communication to realize the decoding while drawing,and the decoded The conversion of the video frame from YUV format to RGB format is realized through Open GL,which improves the drawing speed.The experimental results show that the system designed in this paper has a good correction effect.Watching remote scenes on the Android client has a strong sense of immersion and ensures real-time performance.