Design And Implementation Of RTMP-based Live Streaming Solution For Video Conference System Based On HTML5

Video conference system is an efficient cooperative office application system,which provides an information exchange and sharing platform by graphics and sound for geographically dispersed users,and it can reduce the cost of meeting and has very high practical value.With the enhancement of terminal processing capacity and the development of network,streaming media and HTML5,many video conference systems began to provide support for Web to reduce restrictions of hardware and software o n the video conference system.The video conference system of a company(referred to as company C in this paper)is a converged system with multi-terminal and multi-protocol,and it achieves live and media sync playback function by Flex/Flash and RTMP protocol in Web,while Flash plug-in is at present going away.Therefore,we need a substituted scheme to satisfy the demand of no plug-in,low latency and good compatibility.This paper studies the mainstream solution of Web live based on the live requirement of HTML5 video conference of company C,a new solution is designed and implemented using RTMP protocol,HTML and other technologies,which needs no plug-in and can guarantee a low live delay.This new solution also gives RTMP live from the dependency of Flash,and fills the bank of RTMP live without plug-in under HTML5.In addition,the scheme implemented by this paper also has some characteristics: small changes on the original system,convenient to extension and deploy,the support of load balancing and so on.The main contributions of this paper can be summarized as follows:1)Combined with the requirements of the video conference system of company C,the mainstream solutions for the current Web live and streaming media related technologies was investigated,including RTMP protocol,FLV,AAC,H.264,HTML5 and other related technologies;2)Combined with the demand,a new live solution is designed for the original video conference system,which the core idea is that transfer the RTMP stream to FLV Tag stream by using edge proxy server and push to the client and decode playback by applying H TML5 technology;3)A lightweight proxy server is designed and implemented,which is standalone,structured and easy-to-deploy,it uses C,C + + and multi-threaded to implement,and highly abstracts RTMP resources through data structures;4)A modular and easy-to-extend FLV live client is designed and implemented,which the player is ful y implemented by HTML5 technology and JavaScript;5)The test environment is deployed,and then the implementation of the scheme is tested in detailed functional and performance.Test results show that the scheme meets the requirements of conference for live,media playback,live recording and the view of server status.In the case of a resolution of 640x480 and a frame rate of 20 fps,the live delay can reach 129 ms.The playback delay of RTMP is 1075 ms lower than CKPlayer(Flash),and also 2284 ms lower than VLC.On the other hand,the resource occupancy is stable and within acceptable range.The results show that the scheme can get good performance in these areas: compatibilities,quality,audio and video synchronization,stability and server concurrency.The test results are consistent with the expected results,and also show that the design ideas and methods are correct and effective.