Oriented Research And Implementation Of Mobile Devices, Rich Media End-to-end System

Rich Media technology is a new media concept, which is different from tranditional multimedia like video and audio. It usually contains a variety of elements, such as, text, vector graph and video. And make these elements display together.With hardware and network bandwidth escalated, Rich media technology is expanding to embedded area. Along with the arrival of the era of 3G network, There is a growing demand for the embedded application, which can bring great user experience and high efficiency. So the embedded rich media services will have broad market demand. From the interative mobile TV to electronic magazines, A lot of services can use embedded rich media technology.Typical rich media services include a series of scenes, which are used to organize various media elements from the temporal and spatial. According to the specific needs of the rich media services, these media elements are mainly of audio, video, vector graphics and animations etc. The organization of these elements, the transmission, and the synchronization of different streams are all complex problems.On the market at present the application and rich media technology is not particularly extensive, mature technology product is also not much. the international standards which are widely adopted by are also very few. The thesis through analyzing some existing standards, such as LASeR defined by ISO, the DIMS standards by 3GPP, and some other related agreement, standard, puts forward a set of suitable rich media technology for Windows mobile phones.In embedded technology at present, There are several main competition strength. The first is Adobe's Flash, which is successful on PC platform, and Flash Lite for mobile phones and other electronic equipment. Flash Lite is highly optimized lightweight version. Due to the Adobe company provides a very powerful production tools, making Flash scene content is very convenient. But because of the commercial background, the Flash SWF files of specific format is not open. The opening format of scene file is the LASeR of ISO organization, and the DIMS of 3GPP.In this thesis, the client of the system is based on the DirectShow architecture, which is used for process the media on the Microsoft Windows platform. The mobile phones with Windows mobile system also support this techonology. The main structure of the rich media system is a kind of client/server structure, the innovation is the storage of the scene and media data on server, The reconstructed RTP protocol and the development of DirectShow Filters on mobile phone. The tool RMSBox is developed in the thesis, it can be used to storage the scene content, together with other media streams in a single 3GP file, in order to make the streaming server to recognize the scene content, and streams the scene units using RTP protocal. At the client, a few of filters are developed. These filters can be used for receiving, processing RTP packets from the server and decoding media frames. The last step is to overlay the video output and the scene together and render the RGB data to screen. At the end of the thesis, An example is set to verify the feasibility and effectiveness of this method.