Research On Rich Media Of Packaging Information Based On Augmented Reality

Rich media information refers to a comprehensive cross-media method that integrates digital signatures,text content,hyperlinks to detailed content,image content,audio and video content,and animation and three-dimensional model expressions.In recent years,the traditional packaging field has been gradually influenced by rich media information disseminated by Internet media.The improvement of mobile smart terminal hardware configuration(smartphone)and the development of network communication capabilities(5G network)are not only a challenge for the packaging and printing industry,but also an opportunity for transformation and upgrading.Applying mobile augmented reality technology to ordinary packaging products,you can connect the physical printing information on the surface of the packaging product with virtual digital information,use packaging as the carrier of the tracking image of the augmented reality technology,and combine the mobile smart terminal with the printed surface information of the packaging product.Realize the augmented reality and rich media information display function,so that users can get a surreal virtual and real fusion experience,and thus broaden the channels,levels and dimensions of the information content transmitted by ordinary packaging printed materials.This subject is aimed at the needs of information transmission on the outer surface of ordinary packaging printed products,innovatively combining augmented reality technology and rich media technology,and researching and developing a packaging information rich media system based on augmented reality.The main research contents include augmented reality technology based on natural logo,augmented reality technology based on artificial logo and construction technology of packaging rich media information display function.The specific work is as follows.Firstly,based on a brief description of augmented reality technology and rich media technology,through the analysis of the system’s rendering development platform Unity3D and augmented reality related development tools,this topic chose to use OpenCV as the technical support layer of the open source SDK for the underlying augmented reality development,Import the augmented reality OpenCV development toolkit into Unity3D to build a complete set of augmented reality system with the rich media display of packaging information as the core function,effectively avoiding the closedness and non-autonomy of the SDK for commercial developers.Secondly,for the augmented reality system that uses the natural features of the printed image on the surface of the packaging as the logo image,through the study and comparison of the three image local feature extraction methods of SIFT,SURF and ORB,ORB is finally selected as the extraction method of the local features of the printed image on the packaging surface.On this basis,the Brute-Force algorithm is used as the feature point matching method,and the EPnP algorithm is used to estimate the real-time pose of the camera,real-time tracking and registration of the rich media information to be displayed,and the completion of the augmented reality research with natural features as the logo,and the realization Packaging rich media information display.Thirdly,for the augmented reality system based on the artificial design marks on the outer surface of the package,after analyzing the classification and design principles of the artificial marks,a series of digital image algorithms are used to process the two-dimensional images containing the artificial marks in the video stream captured by the camera.Including the steps of binarization processing,geometric transformation,edge detection,seed filling,template matching and decoding marking,to achieve the positioning,extraction and matching recognition of artificial marks,and completed the augmented reality research based on artificial marks and the corresponding packaging information Rich media display.Finally,in the development of practical application cases,this topic built a development environment based on Windows/Android system;completed the development of an augmented reality rich media system represented by toy packaging;and finally realized the scanning of two-dimensional printed images on the outer surface of paper packaging,A comprehensive application of packaging rich media information display system in the form of augmented reality.After experimental testing,the system has good effectiveness and robustness,indicating that the research method and system flow of packaging information rich media based on augmented reality proposed in this paper have good applicability and practicality.