Research On Audio And Video Synchronous Compression Technology In New Media

This topic studies the audio and video synchronous compression technology under the new media.With the rapid development of new media technologies,the requirements for audio and video are getting higher and higher,and the synchronization problem of audio and video has not been completely solved.This topic is based on DSP hardware platform.The audio and video information is synchronously collected and processed,and the audio is embedded in the inverse of the first non-zero tailing coefficient in the reverse direction of the Zig-zag scan on the basis of H.264/AVC,and the audio is embedded by entropy coding.The video file is subjected to lossless compression.After the compression is completed,it is transmitted to the network terminal via the Ethernet interface in the form of TS stream in the form of TS stream for decoding and synchronous playback.The hardware platform of the system is based on TI's DaVinci series DM6467 T processor.The audio and video information is collected by CCD camera and 3.5mm microphone.The collected information is received by the VP port in DM6467 T to the V4 series FPGA.Pre-processing,the YUV video data in the 4:2:2 format is converted to the 4:2:0format,and transmitted to the DSP through the SPI port for synchronous compression.The compression process is based on the realization of the current mainstream video compression standard H.264/AVC,and the algorithm is improved,and the audio information is embedded by the parity of the DCT coefficients.The collected audio information is stored in the form of a binary bit stream after AD conversion,and the video data is compressed in the form of a residual block.After the 4×4 DCT transform,the residual block is changed into a two-dimensional frequency domain information array by the time domain information,4 The DCT coefficients of ×4 are quantized and traversed by the Zig-zag scanning method.After reordering,they become the one-dimensional array of the low-frequency information in theprevious high-frequency information.The change of the high-intermediate information in the back has little effect on the image quality.Therefore,the audio information is recorded by changing the parity of the last one non-zero tailing coefficient of the luminance block having the non-zero coefficient.The embedded audio and video hybrid file is transmitted over the network in the form of TS stream according to the UDP protocol at a code rate of 1600 Kbps.After receiving the UDP packet,the receiving end unpacks,decompresses,and parses the audio information in the configured VLC player.Wait for the operation to achieve synchronous playback.After the audio information is parsed,the video information is repaired.Through the analysis of the video image PSNR-Y,it is necessary to obtain the repair work.After experimental research,this research has realized real-time synchronous compression and playback of audio and video.While ensuring the quality of audio and video,the video compression ratio can reach 157,and the audio can reach 5%.The audio and video synchronization effect is good,and the basic feeling is not lost.Offset;real-time effect is good,although there is a delay,but does not affect the viewing.