| Under the background of the new crown epidemic and the increasingly fierce competition in the live broadcast industry,differentiation and vertical fields have become the core strategies of mainstream live broadcast manufacturers.Therefore,the author's Bytedance live broadcast team began to work on audio live broadcasts in early2020.Live karaoke was born as a model with low education cost and wide audience.From the perspective of product functions,the system mentioned in this article contains nine major business functions,which are resource management function in live karaoke,song management function in live karaoke,singing function in live karaoke,sound effect function in live karaoke,song listening function in live karaoke,resource management function in KTV room,song management function in KTV room,sound effect function in KTV room,multiplayer interactive singing in KTV room.Based on the product requirements,this article has carried out a detailed demand analysis of the system,and made a summary design for the system.After that,we did an architectural module division based on the business function division.Finally,we made a detailed design for the system and finally realized it.Different from simple Android applications,it is based on two scenarios of live streaming and audio and video instant messaging.Therefore,it includes all the technical difficulties related to large-scale Android engineering architecture design,live streaming,audio and video instant messaging,and traditional karaoke application.(1)In terms of engineering,most of the technologies in this project,which lasted about a year,were realized on the client side because of the particularity of the system.The Android single-ended code volume exceeds 50,000 lines.Therefore,The first technical difficulty and innovation that this paper solves is to develop and use self-developed platform-based architecture solutions to solve the platform-based architecture problems of large-scale business modules to achieve the high scalability and high reusability required by the system.(2)Different from the traditional stand-alone karaoke application,the live karaoke business is established in the live streaming scene.This article innovatively implements a full set of data communication protocols and data packet splitting combined solutions based on SEI(Assisted Enhancement Information)technology in streaming media live encoding technology at the business layer,and use it to realize the SEI-based hybrid transmission and synchronization of lyrics and instructions,while greatly improving the user experience and saving the bandwidth cost of the platform.(3)In the KTV room business based on instant messaging scenarios,this article innovatively proposes a hybrid technical solution based on long link core process control and using SEI to transmit redundant data,which solves the problem of KTV's multi-terminal state consistency in audio and video instant messaging and reliable transmission of KTV's core data based on RTP and RTCP.(4)In terms of algorithms,the data set in this system comes from the song data of the music library and the user's embedded point data generated by the client's operation.The data set is processed through the comprehensive scoring mechanism applicable to this system.We use a hybrid recommendation algorithm with a three-tier structure of recall,refinement,and rearrangement for personalized music recommendation.Thanks to the solution of the above-mentioned engineering difficulties and the recommendation algorithm,the system has obtained a large number of active user groups.Most importantly,we reached a cooperation with a famous music program in early 2021. |
PDF Full Text Request