The Implementation And Application Of Single-view Head Fitting Based Hair Try- On Engine For Mobile Platform

With the advent of mobile Internet, all kinds of interesting Apps have been widely used as they facilitate people’s lives and provide rich fun experiences. It is an opportunity to bring fancy technology of computer graphics into daily life. It turns out that portrait manipulation is a proper entry point as it satisfies the urge to synthesize better looking or funnier portraits. Among methods like face beautification, virtual hairstyle try-on technology satisfies real needs well because people can preview their new styling before a haircut, which protects them from unexpected results. Recently, there is a trend in utilizing 3D shapes for complex portrait manipulations and a breakthrough has been made in single view hair modeling. However, to the best of our knowledge, current hairstyle try-on Apps are far behind the trend: they simply have a 2D hair image lay on the top of input portrait, which results in fake effects.To provide more visually correct composition and user-friendly service, we developed a single-view head fitting based hairstyle try-on engine for mobile platform. Users only need to provide one portrait and select out origin hair with few intuitive strokes. Then our engine will automatically fit a 3D face model, remove origin hair and try on new hairstyle. We firstly introduce the pipeline of our engine and then describe each module in detail. Our head fitting module is built by integrating third-part libraries. To meet the limited hardware resource environment, we dived deep and took lots of optimization strategies in areas such as real time interaction, realistic forehead skin completion, realistic hair rendering and model data compression. Finally, hairstyle try-on service is encapsulated into a SDK to facilitate developers on iOS and Android platforms.