Research On 360 Degree Real Time Virtual Fitting System Based On Kinect And Grey Prediction

With the development of Kinect,Virtual Reality and Human Computer Interaction(HCI)have come into daily life.Virtual fitting,which provides people convenient fitting experience,has become more and more popular.However,most virtual fitting system today is mainly focus on clothes simulation and HCI,but fail to consider how clothes models rotate following human's body.To solve the problem,we introduce an algorithm to realize real time virtual fitting system which can make clothes model rotate by 360 degree following human's body.In this paper,we propose a face detection method based on ellipse skin model to judge the front or back of human body.We capture user's skeleton feature points by Kinect,and track them in real time.Then we get the 3D coordinates of human head joints by index.With the RGB image obtained by Kinect,we judge the front or back of human body by face locating,image segmentation and skin detection.Considering inaccurate data captured by Kinect,we give a prediction of human joints motion based on grey model.We predict the position change of shoulders joints in real time.When the depth coordinate values of the shoulders' joint points are changed greatly,we judge it is a jumping time.According to the results of face prediction and grey prediction,we determine whether it is needed to correct the data of virtual human model joints.In view of different situations,the virtual human model is driven by the different joints data to realize the 360 degree real time virtual fitting system.The proposed method has the following advantages:(1)Sense of reality,the 360 degree real time virtual fitting system make users can see the front and back fitting effect.(2)Real-time,the predicted results can be can obtained quickly by grey model prediction,which realize the real-time rotation of the clothes model with the human body.(3)Accuracy,during the fitting process,other prediction methods will give misjudgment due to the limited skeleton joints information.As shown in the experimental results,our system can achieve better dynamic fitting effect.