Design And Implementation Of Web Robot’s Interactive Functions

In recent years, instant messaging (IM) based web robot has become an importanttool for internet communication. However there still exist various drawbacks in thecurrent web robots, e.g., major interactions between the user and the web robot dependon the traditional keyboard, lack of a robot entity, liveliness and playfulness.The research objectives of this project is to design and implement a web robotexperimental system, which can maximize the sharing of IM value added services(VASs) and network resources, realize the friendly interactions with the usersthrough tactual and visual humanoid modules, and further behave varioushumanoid characters, e.g., vivid emotional expressions, body movements andbehavioral learning. This project has developed the hardware for integrating to apractical web robot experimental device. The hardware system consists ofcortex-M3based microcontroller LPC1752and several peripherals equipmentsincluding power, USB communication, and humanoid robotic module(touch,movement, display).Based on the developed hardware systems, this project presents an efficientapproach to solve the problem of real-time robust hand segmentation and fingertipextraction for finger gesture recognition in Human-robot interaction. Firstly, animproved cascade filtering based hand region candidate is estimated by thecombination of YCbCr skin color probability image. Using the segmented handcandidate regions, fingertips are detected from the contour of a hand using acurvature-based algorithm. An accurate fingertip point is computed by fitting anellipse to the contour around the fingertip using least-squares fitting from thecandidate fingertip points.Finally, this project completes the experimental tests and analyses of various coremodules in the developed web robot system, mainly including the tactual and visualhumanoid functions, and electromagnetic radiation intensity. The results obtainedverify that the developed web robot reaches the expected goals and experimental effects. This project will provides a feasible technical solution to break therestrictions from traditional keyboard and mouse input devices and to realize moreconvenient human-computer interactions including gestures, movements and facialexpressions.