Virtual Reality (VR) is an active technology research field in recently years, having a series of advanced technologies. Since it can bring a highly real experience, it makes exploring the macroworld and microworld more convinient. The paper studies the key technologies of human-computer interaction based on virtual hand in the immersive virtual environment using data glove and position tracker, and also the application in transformer substation simulation system.Firstly, the paper emphatically introduces the immersive virtual environment's concept, character and the key technologies of human-computer interaction, especially based on virtual hand. Then, it researches bone structure and terms of hand motion. I make the virtual hand using 3DS MAX. I summarize the theory, function and key algorithms of 3D input devices and implement the devices' communication with computer. The paperudies the ultrasonic and inertia tracking algorithms, how to obtain and set the data of the virtual hand's joints. Combining hand gesture understanding in different modes, I design a driving algorithm of the virtual hand to implement a real-time human-computer interaction. I use a filter algorithm to assure the stability and accuracy of the interaction. At last, the paper introduces the transformer substation simulation environment, implements virtual hand interaction process based on scene context semantic understanding, and also summarizes the advantage and foreground of the technology's application in electric systems.Finally, a real-time interaction platform is developed under Windows VC2003.NET platform, using OSG SDK, 5DT Data Glove 5 and PCTracker. By applying it to the transformer substation simulation, I can make some interaction with devices. Multi-mode scene context understanding improves the intelligence of the system. It is convenient for the training of electric systems, and has a good application future. |