Pilot Behavior Pattern And Cognitive Performance Using HUD In Different Flight Phases

It is the eternal theme and pursuit of aviation industry to improve flight safety.People's expectations of aviation safety are getting higher and higher.Early in the 1980 s,Head-up Display(HUD)was first applied on civil trunk airliner.Now it has become one of the necessary instrumentations in the cockpit due to its unique features and benefits.CAAC also encourages air operators to install double sets of HUDs during selective equipment installation.Although research has shown that HUD can improve pilots' flying skill,it does not explicitly state how it affects their perception,decision-making and behaviors.Therefore,it is necessary to study pilots' patterns of behavior and cognitive performance combined with the characteristics of different flight stages.This research not only provides strong support and reference for the airworthiness compliance verification of HUD,but also provides experimental reference for design optimization of HUD from the perspective of design of the cockpit,combined with pilots' operating characteristics.The main contents of this paper are as follows:Firstly,the relevant literature on the use and design of HUD was organized,classified and analyzed.Provisions and AC for systems and equipments on the aircraft in FAR-25.1302-1 were sorted out.By analyzing guidance on design and compliance verification of equipments operated by flight crews in AC 25.1302-1,research methods of pilots' behavior patterns and cognitive performance using HUD in different flight stages were found out.Secondly,method of the pilot's hand tracking was studied.The pilot's hand in the video was identified through image processing.Comparing with different tracking methods,also combined with cockpit environment and characteristics of the pilot's hand movement,target tracking method based on nuclear correlation filtering was finally selected to track the pilot's hand.In the meanwhile,combined with characteristics of hand skin color and features of cockpit background,the algorithm was improved.Based on the above study,the experimental research on behavior patterns and cognitive performance of pilots using HUD was carried out.Eye tracker and hand tracking method are applied to record the behavior of pilots during flight.The experiment was designed and the experimental datum of the pilot's eye movement,head movement,hand movement and cognitive performance are analyzed.Finally,the recognition method of pilots' behavior patterns using HUD was studied.Pilots' characteristics of eye movement,head movement and hand movement are respectively represented by eye gaze sequences of different fields of interest when performing different tasks,real-time yaw,pitch and roll angle of the head,and manually tracking hand position.The conditional random field and implicit dynamic conditional random field are applied to identiry the pilot's different behavior characteristics.