Research On Three-Dimensional Display Based On Human Visual Specialties

There has been a consensus in the field of imaging that three dimensional (3D) imaging and display technique is the basic element of imaging industry of the next generation. Since the technique has been further developed and improved by many research groups, the visual experience becomes more real and vivid. To meet the ever-growing demands of 3D imaging and work with the human visual specialties (HVS), this technique has been the current research focus. However, problems exist in all kinds of 3D display techniques such as visual fatigue, crosstalk in anaglyphs, low temporal and spatial resolution and distortion in color repeatability, which would hinder the marketization of a new type 3D display technique. Focused on 3D display, this paper 1) studied the performance of HVS; 2) discussed the relationship between components of 3D display technique and elements from human spatial vision; 3) elaborated depth information processing in 3D display using light field theory; 4) furtherspread the notion of auto-stereo display and studied the relevant techniques and image rendering method; 5) finding ways to tackle with problems such as crosstalk andvisual blur in auto-stereo display which would cause visual fatigue. Although there may be deficiencies as spatial resolution and crosstalk in integral imaging display, those deficiencies would be avoided whenused for depth imaging. After analyzing limitations in depth imaging of microscopes and optical tweezers, we suggested and built a depth extraction and imaging microscopic device based on integral imaging, optimizedthe stereo matching algorithmin integral imaging which tookinterpolation, adaptive window and frequency domain properties into account. We also drew a depth map when using optical tweezers. Since stereo vision would be affected bydistortion in color repeatability in six primary (6P) separation 3D imaging. Thus we analyzed the spatial properties of 6P colors laser 3D display and introduced a color management plan based upon camera response spectrum and segment gamut extension.The main research works are as follows:1. We elaborated HVS and elements of shaping the stereo vision related to display techniques, discussed the relationship between HVS and components of 3D display technique, compared mechanisms of 3D display techniques in folding different type of stereo vision. Using the light field theory, we analyzed the process in recording and reconstructingdepth information in 3D display and depth imaging techniques, and described the frequency domain properties of reconstruction mechanisms in integral imaging.2. Wecarried outapplication ofauto-stereo display technique in the popularization of scientific knowledge, enterprise-university-researchercooperative research on its practical technology andimage generation method. At the same time, we analyzedfeasible plans and applicability of small-size and large-size auto-stereo display device based on HVS, studied on the image generation method fitting stereoscopic mechanism and requirements of the device, and use it to play and implement popularization of scientific knowledge. In light of the conflict in stereoscopic mechanism, we generalized varied factors that cause visual fatigue, then elaboratedvisual fatigues caused by the crosstalk of image source anddisplay device respectively. We analyzed the data the from theexperimentand found edge blur results from moire fringes on the surface of the large-size cylindrical-lensauto-stereo display device, and crosstalk in different areas of the screen when the displayer is deformed due to dead weight, heating and ageing. We also made technical schemes to deal with deformation-caused crosstalk and visual fatigue.In details, we utilized a calibration experiment to acquire the crosstalk rate of different areas of the screen, take it as the weighting for re-encoding the image.3. We studiedon the principle, technology and feasible scheme of integrated imaging indepth information extraction of optical tweezers, elaborated technological principle and depth reconstruction method of light-fieldmicroscopy, analyzed limitations of light-fieldmicroscopy, scanning confocal microscopy and super-resolutionfluorescence microscopy during application in optical tweezers. Thus we proposed the technical solution of integrated imaging microscopy and analyzedthe relationship between its system parameters and performance. We expounded principle of the stereo matchingalgorithm, and put forward the calibration method corresponding to algorithm depth and actual depth based on optimization of unit interpolation, window adaptation and frequency domain property. Finally we established the microscopic depth imaging device based on integrated imaging, obtained the unit arraycontaining depth informationunder the condition ofoptical tweezersapplication, adopted optimized integrated imaging stereo matching algorithmfor image data analysis, and set up the depth map of field of view in the experiment of optical tweezers application.4. We studied on the accurate reproduction of colors in 6P colorslaser 3D display. From the perspective ofcolor vision of human eyes, we elaborated the technological scheme to realize 6P colorslaser 3D display, and analyzed its limitations on colorreproduction. We put forward the optimized choice for 6P colorslaser source wavelength and optimization for wavelength response function of the dual-camera system. Moreover, we raised the color gamut extension method in two groups based on existing image sources in terms of characteristics of 6P colorslaser 3D display, and analyzed the color difference between extended color and true color after the extension.Highlights of the paper are as follows:1. This paper has constructed the correspondence between HVS, light field theory and3D display and depth imaging, applied auto-stereodisplay technique into multiple popularizations of scientific knowledge, and carried out an enterprise-university-researchercooperative research. We put forward a suppression scheme based on image re-encoding for visual fatigues which result from deformation-caused crosstalk.2. According toapplication of extraction of depth information in optical tweezers, this paper has raised a technological scheme of integrated imagingmicroscopy, optimized corresponding stereo matching algorithm, generated unit array containing depth information for fine samples related to optical tweezers by utilizing independently-constructed microscopic depth imaging device based on integrated imaging, and set up the depth map of field of view through extracting depth from the array by algorithm.3. This paper has proposed a feasible color management scheme of six-primary-colorlaser three-dimensional display, optimized the response function of light source wavelength and dual-camera system in six-primary-colorlaser three-dimensional display, raised a color gamut extension method based on existing image sources and applicable to six-primary-colorlaser three-dimensional display, applied the method into color management, and lastly conducted a research on color difference property of its color reproduction.