Exploring Higher Dimensional Photography Using Programmable Cameras

Consumer-grade cameras can be programmed by technical users with an interest in photography, but currently the potential is still being investigated. We explore some of the capabilities available using programmable cameras through the example of capturing what we term a four-dimensional (4D) volume of image data. Having access to a 4D volume of image data allows for the creation of photographs that are visually interesting, but also technically challenging to work with. We deal with the inherent complexity by building tools using computer vision and image processing techniques both at the computer desktop software level as well as inside the camera itself. Our intention is to assist artists and photographers to manage this inherent complexity. The assistance we provide is evaluated by some artists and photographers through a user study. Now that programmable cameras have become available, our work shows how embedding image processing inside a consumer camera along with other computer vision tools can facilitate photographers' creative possibilities.