Development of Vision-aided Navigation for a Wearable Outdoor Augmented Reality System

A. Menozzi, B. Clipp, E. Wenger, J. Heinly, E. Dunn, H. Towles, J-M. Frahm, G. Welch

Abstract: This paper describes the development of vision-aided navigation (i.e., pose estimation) for a wearable augmented reality system operating in natural outdoor environments. This system combines a novel pose estimation capability, a helmet-mounted see-through display, and a wearable processing unit to accurately overlay geo-registered graphics on the user’s view of reality. Accurate pose estimation is achieved through integration of inertial, magnetic, GPS, terrain elevation data, and computer-vision inputs. Specifically, a helmet-mounted forward-looking camera and custom computer vision algorithms are used to provide measurements of absolute orientation (i.e., orientation of the helmet with respect to the Earth). These orientation measurements, which leverage mountainous terrain horizon geometry and/or known land marks, enable the system to achieve significant improvements in accuracy compared to GPS/INS solutions of similar size, weight, and power, and to operate robustly in the presence of magnetic disturbances. Recent field testing activities, across a variety of environments where these vision-based signals of opportunity are available, indicate that high accuracy (less than 10 mrad) in graphics geo-registration can be achieved. This paper presents the pose estimation process, the methods behind the generation of vision-based measurements, and representative experimental results.
Published in: Proceedings of IEEE/ION PLANS 2014
May 5 - 8, 2014
Hyatt Regency Hotel
Monterey, CA
Pages: 760 - 772
Cite this article: Menozzi, A., Clipp, B., Wenger, E., Heinly, J., Dunn, E., Towles, H., Frahm, J-M., Welch, G., "Development of Vision-aided Navigation for a Wearable Outdoor Augmented Reality System," Proceedings of IEEE/ION PLANS 2014, Monterey, CA, May 2014, pp. 760-772.
Full Paper: ION Members/Non-Members: 1 Download Credit
Sign In