Augmented Reality and UWB Technology Fusion: Localization of Objects with Head Mounted Displays

Francisco Molina Martel, Juri Sidorenko, Christoph Bodensteiner, and Michael Arens

Abstract: Technical advances in computer vision, visual inertial odometry and display technology in the past years have produced a considerable improvement in Augmented Reality (AR). However, none of the contemporary commercial Head-Mounted Displays (HMDs) locates objects that are not in direct line-of-sight with a camera. Our objective is the localization of unseen objects and their visualization through an AR HMD. We extend the functionality of an AR HMD by integrating an ultra-wideband (UWB) transceiver on a Microsoft HoloLens. The UWB transceiver estimates the distance to another UWB transceiver via time of arrival. For UWB ranging, two different protocols have been proposed by the IEEE 802.15.4a-2007 standard: Two-Way Ranging (TWR) and Symmetric Double-Sided Two-Way Ranging (SDS-TWR). In this work we consider three different TWR implementations and the standard SDS-TWR method. Two of the three implemented TWR methods use a DecaWave DW1000 IC utility for estimating the clock frequency offset. Our method processes this data with a digital low-pass filter in order to remove the fluctuations induced by the frequency offset estimation error. We localize a static UWB transponder with trilateration, given the measured distance and the calculated positions of the integrated UWB antenna in the HoloLens coordinate frame. We measure and compare the accuracy and precision achieved with three different implemented TWR ranging methods and SDS-TWR. The precision achieved with our TWR method even surpasses SDS-TWR in our measurements. We localize and visualize the estimated position of the UWB transceiver in the HMD with an accuracy of 6 cm for position dilution of precision (PDOP) values smaller than 10.
Published in: Proceedings of the 31st International Technical Meeting of the Satellite Division of The Institute of Navigation (ION GNSS+ 2018)
September 24 - 28, 2018
Hyatt Regency Miami
Miami, Florida
Pages: 685 - 692
Cite this article: Martel, Francisco Molina, Sidorenko, Juri, Bodensteiner, Christoph, Arens, Michael, "Augmented Reality and UWB Technology Fusion: Localization of Objects with Head Mounted Displays," Proceedings of the 31st International Technical Meeting of the Satellite Division of The Institute of Navigation (ION GNSS+ 2018), Miami, Florida, September 2018, pp. 685-692. https://doi.org/10.33012/2018.16046
Full Paper: ION Members/Non-Members: 1 Download Credit
Sign In