Robust Absolute Headset Tracking for Extended Reality

Robert M. Tenny, Lisong C. Sun, Alperen Duru, Todd E. Humphreys

Abstract: Abstract—This paper presents a novel headset tracking framework designed for extended reality (XR) applications. The growth of XR demands accurate and robust tracking mechanisms that are suitable for both indoor and outdoor environments and offer anchoring to a global reference frame. By loosely coupling a visual simultaneous localization and mapping (SLAM) algorithm to a tightly-coupled carrier phase differential GNSS (CDGNSS) and inertial sensor subsystem, the proposed system aims to achieve centimeter-accurate, globally-referenced tracking that persists during extended periods of GNSS degradation. Collaborative and persistent XR experiences are enabled through accurate map creation utilizing a bundle adjustment approach for map generation and maintenance. Cloud or near-edge offloading of computationally demanding steps in the pipeline is explored to reduce the computational demand on the headset. Robust tracking performance is evaluated in terms of odometric drift under GNSS outages. This paper also explores the benefit of additional headset tracking constraints offered by direction-of-arrival measurements to nearby cellular base stations. Such measurements will become available as future wireless standards make increasing use of mmWave frequencies. Index Terms—CDGNSS, SLAM, extended reality
Published in: 2023 IEEE/ION Position, Location and Navigation Symposium (PLANS)
April 24 - 27, 2023
Hyatt Regency Hotel
Monterey, CA
Pages: 1350 - 1362
Cite this article: Tenny, Robert M., Sun, Lisong C., Duru, Alperen, Humphreys, Todd E., "Robust Absolute Headset Tracking for Extended Reality," 2023 IEEE/ION Position, Location and Navigation Symposium (PLANS), Monterey, CA, April 2023, pp. 1350-1362. https://doi.org/10.1109/PLANS53410.2023.10140004
Full Paper: ION Members/Non-Members: 1 Download Credit
Sign In