Extrapolating VR Success to High-Fidelity Mixed Reality for Deployable Point-of-Need Flight Simulation
Modern air forces and joint coalition partners face an urgent requirement to deliver high-fidelity flight simulation at the Point-of-Need (PoN) in forward-deployed environments, directly aligning with the imperative to build training capability at pace ahead of emerging threats. Traditional "box-in-a-room" dome architectures provide necessary visual and haptic fidelity but possess a massive logistical footprint that prevents forward deployment. Conversely, while Virtual Reality (VR) has generated significant empirical data proving its efficacy for procedural training over legacy installations, its inability to seamlessly integrate physical cockpit instruments limits its utility for complex tactical flight operations. This paper addresses the critical transition from VR to high-resolution Video See-Through (VST) Mixed Reality (MR) to solve the haptic integration challenge without compromising deployability. By analyzing established empirical performance metrics from VR flight simulation—such as spatial orientation retention and target acquisition rates—this research establishes a comparative baseline to evaluate the potential of high-fidelity MR architectures incorporating human-eye resolution displays and sub-degree eye-tracking. We detail a technical framework that leverages low-latency VST to allow pilots to interact with physical flight decks while operating inside dense digital synthetic environments. Preliminary evaluation indicates that integrating physical tactile controls with high-resolution digital visual feeds directly mitigates the spatial disorientation and cognitive friction common in pure VR environments. By synthesizing existing VR training data with initial MR performance modeling, the paper demonstrates how high-resolution VST MR bridges the fidelity gap, providing a validated roadmap for joint and allied forces to deploy agile, high-transfer flight training at scale without the infrastructure constraints of legacy dome simulators.