SBIR-STTR Award

Virtual reality (VR) technology can revolutionize military aircrew and pilot training by accurately simulating task performance in a high-fidelity and multisensory virtual environment at significantly lower cost than traditional simulators. User interaction must be intuitive and natural, however, so aviators can train as they fight, while avoiding frustration. Groups within the Air Force are developing VR solutions to fit within their training curricula but are encountering challenges implementing natural interaction with virtual aircraft controls.In the proposed Phase I, collaboration with leaders in Air Force VR aircraft training development will be leveraged to determine standardized human-machine interface (HMI) capability requirements, integration approach(es), and interface design(s) that can be utilized by the Air Force at large. The objective is to create an API capable of integrating HMI technology independently of training development tool set across Air Force programs. A standardized API will enable rapid integration of emerging HMI technology and address the problem of costly duplication of effort across groups within the Air Force, allowing the success of one Air Force project to be rapidly adopted and integrated into others. Implementation of the Air Force-wide API would occur in a notional Phase II.virtual reality,mixed reality,hand tracking,Human-Machine Interface,API design,Aircrew Training

Vertex Solutions (Vertex) understands that virtual and mixed reality (VR and MR) technologies can revolutionize military aircrew and pilot training by accurately simulating task performance in a high-fidelity, multisensory virtual environment at significantly lower cost than traditional physical simulators. To realize VR's training potential, however, great care must be taken in system design and implementation. Both the interface and user interaction must be intuitive and natural so aviators can "train as they fight," while avoiding frustration. Various groups within the Air Force are developing VR solutions to fit within their overall training curricula but are encountering similar challenges in implementing natural human interaction with virtual aircraft controls. In Phase II, Vertex proposes to substantially advance the capabilities of the human-machine interface software development kit VertexMultiSensor to address specific Air Force training technology capability requirements to maximize virtual training immersion and fidelity. The resulting technology will be integrated with training solutions on site at AETC/PTN and Hurlburt AFB and enhance the user experience within deployed immersive training devices (ITDs) to provide meaningful cockpit interaction in a way that improves switchology transfer from ITD to aircraft and improves the effectiveness of virtual mission qualification training.