Phase II year
2019
(last award dollars: 1689186775)
AvaWatz GALEN AR uses Augmented Reality (AR) technology to solve a persistent problem for air traffic controllers: it enables the controller to look at the sky, runways, and taxiways, and see the location and identification of aircraft under his/her control, even when the actual aircraft is obscured by darkness, clouds, or obstruction. Constant visibility improves the controller's situational awareness, leading to more efficient Air Traffic Control (ATC) operations and greater safety. It uses Head-Mounted Display (HMD) hardware built for AR to insert visual aircraft markers and labels into the controller's natural field of vision. It takes in sensor data from aircraft transponders, approach radar and the HMD's camera it then employs Artificial Intelligence Machine Learning (AI/ML) to fuse the data and perform special Computer Vision tasks. The resulting augmented data and map of the visible world is inserted as visual marker and identifying text at the correct location of the aircraft in the HMD based on the view field of the controller's position and orientation. Its architecture includes a novel Edge AR Cloud that reduces the system's dependence on high-bandwidth network access and distinctive sensor data AR rendering.