The broader impact/commercial potential of this project is to develop and provide novel computation capabilities to the marketplace that mimic and apply the way our brain computes beyond deep learning systems and much closer to how the brain actually operates. Althoughthe technology is initially targeted for the commercial drone market, the technology can be applied to consumer and hobbyist drone market, self-driving cars and advanced driver assistance systems, autonomous navigation and guiding systems with obstacle avoidance forrobots, ballistics tracking and counter-drone capabilities for military and defense, and surveillance and counter-drone for public safety and security. This project has the potential to revolutionize robotic and machine vision by providing capabilities that simply do not exist today.This Small Business Innovation Research (SBIR) Phase I project investigates novel ways, algorithms and software implementations that leverage expertise in natural vision systems, deep learning and machine learning to make use of electro-optical sensors, whichrespond in new ways to form the basis of an Airborne Based Sense and Avoid (ABSAA) system. It leverages the benefits of bio-inspired computation, and investigates how to combine information from multiple sensors in a common representation. The project will study novel ways to achieve robust detection, segmentation, clustering, discrimination and classification with these novel sensors. It will also extend methods and algorithms for state estimation, tracking and prediction in the inherent sensor representation. The project will also address the real-time constraints and will attempt to leverage recent hardware implementations, which can provide a complete embedded system for ABSAA system that is low SWaP (size, weight and power) and in the long run, low cost as well because it has the potential to benefit from economy of scale. The theoretical and algorithmic advances generated by the project have the potential to affectmachine and robotic vision well beyond the project focused application to ABSAA.
