SBIR-STTR Award

Gaussian-Pareto Overbounding for Verification and Validation of Safety-Critical eVTOL and UAM Operations
Award last edited on: 9/11/2021

Sponsored Program
STTR
Awarding Agency
DOD : AF
Total Award Amount
$899,598
Award Phase
2
Solicitation Topic Code
AFX20D-TCSO1
Principal Investigator
Suneel Ismail Sheikh

Company Information

ASTER Labs Inc

155 East Owasso Lane
Shoreview, MN 55126
   (651) 484-2084
   info@asterlabs.com
   www.asterlabs.com

Research Institution

University of Alabama - Tuscaloosa

Phase I

Contract Number: FA8649-21-P-0115
Start Date: 12/16/2020    Completed: 6/16/2021
Phase I year
2021
Phase I Amount
$149,819
A Gaussian-Pareto Overbounding (GPO) software toolset will be developed for the verification and validation (V&V) of safety-critical Unmanned Aerial Systems (UAS) sensors, including Guidance, Navigation and Control (GNC) and Collision Avoidance Systems (CAS) sensors using time- and data-efficient overbounding solutions. V&V remains a critical attribute of safe operation within active airspace for current aircraft and future autonomous eVTOL vehicles, particularly those designed for operation in dense environments, including Urban Air Mobility (UAM) or combat regions. Overbounds are used to determine the probability of system failure. However, traditional Gaussian Overbounding methods require large datasets of measurements, which leads to long required lead times to process and analyze data for integrity risk assessment, resulting in overly-conservative error bounds. In this program, a novel approach for overbounding unknown distribution functions called Gaussian-Pareto Overbounding (GPO) will be utilized to significantly reduce the amount of data and time needed to ensure the resilience and reliability of the vehicle systems, while providing accurate and minimally conservative error bounds. This method produces overbounds by hybridizing Gaussian distributions with Generalized Pareto Distributions using Extreme Value Theory, providing a procedure for determining error probabilities for multivariate systems which may display biases, auto-correlation, and heavy-tails. The hybridized GPO algorithms will increase data modeling accuracy and statistical efficiency for these systems. A key objective of the proposed work will be to design and develop a GPO V&V software toolset that includes functions and algorithms to generate GPO models, overbound conservatism, and analyze data efficiency. The program will also perform general risk assessment, using developed and available data analysis tools, including clustering and data dependency tests. The comprehensive software toolset will include data efficient methods to map overbounds through linearized systems. Simulations will be performed to demonstrate utility and applicability of GPO algorithms compared to traditional methods. Phase I will focus on applying the GPO algorithms to UAS overbounding, including using existing INS/GNSS navigation and collision-avoidance system data, and incorporating these methods into the prototype GPO V&V software toolset, with extended applications to guidance, control, and power management systems. The proposed work has broad applicability to risk assessment and certification of aerial, sea, ground, and space vehicles, and applies to a variety of systems requiring data-driven methods to ensure safety and reliability. This includes use in surveillance, security, disaster evaluation, humanitarian aid delivery, scientific investigations, package transport, and hobbyist operations.

Phase II

Contract Number: FA8649-22-P-0765
Start Date: 3/11/2022    Completed: 6/12/2023
Phase II year
2022
Phase II Amount
$749,779
A Gaussian-Pareto Overbounding (GPO) software toolset will be developed for the verification and validation (V&V) of safety-critical Unmanned Aerial Systems (UAS). In particular, this includes the V&V of sensors used to operate UAS, including navigation systems, the Air Data System (ADS), the Power Monitoring System (PMS), and Collision Avoidance Systems (CAS). The model-based techniques offered in this toolset provide advanced statistical modeling of UAS sensors using time- and data-efficient overbounding solutions. V&V remains a critical attribute of safe operation within active airspace for current aircraft and future autonomous eVTOL vehicles, particularly those designed for operation in dense environments, including Urban Air Mobility (UAM) and combat regions. Overbounds are used to encompass the probability of rare system events, especially system failures, and have traditionally been determined using Gaussian Overbound (GO) uncertainty models. However, GO requires large error measurement datasets to characterize a system’s sensors, and therefore long lead times to process and analyze data for integrity risk assessment, and results in overly-conservative error bounds that do not model the asymptotic characteristics of the error uncertainty. In this program, the novel GPO approach for overbounding unknown distribution functions will be utilized to significantly reduce the amount of data and time needed to ensure the resilience and reliability of the vehicle sensor systems, while providing accurate, data-efficient, and minimally-conservative error bounds. GPO hybridizes Gaussian distributions with Generalized Pareto Distributions using Extreme Value Theory, providing a procedure for determining error probabilities for sensors that displays biases, auto-correlation, heavy-tails, and multivariate correlation. A key objective of the proposed work will be to produce a GPO V&V software toolset that includes algorithms to generate GPO models, overbound conservatism, and analyze statistical data efficiency for characterizing sensor errors of eVTOL and UAM. The program will perform risk assessment using developed data analysis tools, including clustering and data dependency tests. The comprehensive software toolset will include data efficient methods to map overbounds through common model-based data fusion algorithms. Demonstrations using actual sensor data will show the significant benefits of GPO algorithms compared to traditional methods, with the capability to prevent unpredictable vehicle behavior. Phase II will focus on applying the GPO algorithms to specific UAS-grade sensors, including INS/GNSS navigation, ADS, PMS, and CAS data using the fully developed GPO V&V software toolset. The proposed work has broad applicability to risk assessment and certification of aerial, sea, ground, and space vehicles, and applies to a variety of sensor systems requiring statistical data-driven and model-based methods to ensure safety and reliability.