different modes, while using different combinations of subsystems. This presents a challenge for the personnel validating the system during design and development; the number of combinations of environments, modes, and subsystems is exponential. They cannot all be tested, so an optimal subset of tests must be run. We propose to develop VERITAS: Validation and Evaluation of Remote, Interactive Teams of Autonomous Systems, a tool that will optimize the specification of tests for complex UV systems and supports analysis of performance. VERITAS will enable system developers, testers, and operators to define the attributes and capabilities of a system, its operating modes, and mission environments. The VERITAS tool will analyze system performance to (1) identify the factors that are responsible for mission performance and outcomes, and (2) define the performance envelope (capabilities and limitations) of the system. VERITAS will accomplish this by (1) optimizing the form and sequence of test cases to define the performance envelope most rapidly and effectively, and by (2) providing an advanced user interface that simplifies configuration of the test environment, monitoring of test progress, and comprehension of test results.
Keywords: Adjustable Autonomy, Unmanned Vehicles, Autonomous Operations, Test And Evaluation
