This Small Business Innovation Research Phase I project will address the need for innovative algorithms that convert acoustic time-domain data into a compressed data stream that is transmitted via satellite communications (SATCOM) and reassembled with low latency upon its receipt. The Navy requires 100% preservation of the acoustic data to be transmitted in real-time for processing at shore facilities. drivewarps novel approach involves genetic and machine learning algorithms combined with a proprietary reference data block library that disassembles and reassembles data in real-time. Dynamic data replication (DDRep) technology replaces the original data with assembly instructions (metadata) and reference data blocks stored on both the sending and receiving device. The metadata can be transmitted and then stored until needed, and the audio files reassembled at that time. drivewarps state-of-the-art technology significantly reduces bandwidth and storage requirements and allows reference data sets to be stored separately from the metadata, enabling a high degree of security. DDRep can be used on any networked device for real-time data reduction and transmission and would decrease the Navys deployment costs by enabling the use of an inexpensive unmanned vessel to collect acoustic data, saving $50k-100k per day for the DoN.
Benefit: The expansion of data and the need to transfer data at higher rates is a widespread need. According to IDC data, approximately 3.5 billion devices with internet connections and high data rates will be shipped in 2021, and at present approximately 500,000 data centers are in operation globally. Much effort and capital are being devoted to increasing bandwidth as well as to devising new techniques for compression and deduplication (a technique to remove duplicate data objects and replace them with links to a single copy of an object) techniques. While progress is being made with respect to increasing bandwidth, compression and deduplication are widely believed to be approaching their practical limits. Simultaneously, the growth of data and the need for higher data transfer rates as well as for more storage capacity continues to expand rapidly. The Navys SURTASS related requirement is not unique; data centers need to save and transfer large volumes of data and often resort to trucking hard drives to a backup center, radio telescopes generate very high volumes of data that are a difficult challenge, and every day the need continues to grow. DDRep has wide applicability for both the Navy and a fully functional commercial version of the software.
Keywords: Compression, Compression, data block library, metadata, string matching, lossless compression, hashing algorithm, Acoustic Data
