{'fraction_non_alphanumeric': 0.03211009174311927, 'fraction_numerical': 0.019003931847968544, 'mean_word_length': 4.96484375, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Delivery methods for LVSD systems

In this paper we present formats and delivery methods of Large Volume Streaming Data (LVSD) systems. LVSD systems collect TBs of data per mission with aggregate camera sizes in the 100 Mpixel to several Gpixel range at temporal rates of 2 - 60 Hz. We present options and recommendations for the different stages of LVSD data collection and delivery, to include the raw (multi-camera) data, delivery of processed (stabilized mosaic) data, and delivery of user-defined region of interest windows. Many LVSD systems use JPEG 2000 for the compression of raw and processed data. We explore the use of the JPEG 2000 Interactive Protocol (JPIP) for interactive client/server delivery to thick-clients (desktops and laptops) and MPEG-2 and H.264 to handheld thin-clients (tablets, cell phones). We also explore the use of 3D JPEG 2000 compression, defined in ISO 15444-2, for storage and delivery as well. The delivery of raw, processed, and region of interest data requires different metadata delivery techniques and metadata content. Beyond the format and delivery of data and metadata we discuss the requirements for a client/server protocol that provides data discovery and retrieval. Finally, we look into the future as LVSD systems perform automated processing to produce "information" from the original data. This information may include tracks of moving targets, changes of the background, snap shots of targets, fusion of multiple sensors, and information about "events" that have happened.