{'fraction_non_alphanumeric': 0.020053475935828877, 'fraction_numerical': 0.0, 'mean_word_length': 5.935185185185185, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A scientific workflow solution to the archiving of digital media

This work explores the challenges of embedding long-term preservation processes into existing video production workflows. The challenges are many: size of video data, bulk and parallel transfer into the archive, automation of the processes, elimination of human steps, automatic triggering of the preservation workflows, replication of content, automatic extraction of metadata, and most important mechanisms to ldquohardenrdquo the automation by providing recovery mechanisms in case of errors and discrepancies. We present production-quality solutions that automate this process and make use of Kepler scientific workflows and Storage Resource Broker (SRB) data grid environments.