{'fraction_non_alphanumeric': 0.0170863309352518, 'fraction_numerical': 0.0017985611510791368, 'mean_word_length': 5.913043478260869, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Thermal Infrared and Visible Spectrum Fusion for Multi-modal Video Analysis

While traditional image and video processing focus on extracting knowledge from data of a single modality, such as visual spectrum or thermal infrared video, this report investigates the benefits and challenges of capturing and analysing multimodal video. It specifically targets the two modalities of visible spectrum and thermal infrared video. A novel capture device has been developed to capture and align (both temporally and spatially) video sequences captured in both modalities. Two publications in international conferences, to date, demonstrate the effectiveness of multimodal analysis in its robustness to lighting variations and background camouflage of tracked objects. The challenge of multimodal fusion is to obtain optimal benefits from the joint use of multiple modalities, namely thermal infrared and visible spectrum video in this project. Applications include 24hour automatic surveillance systems, people tracking-and-counting in commercial centres, human-machine interfaces and industrial automation applications.