{'fraction_non_alphanumeric': 0.019455252918287938, 'fraction_numerical': 0.010700389105058366, 'mean_word_length': 5.236363636363636, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Aligning Brain Activity and Sketch in Multi-Modal CAD Interface

This paper investigates the proper synchronization of sketch data and cognitive states in a multi-modal CAD interface. In a series of experiments, 5 subjects were instructed to watch and then explain 6 mechanical mechanisms by sketching them on a touch based screen. Simultaneously, subject’s brain waves were recorded in terms of electroencephalogram (EEG) signals from 9 locations on the scalp. EEG signals were analyzed and translated into mental workload and cognitive state. A dynamic time window was then constructed to align these features with sketch features such that the combination of two modalities maximizes the classification of gesture from non-gesture strokes. Quadratic Discriminant Analysis (QDA) was used as classification method. Our experimental results show that the best temporal alignment for workload and sketch analysis starts from 30% time lag with previous stroke and ends before 30% time lag with next stroke.Copyright © 2014 by ASME