{'fraction_non_alphanumeric': 0.026046511627906978, 'fraction_numerical': 0.0009302325581395349, 'mean_word_length': 5.181034482758621, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Harnessing the Enactive Knowledge of Musicians to Allow the Real-Time Performance of Correlated Music and Computer Graphics

Artists and scientists have a perpetual interest in the relationship between music and art. As technology has progressed, so too have the tools that allow the practical exploration of this relationship. Today, artists in many disparate fields occupy themselves with producing animated visual art that is correlated with music (called ‘visual music’). Despite this interest and advancing technology, there still is no tool that will allow one to perform visual music in real-time with a significant level of control. Here we propose a system that would enable a group or individual to perform live ‘visual music’ using the musical instrument(s) itself as the primary source of control information for the graphics. The hypothesis driving this choice of interface is that, by connecting musical control data (i.e. scales, notes, chords, tempo, force, sound timbre and volume) to graphical control information (a process called mapping [6]), a performer will be able to more readily transfer his/her enactive knowledge [1] of the instrument to creating visual music. The term enactive knowledge refers to knowledge that can only be acquired and manifested through action. Examples of human activities that heavily rely on enactive knowledge include dance, painting, sports, and performing music. If our hypothesis is correct, this will enable a mode of musical/visual performance different from current practice, which is likely to enhance the experience of both the performer(s) and audiences. The outcome of this process will not simply be music visualization, with the graphics being subordinate. Rather, we believe that images controlled directly by the same physical action that generates music will feedback to shape what is actually played musically by the performer. Furthermore, many people will be able to collaboratively perform a complex musical and visual experience live – in a manner that live musicians are already used to, because each performer will be influenced by the performance of the others in the group.