{'fraction_non_alphanumeric': 0.01818181818181818, 'fraction_numerical': 0.0025974025974025974, 'mean_word_length': 4.996108949416342, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
The Influence of Video Sampling Rate on Lipreading Performance

That adding visual information improves the recognition of speech is an established fact. However, since the video sampling is done at a much lower rate than speech sampling and the increase in performance, while promising, is still not at the expected level, the question of whether or not is it useful to use high speed recordings makes its appearance. We propose in this paper an analysis of the gain in information from the point of view of lipreading accuracy, based on Root Mean Square Deviation (RMSD) measure. We analyze both real data, recorded using high speed technology, and synthetic data obtained using the well known software tools CUAnimate and CSLU Toolkit. The analysis is performed on two different and highly used types of features the mouth width and height and optical flow. Taking into account the rate of speech our preliminary findings show two different situations. In the case of low speech rate, usually used during spellings or when uttering connected digits (e.g. telephone numbers, account numbers) or uttering separate words, the information gained by using high speed recordings is not significant enough to justify the tremendous amount of resources needed when working with high speed recordings. However, in the case of continuous speech, when the speech rate tends to increase, a recording rate in the range of 24 to 30 frames per second is definitely insufficient. Then interpolation is needed which decreases the recognition performance.