{'fraction_non_alphanumeric': 0.03756906077348066, 'fraction_numerical': 0.0011049723756906078, 'mean_word_length': 4.770700636942675, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A smart audio/video mixing method based on main speaker decision for a software-based multipoint control unit

In this paper, we present a Smart Audio/Video Mixing method (SmartAVM) for a software-based multipoint control unit (SW-based MCU) to provide an immersive video conferencing service. The SmartAVM determines the mixing mode to one of the true mixing, equal mixing, and main speaker decision-based mixing modes, according to the number of clients (i.e., human users) connected to the SW-based MCU. Then, audio/video (A/V) signals from all clients are mixed using the different weighting factors according to the mixing mode. To show the effectiveness of SmartAVM, we implemented an SW-based MCU using OPUS and VP8 as the audio and video coders, respectively. Results show that the SmartAVM correctly determined the proper mixing mode and mixed A/V signals according to the determined mixing mode.