{'fraction_non_alphanumeric': 0.02135561745589601, 'fraction_numerical': 0.0, 'mean_word_length': 5.455089820359281, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A systematic framework for dynamically optimizing delay-sensitive wireless transmission

Delay sensitive applications need to overcome the service problems in dynamic environments with respect to both the multimedia source data (e.g., variable bit-rate) and the wireless channels (e.g., fading channel). This paper considers the problem of point to point transmission of scalable video coding over a fading channel. We formulate the rate adaptation challenge of WLAN multimedia networks as a Markov Decision Process and resolve this problem online based on reinforcement learning. The buffer state, channel state, and video state were considered as a joint state of system to maximize the average Quality of Service under delay constraints. To improve the convergence speed of learning, system's underlying dynamics were partitioned into a priori known and a priori unknown components. The proposed learning algorithm exploits known information about the system, so that less information needs to be learned compared with that in conventional reinforcement learning algorithms.