{'fraction_non_alphanumeric': 0.03152364273204904, 'fraction_numerical': 0.0008756567425569177, 'mean_word_length': 4.861538461538461, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Rate control using embedded adaptive vector quantization

This paper presents a simple, fast and accurate rate control algorithm using adaptive vector quantization (AVQ). The AVQ perspective embeds learning in a dynamic geometry. More specifically, it estimates the unknown joint probability density function p( x, y). The input-output pair represents a sample from the function f:R/sup n//spl rarr/R/sup p/. The function f maps n-vectors x to p-vectors y. We estimate this function using long training image sequences by varying the quantization parameter (QP) within admissible ranges. We generate the non-linear relationship between rate and sum of absolute difference (SAD) using training vectors. Then we apply the mean operator to the rate for each quantized SAD value to generate three look-up tables storing the rate-distortion function. These tables are used to decide the proper QP values for a given bit budget. Simulation results show the proposed algorithm outperforms the MPEG-4 rate control algorithm in terms of reproduced image quality and coding efficiency while requiring much less complexity. It keeps bit rate accurately.