{'fraction_non_alphanumeric': 0.015625, 'fraction_numerical': 0.0009765625, 'mean_word_length': 5.174698795180723, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Fast VQ Codebook Generation Method Using Codeword Stability Check and Finite State Concept

The codebook design in the vector quantization scheme is important because it affects the image quality of the encoded image. The Linde-Buzo-Gray (LBG) codebook generation algorithm is well known and a popular choice among codebook users. However, a heavy computational complexity is consumed for the iteratively clustering process in the LBG algorithm. In this paper, the similarity of codewords in consecutive rounds of the LBG algorithm is exploited to reduce the computational complexity. By checking the stability of codewords, the status of each codeword in the codebook can be determined. Only the unstable codewords are refined to generate the new codebook. The proposed method can be further improved by cooperating with the finite state technique. Experimental results show that the computational complexity of the proposed method is reduced to about 4% of the LBG algorithm while achieving a slightly worse image quality.