{'fraction_non_alphanumeric': 0.019507186858316223, 'fraction_numerical': 0.0, 'mean_word_length': 5.63265306122449, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Network traffic estimation using Markov chain and Incremental Gaussian Mixture

This paper presents a traffic flow estimation method for communication networks using higher order Markov chain and Incremental Gaussian Mixture Model (IGMM). Given the previous and current values of network traffic flow, the optimal prediction under the minimum mean square error criteria is given as the conditional expectation according to the transition probability of Markov chain. Since the transition probability is not known beforehand, IGMM, whose mixtures are updated on-line as traffic flow values become known, is used to instantaneously change the probability density function of mixtures. IGMM with an on-line learning mechanism has lower computational complexity and requires lower memory compared to Gaussian Mixture Model (GMM) which uses batch processing. Numerical experiments using publicly available “Abilene” data-set show that IGMM outperforms GMM, and it is more robust.