{'fraction_non_alphanumeric': 0.009823182711198428, 'fraction_numerical': 0.003929273084479371, 'mean_word_length': 5.290123456790123, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Traffic behavior analysis with Poisson sampling on high-speed network

With the subsequent increasing of backbone bandwidth, the full trace capture will be seriously hindered. The research in the paper results from a study analyzing packet traces obtained from a backbone link in CERNET. Millions of packets are passed per minute through the link that make the traffic measurement difficult or even impossible. The Poisson sampling measure proposed by RFC2330 is used in the research to alleviate the measurement hindering while preserving the statistically representative characteristics of the traffic population. Algorithms for the continuous process sampling and the discrete process sampling are proposed in the paper. The relationship between the mean packet length of the Poisson sampling data sets and the test data set is discussed to show the advantage of the algorithms. The network traffic throughput can be estimated according to the mean length of sampling packets, Poisson rate and during sampling time.