{'fraction_non_alphanumeric': 0.018214285714285714, 'fraction_numerical': 0.00035714285714285714, 'mean_word_length': 5.07592190889371, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A Study on the Internet Capacity Dimensioning Based on Traffic Measurement and its Statistical Analysis

Network dimensioning is becoming important in order to provide a stable Quality of Service (QoS) to the customers. However, it is not an easy task because the Internet traffic changes dynamically and frequently. We thus need a new approach for network dimensioning suitable to the Internet. Probably, it would be quite different from the existing well-established method for the telephone network. Actually, our method proposed in this thesis tries to establish a new paradigm of network dimensioning for the new communication era of the Internet. In this thesis, we first consider a new estimation method of the end-to-end traffic characteristics in the Internet, which is necessary to determine the capacity of the current link. We improve an existing measurement tool called pathchar, which measures the capacity of all links between end hosts. The measurement method of pathchar is innovative, but it still has many problems. If unexpectedly large errors are included or if route alternation is present during the measurement, the obtained estimation is much far from the actual one. We then propose a new method to eliminate those errors in estimating the bandwidth. To increase the reliability on the estimation, the confidence interval for the estimated bandwidth is important. For this purpose, two approaches, parametric and nonparametric approaches, are investigated in order to add the confidence intervals. Another important issue is the method for controlling the measurement period. If the link is stable, small measurement data is sufficient, while if the data is not sufficient, many measurements is necessary to obtain an accurate and reliable estimation. We propose a measurement method to adaptively control the number of measurement data sets. By our approach, a reliable bandwidth estimation can be established. 1 We next move to the network dimensioning approach in order to resolve the bottleneck for stable and QoSrich data communications in the Internet. For that purpose, a possible cause of the bottleneck must be examined not only within the network, but also at the end hosts, which originated in an intrinsic nature of the Internet architecture. In our study, we first propose a method to identify the bottleneck for improving the performance of the end users. Once the network is found to be bottleneck, the network operator should determine how much the network resources is increased to meet the end user’s QoS requirements. We collected the measurement results from the actual operating Internet, and provide an evidence to support an appropriateness of our approach. Based on the measurements, we finally present the methodology to determine the link capacity.