{'fraction_non_alphanumeric': 0.014095536413469069, 'fraction_numerical': 0.0, 'mean_word_length': 5.422110552763819, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Measurement-Augmented Spectrum Databases for White Space Spectrum

Spectrum databases used to estimate TV white space availability often provide inaccurate and largely conservative estimates as they are primarily based on empirical propagation models. This leads to 'loss' of white space spectrum that is critical in urban areas with large spectrum demand. While alternatives are possible in terms of incorporating direct spectrum measurements, the measurement locations must be judiciously chosen so that measurement effort is not prohibitive. Fundamentally, this boils down to addressing the estimation accuracy vs measurement effort question. We present a rigorous data driven analysis to address this using measurement data collected in parts of New York City metro area. We show that it is possible to develop models that estimate whether the current database estimates are reliable in a given location. Following this, we provide a recipe for developing a `measurement-augmented' spectrum database that takes the help of measurements where needed and falls back on the current propagation model-based database technique in the rest of the areas. The final takeaway is that it is possible to improve database accuracy significantly with only modest amount of measurements.