{'fraction_non_alphanumeric': 0.012213740458015267, 'fraction_numerical': 0.0, 'mean_word_length': 5.626262626262626, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Understanding Web Data Sources for Search and Exploration

As information sources become increasingly available on the Internet, searching and extracting information from them is getting more important. We present a data model and a general service framework for supporting search and exploration of heterogeneous data sources. In our approach, concepts and abstractions find suitable and efficient implementations. In this paper, we especially focus on the support of dynamicity and flexibility offered by our framework, from the definition of data sources to the interaction options offered to users when expressing queries and interacting with results.