{'fraction_non_alphanumeric': 0.02849441663457836, 'fraction_numerical': 0.007316134000770119, 'mean_word_length': 5.5606060606060606, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Scientific Data Mining - A Practical Perspective

Technological advances are enabling scientists to collect vast amounts of data in fields such as medicine, remote sensing, astronomy, and high-energy physics. These data arise not only from experiments and observations, but also from computer simulations of complex phenomena. They are often complex, with both spatial and temporal components. As a result, it has become impractical to manually explore, analyze, and understand the data. Scientific Data Mining: A Practical Perspective describes how techniques from the multi-disciplinary field of data mining can be used to address the modern problem of data overload in science and engineering domains. Starting with a survey of analysis problems in different applications, this book identifies the common themes across these domains and uses them to define an end-to-end process of scientific data mining. This multi-step process includes tasks such as processing the raw image or mesh data to identify objects of interest;extracting relevant features describing the objects; detecting patterns among the objects; and displaying the patterns for validation by the scientists. A majority of the book describes how techniques from disciplines such as image and video processing, statistics, machine learning, pattern recognition, and mathematical optimization can be used for the tasks in each step. It also includes a description of software systems developed for scientific data mining; general guidelines for getting started on the analysis of massive, complex data sets; and an extensive bibliography. Audience: This book is intended for data mining practitioners and scientists interested in applying data mining techniques to their data sets. It is also appropriate for advanced undergraduate and graduate-level courses on data analysis offered in mathematics, computer science, and statistics departments. Contents: Preface; Chapter 1: Introduction; Chapter 2: Data Mining in Science and Engineering; Chapter 3: Common Themes in Mining Scientific Data; Chapter 4: The Scientific Data Mining Process; Chapter 5: Reducing the Size of the Data; Chapter 6: Fusing Different Data Modalities; Chapter 7: Enhancing Image Data; Chapter 8: Finding Objects in the Data; Chapter 9: Extracting Features Describing the Objects; Chapter 10: Reducing the Dimension of the Data; Chapter 11: Finding Patterns in the Data; Chapter 12: Visualizing the Data and Validating the Results; Chapter 13: Scientific Data Mining Systems; Chapter 14: Lessons Learned, Challenges, and Opportunities; Bibliography; Index