{'fraction_non_alphanumeric': 0.012444444444444444, 'fraction_numerical': 0.0, 'mean_word_length': 5.508670520231214, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Identifying and visualizing nonlinear variation patterns in multivariate manufacturing data

In modern manufacturing processes, it is not uncommon to have hundreds, or even thousands, of different process variables that are measured and recorded in databases. The large quantities of multivariate measurement data usually contain valuable information on the major sources of variation that contribute to the final product or process variability. The focus of this work is on variation sources that result in complex, nonlinear variation patterns in the data. We propose a model for representing nonlinear variation patterns and a method for blindly identifying the patterns, based on a sample of measurement data, with no prior knowledge of the nature of the patterns. The identification method is based on principal curve estimation, in conjunction with a data preprocessing step that makes it suitable for high dimensional data. We also discuss an approach for interactively visualizing the nature of the identified variation patterns, to aid in identifying and eliminating the major root causes of manufacturing variation.