{'fraction_non_alphanumeric': 0.030845157310302282, 'fraction_numerical': 0.0024676125848241827, 'mean_word_length': 5.815126050420168, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Synthsonic: Fast, Probabilistic modeling and Synthesis of Tabular Data

The creation of realistic, synthetic datasets has several purposes with growing demand in recent times, e.g. privacy protection and other cases where real data cannot be easily shared. A multitude of primarily neural networks (NNs), e.g. Generative Adversarial Networks (GANs) and Variational Autoen-coders (VAEs), or Bayesian Network (BN) approaches have been created to tackle this problem, however these require extensive com-pute resources, lack interpretability, and in some instances lack replication ﬁdelity as well. We propose a hybrid, probabilistic approach for synthesizing pairwise independent tabular data, called Synthsonic. A sequence of well-understood, invertible statistical transformations removes ﬁrst-order correlations, then a Bayesian Network jointly models continuous and categorical variables, and a calibrated discriminative learner captures the remaining dependencies. Replication studies on MIT’s SDGym benchmark show marginally or signiﬁcantly better performance than all prior BN-based approaches, while being competitive with NN-based approaches (ﬁrst place in 10 out of 13 benchmark datasets). The computational time required to learn the data distribution is at least one order of magnitude lower than the NN methods. Furthermore, in-specting intermediate results during the synthetic data generation allows easy diagnostics and tailored corrections. We believe the combination of out-of-the-box performance, speed and interpretability make this method a signiﬁcant addition to the synthetic data generation toolbox.