{'fraction_non_alphanumeric': 0.016375545851528384, 'fraction_numerical': 0.010917030567685589, 'mean_word_length': 5.113333333333333, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A Study on the Importance of Data Balance for Digital Transformation: Based on the result of data balance analysis for AI learning

This study shows the need of data balance by analysis the balance of data collected by the government. 
As a result of analysis of vehicle recognition data, only 231(3.08%) were significant data, even though 7,500 pieces of diversity were required, and the rest were all listed in the overlapping data. This means that biased artificial intelligence is highly likely to be created. 
The introduction of artificial intelligence technology is too important and fundamental a change, it cannot be achieved only by the technical efforts of individual companies in quality. Only when the government or public institutions provide necessary standards and provide minimum infrastructure can the competitiveness of companies as well as social stability related to new technologies be secured.