{'fraction_non_alphanumeric': 0.010011123470522803, 'fraction_numerical': 0.0, 'mean_word_length': 5.521739130434782, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
An Optimal Data Representation to Store and Retrieve Data using Encoding

Smart and innovative trends towards digital India lead to data explosion, while many cloud and network applications require smart data management. Storing big data generated in volumes by smart devices and social networks is a challenge, though enhanced storage facilities and storage devices keep coming as each facility requires some overheads or other in maintaining, retrieving and transmitting data. Next generation computing involves vast data handling requirements for which effective storage representations is needed. In this paper an optimal data representation technique based on probability based encoding is proposed, which can be used for efficient storage and communication of large data. The technique has been tested on various data types and the effectiveness on storage and time are analyzed and presented.