{'fraction_non_alphanumeric': 0.01394700139470014, 'fraction_numerical': 0.0, 'mean_word_length': 5.033613445378151, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Data compression for Arabic text

The huge amount of data that are being stored/or communicated between different terminals motivates the need for data compression. The compression of data helps in saving the required storage and transmission bandwidth, Several methods for data compression have been proposed in the literature. A new data compression technique is presented here. Its performance is investigated with respect to both English and Arabic texts. In this paper some of the Arabic text statistics are calculated, then the new technique and the other techniques are applied to different types of Arabic and English texts. A comparison is worked out, and an improvement in the compression ratio is observed.