{'fraction_non_alphanumeric': 0.03275529865125241, 'fraction_numerical': 0.0, 'mean_word_length': 5.221556886227545, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Hardware for Quantized Mixed-Precision Deep Neural Networks

Due to network and privacy issues, there is a push to perform Deep Learning (DL) computations on the edge rather than on the cloud. However, state-of-the-art Deep Neural Networks (DNNs) require vast resources that are limited on edge devices. This limitation has brought the need to design custom hardware to implement DL-specific optimizations. Traditionally DNNs have run on high-precision number formats; however, DNNs are surprisingly robust and do not require this much precision. Instead, using quantization, networks can run on low-bit widths while achieving fair accuracy. This finding suggests that edge devices can run resource-efficient DNNs at the cost of accuracy. In addition, layers within a network do not require the same precision. Therefore, a further optimization suggests using mixed-precision over uniform quantization. A comparison is made between an architecture—designed to support mixed-precision DNNs in hardware—and its single-precision counterpart.