{'fraction_non_alphanumeric': 0.012770137524557957, 'fraction_numerical': 0.0, 'mean_word_length': 5.532051282051282, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Intelligent three step sampling design for face recognition

Learning curve phenomenon indicates that not all available images need to be used in training. This paper proposes a three-step intelligent sampling to construct a representative and efficient training database, where both the number of training images and which images to be included are determined. Firstly, clustering on a subset of huge face database is implemented as preparation. Secondly, systematic sampling on clusters is utilized to improve the efficiency. Thirdly, performance is evaluated to check whether the learning curve has reached a point of diminishing returns, and a new metric of difficulty is defined to determine which images from the complementary subset of initial training set should be added into training. The proposed intelligent three step sampling design enhances recognition rate and generalizability while improving efficiency, which exerts the full potential of any given face recognition algorithm without system overhaul.