{'fraction_non_alphanumeric': 0.010638297872340425, 'fraction_numerical': 0.0, 'mean_word_length': 5.683060109289618, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Knowledge Extraction and Integration for Information Gathering in Penetration Testing

Assets identification is an important aspect of penetration test on which security practitioner develop their defense mechanism. In addition, assets identification is an essential piece of information for penetration testers to find a weakness in the targeted organization. Information gathering is the process of extracting knowledge to recognize the organizations' assets available on the internet. There are many open source tools available for information gathering. However, penetration tester needs to put manual effort (during several hours to multiple days) to extract useful knowledge from the output of one tool and integrate that knowledge in another tool. Penetration tester can increase speed and accuracy of the overall information gathering process by automating the knowledge extraction and integration. This paper review and identify open source subdomain enumeration and service scanning tools and present an approach to integrate and automate identified tools. The result reveals that there is a significant improvement of the information gathering process by using our approach due to the reduction of manual tasks.