{'fraction_non_alphanumeric': 0.01981833195706028, 'fraction_numerical': 0.0016515276630883566, 'mean_word_length': 4.912195121951219, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Signals Intelligence-Processing-Analysis-Classification Ulla Uebler

In the world of SIGINT / COMINT more data are incoming from a large variety of sources – for example mobile and satellite communication. Automatic systems become necessary to process the amounts of data. In this paper we focus two main aspects: (1) the treatment and processing of data coming from different sources in the same standard manner, i.e. all inputs formats will be treated in the same way, leading to a standardized data model; and (2) introduce automatic processing wherever possible – applying either manual or automatic algorithms where they are best suited. The way of applying these two procedures is firstly realised in our SIPAC system to be described later on in more detail. We have developed this system in years of applied research; the technical algorithms for automatic processing are mainly developed at MEDAV – although the system is flexible enough to integrate specialized algorithms from other parties. It is a key item of this paper to show the effort spent while researching the optimal performance of such a system still leaving the flexibility to humans to modify the parameters according to a specific task.