{'fraction_non_alphanumeric': 0.009633911368015413, 'fraction_numerical': 0.0, 'mean_word_length': 5.666666666666667, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Distributed Data Stream Processing with Onix

Onix is a distributed data stream processing platform developed at Cyber Agent with the emphasis on scalability, robust failure handling and simplicity to roll out new systems over the platform without distributed systems expertise -- by data flow schema registration and implementation of application logic according to simple programming model. This poster overviews how distributed data processing is implemented in Onix and presents some scalability evaluation results.