{'fraction_non_alphanumeric': 0.022583559168925023, 'fraction_numerical': 0.007226738934056007, 'mean_word_length': 5.189944134078212, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Real-time localization and classification for digital microscopy using single-shot convolutional neural networks

We present an adapted single shot neural network architecture (YOLO) for the real-time localization and classification of particles in optical microscopy. Our work is aimed at the manipulation of microscopic objects in real-time by a feedback loop. The network is implemented in Python/Keras using the TensorFlow backend. The trained model is then exported to a GPU supported C library for real-time inference readily integrable in other programming languages such as C++ and LabVIEW. It is capable of localizing and classifying several hundred of microscopic objects even at very low signal-to-noise ratios running for images as large as 416 x 416 pixels with an inference time of about 10 ms.
We demonstrate real-time detection in tracking and manipulating active particles of different types. Symmetric active particles, as well as Janus particles propelled by self-thermophoretic laser-induced processes, are identified and controlled via a Photon-Nudging procedure developed in the group.