{'fraction_non_alphanumeric': 0.025050100200400802, 'fraction_numerical': 0.01603206412825651, 'mean_word_length': 5.487012987012987, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Reinforcement Learning for Compensating Power Excursions in Amplified WDM Systems

Wavelength-dependent power excursions in gain-controlled erbium doped fiber amplifiers (EDFA) is a challenging issue in optical networks. We investigate a launch channel power control method using reinforcement learning (RL) to mitigate the power excursions of EDFA systems. A machine learning engine is developed, trained and evaluated with four different policy-gradient RL algorithms that are compared according to two main criteria: achieved power excursion reduction and learning time. Different scenarios are considered with 12-, 24-, 40- active channels at fixed wavelengths and with variable number of active channels (between 12 and 64) assigned randomly at different wavelengths during RL process. We show 62% power excursion reduction in the 40-channel scenario and 28% in the variable scenario, which demonstrates the promising role of online RL approach for controlling power excursion in EDFA systems.