{'fraction_non_alphanumeric': 0.020743301642178046, 'fraction_numerical': 0.0, 'mean_word_length': 5.327868852459017, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A new reinforcement learning vehicle control architecture for vision-based road following

A new dynamic control architecture based on reinforcement learning (RL) has been developed and applied to the problem of high-speed road following of high-curvature roads. Through RL, the control system indirectly learns the vehicle-road interaction dynamics, knowledge which is essential to stay on the road in high-speed road tracking. First, computer simulation has been carried out in order to test stability and performance of the proposed RL controller before actual use. The proposed controller exhibited a good road tracking performance, especially on high-curvature roads. Then, the actual autonomous driving experiments successfully verified the control performance on campus roads in which there were shadows from the trees, noisy and/or broken lane markings, different road curvatures, and also different times of the day reflecting a range of lighting conditions. The proposed three-stage image processing algorithm and the use of all six strips of edges have been capable of handling most of the uncertainties arising from the nonideal road conditions.