{'fraction_non_alphanumeric': 0.018641810918774968, 'fraction_numerical': 0.005326231691078562, 'mean_word_length': 4.654135338345864, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Smoothing splines for trend estimation and prediction in time series

We consider the use of generalized additive models with correlated errors for analysing trends in time series. The trend is represented as a smoothing spline so that it can be extrapolated. A method is proposed for choosing the smoothing parameter. It is based on the ability to predict a short term into the future. The choice not only addresses the purpose in hand, but also performs very well, and avoids the tendency to under‐smooth or to interpolate the data that can occur with other data‐driven methods used to choose the smoothing parameter. The method is applied to data from a chemical process and to stream salinity measurements. Copyright © 2008 John Wiley & Sons, Ltd.