{'fraction_non_alphanumeric': 0.03195739014647137, 'fraction_numerical': 0.0, 'mean_word_length': 5.2625, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 1, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 1, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
An Iterative Algorithm for Background Removal in Spectroscopy by Wavelet Transforms

Wavelet transforms are an extremely powerful tool when it comes to processing signals that have very “low frequency” components or non-periodic events. Our particular interest here is in the ability of wavelet transforms to remove backgrounds of spectroscopic signals. We will discuss the case of surface-enhanced Raman spectroscopy (SERS) for illustration, but the situation it depicts is widespread throughout a myriad of different types of spectroscopies (IR, NMR, etc.). We outline a purpose-built algorithm that we have developed to perform an iterative wavelet transform. In this algorithm, the effect of the signal peaks above the background is reduced after each iteration until the fit converges close to the real background. Experimental examples of two different SERS applications are given: one involving broad backgrounds (that do not vary much among spectra), and another that involves single molecule SERS (SM-SERS) measurements with narrower (and varying) backgrounds. In both cases, we will show that wavelet transforms can be used to fit the background with a great deal of accuracy, thus providing the framework for automatic background removal of large sets of data (typically obtained in time-series or spatial mappings). A MATLAB® based application that utilizes the iterative algorithm developed here is freely available to download from http://www.victoria.ac.nz/raman/publis/codes/cobra.aspx.