{'fraction_non_alphanumeric': 0.0292436065827088, 'fraction_numerical': 0.02580545468593062, 'mean_word_length': 5.000695410292073, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 1, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Statistics of the early synthetic dye industry

From the invention of Perkin’s Mauve in 1856, to publication of the first edition of the Colour Index in 1924, more than 1200 synthetic organic colourants were introduced. Some achieved commercial success, while others were rarely used for reasons such as high cost, low fastness, and toxicity. This turbulent period of innovation was largely driven by demand of the textile industry; however, synthetic colourants were subsequently adopted in many other applications. An understanding of the most common materials and their properties is therefore important to the study of heritage collections and their preservation. The risk of light damage during exhibition of objects is often a concern due to the fugitive nature of many synthetic colourants. To provide a foundation for focused research on synthetic dye identification and lightfastness, work was carried out to identify the most prominent of these colourants used in North America up to the year 1924 when the first edition of the Colour Index was published. Information was compiled and analysed from several sources including multiple editions of the Colour Index, and government documents related to the manufacture and trade of synthetic dyes that provide data from 1914 onwards. Cross-referencing between the information sources provided a summary of parameters for each colourant including the date of introduction, number of manufacturers, lightfastness, and quantity produced or imported in the United States. A document published in 1916 by the US Department of Commerce listed 259 colours with Schultz number imported during the 1913–1914 fiscal year, in quantities above 10,000 lb (4536 kg). Adding domestic products to the list, and removing duplicates, gave 289 individual colours with Schultz number imported and/or produced in the US. In addition, there were some imports of unknown composition: 96 azo, 23 sulphur, and 68 unclassified. Further review of census data from 1917 through the 1920’s suggested that less than one quarter of the dyes listed in the Colour Index were imported or manufactured in significant amounts. The results of this analysis are presented as summary statistics, which are complemented by an open dataset publication to facilitate future research.


Introduction
Early advances related to synthetic and semi-synthetic dyes were made by Barth (indigo carmine, 1743) [1], Woulfe (picric acid, 1771) [2], Scheele (murexide, 1776) [3], and Runge (aurin, 1834) [2,4]; however, a commercial industry was not significant until William Perkin created mauveine in 1856. This was followed by a period of accelerated developments of new products, which peaked near the end of the 19th century. Early synthetic dyes are generally categorised according to chemical structure. The most abundant synthetic dyes belong to the azo class. However, other chemical classes, including triphenylmethane, azine, xanthene, nitro, oxazine, indigoid and anthraquinone have each in turn had an important impact on the industry. As colourants were introduced to the market, many were used to colour materials other than textiles: e.g. waxes and varnishes, writing and printing inks, paint pigments, and early plastics. As a result, large quantities of synthetic colourants are present throughout museum collections around the world. Detailed reviews of the early industry [2,3,[5][6][7][8][9] and respective dye chemistry [10][11][12][13][14] are plentiful in the literature, and provide valuable context for current studies of heritage materials.
For many heritage objects, efforts are made to identify colourant materials for historical study, authentication and dating, and fastness evaluation. The large number of possible compounds makes it an overwhelming task to characterise them all, and in many cases reference materials are scarce. Analysis of these colourants is further complicated by the varied nomenclature used by manufacturers, where similar names were used for different dyes. The confusing letter codes (markings) after dye names, practice of mixing products, and mischaracterization of the product composition create additional layers of complexity. Norton [15] offers insight into some aspects of this confusing issue in a section titled "The Marks of Coal-Tar Colors". As just one example of the complexity, Norton indicated that 300,000 lb of a dye named Cotton Black with various markings (unclassified by Schultz #) was imported into the United States in 1914. The first edition of the Colour Index (CI) contains several listings that relate to this product name [16] In the 1980s, Schweppe [18,19] aimed to simplify the problem by providing a shortlist of 65 early synthetic organic dyes with notes to assist with their identification, while also highlighting a subset of 22 stated as the most common [20]. In the field of heritage science, this list has become a common reference despite the ambiguous selection criteria. In a review of the early synthetic dyes, Barnett [20] remarks that areas for further work include identifying the most common materials using 19th century trade literature, and compiling respective fastness data. The challenge, of course, is finding quantitative data regarding dye production or use. The Colour Index is an encyclopaedic resource of colourant data; however, information related to the degree of use is limited, and modern lightfastness data is unavailable for many of the earliest materials. Similarly, most trade books of the period simply outline the vast range of products available. It is likely that a significant number of the catalogued products were rarely used, and analysis could be prioritized to specific materials given the appropriate information.
This study investigates several trends in the synthetic dye industry using early 20th century literature: multiple editions of the CI [16,21,22], Norton's census [15], and the annual Census of Dyes and Coal Tar Chemicals from the US Tariff Commission [23,24]. The goal of the work is to provide a framework to better understand the most prominent early synthetic dyes, optimise methods for identification, and further develop lightfastness data for risk assessment tools. Findings are presented as summary statistics due to the large number of materials, while tabulated values are provided in a complementary dataset for further research work [25].

Data mining the colour index
Many reference texts were published with lists of dyes during the latter half of the 19th century, leading to the development of different classification systems [26]. The first widely adopted approach was Tabellarische übersicht der Künstlichen Organischen Farbstoffe by Schultz and Julius [27], which was published in seven editions between 1888 and 1931. The fifth edition [28], retitled Farbstofftabellen, became a template for the first edition of the CI and resulted in a legal dispute between the two groups [26]. The CI employed a new numbering system, and provided a convenient table for cross-referencing with listings in Farbstofftabellen. The table is a valuable resource since it allows conversion from the 1914 Schultz number to the first CI number [16], and subsequently to the CI constitution number in current use [21]. This conversion was applied in the following section during a review of census data, where US dye imports and production quantities were published with the 1914 Schultz number prior to 1924.
The CI contains a large amount of information showing interesting trends when extracted and studied as a dataset. For example, a column of citations for each dye provides the approximate date of introduction for each compound. Using this information, the earliest date was tabulated for each dye, and a sorted list was used to generate a plot of cumulative dyes invented through time. The result in Fig. 1 shows a sigmoid curve with features characteristic of the stages of an evolving technology: birth, development, maturity and stagnation. At a conference celebrating the centennial of Perkin's creation of mauveine, Lecher [5] described the stage up to ~ 1870 as the 'empirical period' when the structural theory was not yet established. This was followed by the 'rational period' , as the Kekulé structure of benzene was developed in 1865 [29] and later accepted. When the industry entered this latter period, the introduction of new dyes accelerated as specific organic compounds were sought after. This is evident in Fig. 1, where the rate of dye introduction accelerates shortly after 1870, and peaks around 1889. Another moment of significance is observed at the year 1893, when 50 % of this first wave of dyes was introduced.
Further information is added to this overview of the early synthetic dye industry by cross-referencing date of introduction with chemical classification. The stacked histogram in Fig. 2 highlights the distribution of dyes invented over time by chemical class, with a dominant peak generated by the azos around 1890 (cf. Fig. 1). A smaller peak at 1907 is due to the development of anthraquinone and sulphur dyes, which is followed by a cluster of indigoids around 1915. The introduction of triphenylmethane and xanthene dyes is scattered throughout the time period, along with the remainder of chemical classes grouped as 'other' to simplify the plot.
The CI provides occasional qualitative indications of popularity in the descriptive text for the listed dyes, but the information is sparse and of limited use. Another potential popularity indicator is the number of manufacturers, M, that offered each product. One would assume that compounds having many manufacturers would also experience significant commercial use. Those with one manufacturer may have had patent protection; however, this was likely circumvented or ignored using different methods of manufacture and varied rules by country. Gardener [30] provides a compilation of articles related to the British coal-tar industry, with the issue of patent protection highlighted throughout the text. In one paper, Bloxam [31] states "The whole of organic chemistry has been wondrously advanced by the desire of the maker of dyestuffs on the one hand to obtain monopolies of new colours, and on the other hand to avoid paying royalties under existing patents". To illustrate the varied number of manufacturers, Fig. 3 shows a plot of the number of dyes having more than a given value of Mdefined here as the manufacturers in exceedance, M e . The plot was constructed in this manner to quickly determine how many colourants would be required for future analysis (e.g. chemical and lightfastness) if we target those with more than some threshold number of manufacturers. Nearly all dyes had one or more manufacturers, while less than 50 % had M ≥ 3, and only ~ 10 % are indicated with M ≥ 15. The number of manufacturers is also used in the following section when plotting import and production quantities from US census data.
A final parameter investigated in the CI was the lightfastness rating for each colourant. The third edition [22] was reviewed for ISO and AATCC lightfastness values related to each of the 1,230 synthetic organic dyes listed in the first edition [16], using a conversion table in the second edition [21] for the two CI numbering systems. In total, 432 were found, or ~ 35 % of the total list. Counts of dyes with half-step ratings (e.g. ISO 2-3) were split equally into adjacent bins of full step ISO values to plot a histogram of the quantity of dyes with each lightfastness. Figure 4 shows the resulting percentage of dyes having each ISO value, with a peak at ISO 3. This distribution is affected by the number of dyes with ISO ratings listed in the CI, which varies significantly by chemical class and application type. The distributions are also highlighted separately for the direct and vat dyes, showing peaks at the lower and higher ISO ratings respectively. Figure 5 gives a related plot in which the relationship between the ISO and AATCC lightfastness scales is evaluated using data from 237 of the dyes, where both measures were available. Many of the earliest synthetic dyes were highly fugitive to light, which is well documented in literature of the period [32]. When Lauth discussed a new dye (Violet de Paris) in 1867, he gave some perspective on the shifting public opinion toward lightfastness: The violets obtained from methyl-aniline possess a richness and purity which leave nothing to be desired … Nevertheless they were not adopted by manufacturers, who, indeed at the time above mentioned (1861), attached less importance to the beauty of a colour than to its permanence. In this latter respect the methyl-aniline violets do not excel, and consequently dyers would have nothing to do with them. Gradually, however, people have become accustomed to colours which fade on exposure to the solar rays. Indeed the public taste at the present day, in colours as in everything else, inclines rather to tinsel than to solid excellence.
In his 1896 Hofmann memorial lecture, Perkin [6] also points to the shift of public interest toward new  When reviewing the extensive list of materials in the first edition of the CI, it is natural to wonder which materials were used in significant quantities, and most likely prevalent in museum collections. The CI was developed as a catalogue of all colourants, but only provides occasional information about popularity using qualitative terms such as 'used extensively for…". It is possible that many of the colourants were never used in significant quantities, while others achieved varying degrees of popularity. Some colourants are known to have had a period of success prior to their replacement by a new dye with improved properties and/or simplified production methods. An example is found in the history of the earliest synthetic green dyes. Cherpin created the first of value called aldehyde green in 1862, which was later displaced by Perkins green, iodine green, and methyl green. The CI notes the prior popularity for many of these dyes, as well as their replacement and ultimate obsolescence. Although limited quantitative data exists regarding the use of earliest synthetic dyes, valuable information is available from United States census data starting in 1913-1914. The following section provides an overview of data collected from government documents of the period.

US imports and domestic production
A resource for assessing general dye popularity is the US census data published in the early 20th century, at a time when there was significant pressure to boost domestic production and compete with manufacturers in Europe. The outbreak of World War I in July 1914 led to a severe disruption of the dye industry due to the broad reliance on supplies from Germany. This included finished products, as well as the large number of intermediates for dye manufacture. The issue was often described as the 'dyestuff famine' or 'dyestuff crisis' [34,35], and short-lived attempts were made to return to traditional methods using natural dyes [36] with limited success. Commenting on the state of the US dye industry, Hesse [34]  At approximately the same time, the mystery regarding US dye imports was addressed by a commercial agent named Thomas H. Norton at the US Department of Commerce (Fig. 6). With careful planning to avoid the pitfalls experienced by similar efforts in Britain, Norton successfully conducted a census of imports for the 1913-1914 fiscal year [15]. His report included a large table of import quantities above 10,000 lb. (4536 kg), dollar values, commercial dye name, and Schultz number where available. These quantities were evaluated in the present study by converting the Schultz numbers to those of the first CI edition. Figure 7a shows the quantities reported by Norton versus CI number, with markers at the top indicating many of the chemical classes. The top-ten imported dyes are noted with labels on the peaks, and outlined in Table 1. Further information is provided in Appendix: Table 2, and the accompanying dataset [25]. Norton also catalogued dyes without a Schultz number; however, these only amounted to ~ 16 % of the total import quantity (see Appendix: Table 3 for those above 100,000 lb). The results of Fig. 7a provide a useful indication of which dyes were predominantly used in the US when domestic manufacturing was still maturing.
A related development from Norton's census was the US Revenue Act of 1916. This led to the formation of the Tariff Commission, and enacted measures to temporarily support the US dyestuff industry through trade policy. As a means of tracking progress, an annual report was published by the Tariff Commission starting in 1918 (with 1917 data) called the Census of Dyes and Coal-Tar Chemicals. The report continued for several decades, with each issue summarising quantitative data regarding dye production and imports by chemical classification number (i.e. Schultz prior to 1924, followed by early CI#). For the current study, a review of these data was undertaken by tabulating production amounts from 1917 through the 1920's. Conversion to first edition CI number also allowed cross-referencing with data summarised in the previous section. Figure 7b and c show imports and domestic production data respectively for 1920, where the log-scale highlights the large quantities of some dyes. Unlike Norton's census, subsequent publications list amounts below 10,000 lb (not shown here); however, some domestic production data was withheld to maintain manufacturer privacy. A small group, particularly sulphur dyes, included production amounts but were not characterised by Schultz number. Figure 8a presents US imports for the 1914 fiscal year versus the number of manufacturers listed in the first edition of the CI for the respective dyes. A similar plot is given in Fig. 8b, showing peak annual production for the period of 1917-1924 versus number of manufacturers. There is significant scatter in these data; however, the plots indicate a trend of increasing dye quantities with number of manufacturers. In both plots, data points circled in red indicate one of the 65 dyes in the Schweppe list [18]. Bracketed numbers in the legends give the number of points plotted for each series. For example, Fig. 8a shows 259 materials imported into the US in quantities greater than 10,000 lb, of which 43 are described by Schweppe. Dyes imported in large quantities, and not in Schweppe's list, may be worth further examination if the CI describes applications relevant to heritage objects.
Disruption to the dye industry during WWI contributed to the United States domestically producing many of the dyes that were previously imported in significant quantities. Figure 9 explores this trend with a plot of the production and imports of dyes in the United States during 1920 versus 1914 imports (Norton's census) for the corresponding materials. By 1920, approximately one third were produced in the US in quantities significantly larger than the prior 1914 imports. Some continued to be imported (41 %); however, these were typically at much lower quantities. A small number (6 %) were both imported and produced in the US during 1920, with production dominant.
A broader assessment of census data from 1917 through the 1920's suggests that less than one quarter of the colourants in the CI were produced or imported in the United States in significant quantities during the period. In comparison, Norton's census listed 259 colours with Schultz number imported in quantities above 10,000 lb (~ 21 % of the CI) during the 1913-1914 fiscal year. Adding the list of domestic products (tabulated by Norton without quantities), and removing duplicates, gave 289 compounds with unique Schultz number that were imported and/or produced in the US. There were also several imports of unknown composition in Norton's census: 96 azo, 23 sulphur, and 68 unclassified. This likely included duplicate counts of similar compounds. See Appendix: Table 3 for the small subset of undefined dyes imported in amounts over 100,000 lb. The overall findings emphasize that a subset of the CI list is worth greater attention for further analysis. It is also important to note that some applications of concern to heritage collections may have used colourants in relatively small amounts that are overshadowed by these general statistics.

Conclusions
Statistics of the early synthetic dye industry were reviewed by extracting colourant data from the CI including date of introduction, number of manufacturers, chemical class, and lightfastness. These parameters were plotted to show trends with respect to the number of dyes introduced over time, the rate of introduction, and the types of colourants from the mid-19th century to 1924. The number of manufacturers was shown as a potential indicator of popularity with values ranging from zero to more than 60 per colourant. Lightfastness data with ISO and AATCC ratings were summarised by cross-referencing between multiple editions of the CI. This was used to highlight the relationship between ISO and AATCC rating systems, and also the distribution of ISO lightfastness for 432 colourants listed in the 1st edition of the CI.
The analysis of CI data was followed by a review of United States census literature from 1914 through the 1920's. In broad terms, census data suggested that less , and a total of 289 classified (Schultz #) compounds imported and/or produced. There were also several compounds of unknown composition in Norton's census that made up ~ 16 % of total imports: 96 azo, 23 sulphur, and 68 unclassified. Census data were further used to show the amounts of each colourant imported and produced in the US, which was then compared with the number of manufacturers. Comparisons were also made with the Schweppe list of synthetic dyes since it is frequently used as a reference for dye analysis. Several of the dyes on Schweppe's list were imported or produced in significant quantities during the studied time period; however, the results highlight that many other products deserve further consideration.  To support research related to the history and preservation of heritage collections, a compilation of the tabulated values is provided as an open dataset [25]. In our ongoing work, this information provides a tool for selecting specific samples of interest for chemical analysis and lightfastness testing using a set of criteria: introduced 1870 and earlier (empirical period); produced or imported in large quantities (≥ 100,000 lb/yr); having a large number of manufacturers listed in the CI (M ≥ 15); or historically significant. Appendix: Table 2 provides a summary of colourants meeting these criteria, while the dataset [25] allows anyone to generate a custom list based on parameters of interest.
In parallel to the work described here, a list of available period samples was tabulated from trade books and dying texts (i.e. commercial name, and manufacturer where available). This was cross-referenced with the first edition of the Colour Index to verify the CI# where possible, and then pick the target samples of interest for analysis. At the present time, over 100 samples have been studied for the effects of light exposure with a custom fadometer, and chemical markers using gas chromatography-mass spectrometry (GC-MS). The goal is to provide an open database for researchers to explore the results, and build upon in future work. Finally, the samples with and without light damage are catalogued and stored for possible analysis with other analytical techniques. Table 2 gives a summary of dyes in the first edition of the CI [16] that meet one or more of the following criteria: (a) introduced 1870 or earlier; (b) imported or produced in quantities of 100,000 lb/yr or more (1914)(1915)(1916)(1917)(1918)(1919)(1920)(1921)(1922)(1923)(1924); (c) having 15 or more manufacturers listed in the CI. Matches for each criterion are emphasised in bold and underlined for clarity. A question mark in the column of peak annual US production (1917)(1918)(1919)(1920)(1921)(1922)(1923)(1924) indicates that the dye was produced in at least one reporting period; however, the quantity was withheld for manufacturer privacy. This list of dyes is also supplemented with some materials of known relevance or historical significance that are not already captured: e.g. the first sulphur dye (CI 933), and early dyes without CI number (aldehyde green, aldehyde blue). Additionally, cross-referencing with the Schweppe list [18] of important early synthetic dyes showed a near match for Mordant Red 3 (CI 1034): introduced ~ 1871, with nearly 82,000 lb imported to the US in 1914. The dye was added to the table in consideration of these factors.  Table 2 List of dyes fulfilling selection criteria based on date of introduction (≤ 1870), number of manufacturers (≥ 15), US imports and production (≥ 100,000 lb/yr), or other significance For further comparison, Table 3 provides a supplementary list of ambiguous dyes that were listed in Norton's 1914 census [15] with import quantities above 100,000 lb. Six dyes were categorised as unidentified azo materials, while the remaining three were of unknown chemical class.

Appendix
Abbreviation CI: Colour Index.

Authors' contributions
EH compiled the dataset used in this study, and drafted the manuscript. JP provided significant input through edits and revisions. Both authors worked on the interpretation of data, and the selection criteria for targeted analysis of colourants in future work. All authors read and approved the final manuscript.

Funding
Not applicable.

Availability of data and materials
The dataset generated and analysed during the current study is available in the Harvard Dataverse repository, https:// doi. org/ 10. 7910/ DVN/ BK2CBX [25].