{'fraction_non_alphanumeric': 0.021462639109697933, 'fraction_numerical': 0.0023847376788553257, 'mean_word_length': 4.312236286919831, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
How to Use the LSA Web Site

Many researchers and students interested in applying latent semantic analysis (LSA) become daunted by the complexities of building spaces and applying those spaces to new problems. In an effort to provide a simpler interface, the University of Colorado built the LSAWeb site (http://lsa.colorado.edu). The Web site contains several precomputed semantic spaces and tools to manipulate those spaces in a number of ways. This chapter provides an overview of the site and describes some of the issues that you will need to be aware of in order to use the site correctly. Like any model, poor results can be obtained from LSAif parameters are not set appropriately. We will highlight some of the most common errors and give advice on how to use the site to generate the best results. In the discussions in this chapter, we will assume that you have a basic understanding of the mechanics of LSA and are familiar with terms such as cosine, psuedodoc, and so on. If this is not the case, then before proceeding you should read chapter 2 in this volume on the mathematical foundations of LSA. Figure 3.1 shows the home page of the LSA Web site. On the left-hand side is a main menu, which provides fast links to the main areas of the Web