{'fraction_non_alphanumeric': 0.021553325901151988, 'fraction_numerical': 0.0, 'mean_word_length': 5.118181818181818, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Dublin Core Metadata Initiative Metadata Formats Simple Formats Structured Formats Dublin Core Metadata Element Set

The Internet has often been described as a library. The people who do so are usually not familiar with what the libraries really are. The real state of the affairs was described by Clifford Lynch in his seminal article "Searching the Internet" The Internet-and particularly its collection of multimedia resources known as the World Wide Web-was not designed to support the organized publication and retrieval of information, as libraries are. It has evolved into what might be thought of as a chaotic repository for the collective output of the world's digital "printing presses." This storehouse of information contains not only books and papers but raw scientific data, menus, meeting minutes, advertisements, video and audio recordings, and transcripts of interactive conversations. The ephemeral mixes everywhere with works of lasting importance. In short, the Net is not a digital library. But if it is to continue to grow and thrive as a new means of communication, something very much like traditional library services will be needed to organize, access and preserve networked information. One of the traditional library services which is especially relevant in this context is description of resources. The best method for improving the chances of finding a document-research report, information about ongoing research, or basically anything-from the Internet is to describe it, and hope that an automated indexing application will find and process the metadata you provided. Metadata, structured data about data, may support a number of functions, such as location, discovery, documentation, evaluation, and selection of resources. Long-time preservation of electronic documents is emerging as one of the key areas as well. These activities may be carried out by human end-users or (human or automated) agents. The quality of metadata naturally has a major impact on searching – Alta Vista provides gigabytes of metadata from millions of documents, but finding tens of thousands of hits as a result of even quite narrow searches is not a good result. Metadata structure is defined in formats, which again are based implicitly or explicitly on something that the library community calls cataloguing rules, agreements on how to extract metadata from the resource. Both the cataloguing rules and the format may be very simple or extremely complicated. Depending on this background, it may be necessary to have a highly trained and competent professional such as a cataloguer in the library to provide metadata (called bibliographic data by my community). Or, just an …