{'fraction_non_alphanumeric': 0.01929737753587333, 'fraction_numerical': 0.0, 'mean_word_length': 4.711864406779661, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Chinese News Report and Summarization System

This demo shows a concept-driven search engine provides human intelligence to the user who desires to seek for relevant information over Internet. Coupled with an auto summarizer and a text-to-speech engine, the retrieved information can be delivered to the user succinctly and in a human conversational manner. The concept-driven search system consists of a spider, a ConceptNet, and standard information retrieval (IR) engine. The spider is an Internet agent that automatically penetrates into the Cyberspace and gathers information for a specific domain. Represented by a concept network, the ConceptNet is composed by hundreds of nodes, each referring to a specific concept for a chosen domain and pointing to the associations among concepts. The standard IR system serves as the direct interface between the search engine and the user. When the user enters a query, the IR engine returns an initial answer set. Then it pipes the query to the ConceptNet, which checks if there already exists a concept term in the network. If the concept is located, the ConceptNet returns the related concepts and their semantic associations. It is usually the case that the user first gives a general concept as the first query. In return, she gets a broad answer set along with a number of specific concepts from the ConceptNet. Next, the user chooses one (or more) of these specific concepts in order to obtain narrowed and more relevant documents. This process iterates until the user gets targeted result. Once the user feels satisfies with the returned information, the auto summarizer kicks in. It helps the user locate the main theme of the story and condense it into a short paragraph or in a bulleti zed format. The summaries can be read or can be listened. When choosing to listen, a smart TTS engine gets initiated. Backed up by an unlimited domain Mandarin TTS system and a large Mandarin speech corpus, the summaries will be spoken out loudly very close to human broadcast.