{'fraction_non_alphanumeric': 0.04568527918781726, 'fraction_numerical': 0.016074450084602367, 'mean_word_length': 4.580188679245283, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Intonation and the assessment of information1

1. It is now a commonplace that one of the functions of intonation in English is to divide a discourse into ‘units of information’ and to structure these units by singling out within each one a focal part which contains what the speaker is presenting to the listener as ‘new’, in the sense of ‘newsworthy’ (Halliday, 1967; Quirk et at., 1972; Bolinger, 1958, 1972). The remainder of the information unit (if there is a remainder - some units are all focus) is said to contain ‘given’ information. 2 According to some versions of the theory, many information units – in fact the majority of those with ‘unmarked tonicity’ (Halliday), or with the focus in the ‘neutral position’ (Quirk et at.) – are ambiguous in structure, and the choice between two or more structural possibilities is made in accordance with the context. The principle is illustrated in the following examples, in which the A-sentences provide the context, the nuclear syllable is marked with an accent, and the focal unit is in capitals (Halliday's term for the focal unit is the ‘domain of focus’; Quirk et al. speak of the ‘new element’ or the ‘unit marked as new’)