Style is NOT a single variable: Case Studies for Cross-Style Language
  Understanding
  Every natural text is written in some style. Style is formed by a complex
combination of different stylistic factors, including formality markers,
emotions, metaphors, etc. One cannot form a complete understanding of a text
without considering these factors. The factors combine and co-vary in complex
ways to form styles. Studying the nature of the co-varying combinations sheds
light on stylistic language in general, sometimes called cross-style language
understanding. This paper provides the benchmark corpus (xSLUE) that combines
existing datasets and collects a new one for sentence-level cross-style
language understanding and evaluation. The benchmark contains text in 15
different styles under the proposed four theoretical groupings: figurative,
personal, affective, and interpersonal groups. For valid evaluation, we collect
an additional diagnostic set by annotating all 15 styles on the same text.
Using xSLUE, we propose three interesting cross-style applications in
classification, correlation, and generation. First, our proposed cross-style
classifier trained with multiple styles together helps improve overall
classification performance against individually-trained style classifiers.
Second, our study shows that some styles are highly dependent on each other in
human-written text. Finally, we find that combinations of some contradictive
styles likely generate stylistically less appropriate text. We believe our
benchmark and case studies help explore interesting future directions for
cross-style research. The preprocessed datasets and code are publicly
available.
