languages text segmentation significant task requiring knowledge vocabulary morphology words language sometimes process also used cases like bag words bow creation data mining morphological analysis lemmatization task removing inflectional endings return base dictionary form word also known lemma lemmatization another technique reducing words normalized form case transformation actually uses dictionary map words actual form morphological segmentation separate words
Humanities Languages and literature Linguistics Natural language processing