{'fraction_non_alphanumeric': 0.028648445336008025, 'fraction_numerical': 0.013039117352056168, 'mean_word_length': 5.063283922462942, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 8, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
MACHINE LEARNING METHODS IN THE APPLICATION OF SPEECH EMOTION RECOGNITION

Machine Learning concerns the development of algorithms, which allows machine to learn via inductive inference based on observation data that represent incomplete information about statistical phenomenon. Classification, also referred to as pattern recognition, is an important task in Machine Learning, by which machines “learn” to automatically recognize complex patterns, to distinguish between exemplars based on their different patterns, and to make intelligent decisions. A pattern classification task generally consists of three modules, i.e. data representation (feature extraction) module, feature selection or reduction module, and classification module. The first module aims to find invariant features that are able to best describe the differences in classes. The second module of feature selection and feature reduction is to reduce the dimensionality of the feature vectors for classification. The classification module finds the actual mapping between patterns and labels based on features. The objective of this chapter is to investigate the machine learning methods in the application of automatic recognition of emotional states from human speech. It is well-known that human speech not only conveys linguistic information but also the paralinguistic information referring to the implicit messages such as emotional states of the speaker. Human emotions are the mental and physiological states associated with the feelings, thoughts, and behaviors of humans. The emotional states conveyed in speech play an important role in human-human communication as they provide important information about the speakers or their responses to the outside world. Sometimes, the same sentences expressed in different emotions have different meanings. It is, thus, clearly important for a computer to be capable of identifying the emotional state expressed by a human subject in order for personalized responses to be delivered accordingly. 1


Introduction
Machine Learning concerns the development of algorithms, which allows machine to learn via inductive inference based on observation data that represent incomplete information about statistical phenomenon. Classification, also referred to as pattern recognition, is an important task in Machine Learning, by which machines "learn" to automatically recognize complex patterns, to distinguish between exemplars based on their different patterns, and to make intelligent decisions. A pattern classification task generally consists of three modules, i.e. data representation (feature extraction) module, feature selection or reduction module, and classification module. The first module aims to find invariant features that are able to best describe the differences in classes. The second module of feature selection and feature reduction is to reduce the dimensionality of the feature vectors for classification. The classification module finds the actual mapping between patterns and labels based on features. The objective of this chapter is to investigate the machine learning methods in the application of automatic recognition of emotional states from human speech. It is well-known that human speech not only conveys linguistic information but also the paralinguistic information referring to the implicit messages such as emotional states of the speaker. Human emotions are the mental and physiological states associated with the feelings, thoughts, and behaviors of humans. The emotional states conveyed in speech play an important role in human-human communication as they provide important information about the speakers or their responses to the outside world. Sometimes, the same sentences expressed in different emotions have different meanings. It is, thus, clearly important for a computer to be capable of identifying the emotional state expressed by a human subject in order for personalized responses to be delivered accordingly.
Speech emotion recognition aims to automatically identify the emotional or physical state of a human being from his or her voice. With the rapid development of human-computer interaction technology, it has found increasing applications in security, learning, medicine, entertainment, etc. Abnormal emotion (e.g. stress and nervousness) detection in audio surveillance can help detect a lie or identify a suspicious person. Web-based E-learning has prompted more interactive functions between computers and human users. With the ability to recognize emotions from users' speech, computers can interactively adjust the content of teaching and speed of delivery depending on the users' response. The same idea can be used in commercial applications, where machines are able to recognize emotions expressed by the customers and adjust their responses accordingly. The automatic recognition of emotions in speech can also be useful in clinical studies, psychosis monitoring and diagnosis. Entertainment is another possible application for emotion recognition. With the help of emotion detection, interactive games can be made more natural and interesting. Motivated by the demand for human-like machines and the increasing applications, research on speech based emotion recognition has been investigated for over two decades (Amir, 2001;Clavel et al., 2004;Cowie & Douglas-Cowie, 1996;Cowie et al., 2001;Dellaert et al., 1996;Lee & Narayanan, 2005;Morrison et al., 2007;Nguyen & Bass, 2005;Nicholson et al., 1999;Petrushin, 1999;Petrushin, 2000;Scherer, 2000;Ser et al., 2008;Ververidis & Kotropoulos, 2006;Yu et al., 2001;Zhou et al., 2006). Speech feature extraction is of critical importance in speech emotion recognition. The basic acoustic features extracted directly from the original speech signals, e.g. pitch, energy, rate of speech, are widely used in speech emotion recognition (Ververidis & Kotropoulos, 2006;Lee & Narayanan, 2005;Dellaert et al., 1996;Petrushin, 2000;Amir, 2001). The pitch of speech is the main acoustic correlate of tone and intonation. It depends on the number of vibrations per second produced by the vocal cords, and represents the highness or lowness of a tone as perceived by the ear. Since the pitch is related to the tension of the vocal folds and subglottal air pressure, it can provide information about the emotions expressed in speech (Ververidis & Kotropoulos, 2006). In the study on the behavior of the acoustic features in different emotions (Davitz, 1964;Huttar, 1968;Fonagy, 1978;Moravek, 1979;Van Bezooijen, 1984;McGilloway et al., 1995, Ververidis & Kotropoulos, 2006, it has been found that the pitch level in anger and fear is higher while a lower mean pitch level is measured in disgust and sadness. A downward slope in the pitch contour can be observed in speech expressed with fear and sadness, while the speech with joy shows a rising slope. The energy related features are also commonly used in emotion recognition. Higher energy is measured with anger and fear. Disgust and sadness are associated with a lower intensity level. The rate of speech also varies with different emotions and aids in the identification of a person's emotional state (Ververidis & Kotropoulos, 2006;Lee & Narayanan, 2005). Some features derived from mathematical transformation of basic acoustic features, e.g. Mel-Frequency Cepstral Coefficients (MFCC) (Specht, 1988;Reynolds et al., 2000) and Linear Predictionbased Cepstral Coefficients (LPCC) (Specht, 1988), are also employed in some studies. As speech is assumed as a short-time stationary signal, acoustic features are generally calculated on a frame basis, in order to capture long range characteristics of the speech signal, feature statistics are usually used, such as mean, median, range, standard deviation, maximum, minimum, and linear regression coefficient (Lee & Narayanan, 2005). Even though many studies have been carried out to find which acoustic features are suitable for www.intechopen.com Machine Learning Methods In The Application Of Speech Emotion Recognition 3 emotion recognition, however, there is still no conclusive evidence to show which set of features can provide the best recognition accuracy (Zhou, 2006). Most machine learning and data mining techniques may not work effectively with highdimensional feature vectors and limited data. Feature selection or feature reduction is usually conducted to reduce the dimensionality of the feature space. To work with a small, well-selected feature set, irrelevant information in the original feature set can be removed. The complexity of calculation is also reduced with a decreased dimensionality. Lee & Narayanan (2005) used the forward selection (FS) method for feature selection. FS first initialized to contain the single best feature with respect to a chosen criterion from the whole feature set, in which the classification accuracy criterion by nearest neighborhood rule is used and the accuracy rate is estimated by leave-one-out method. The subsequent features were then added from the remaining features which maximized the classification accuracy until the number of features added reached a pre-specified number. Principal Component Analysis (PCA) was applied to further reduce the dimension of the features selected using the FS method. An automatic feature selector based on a RF2TREE algorithm and the traditional C4.5 algorithm was developed by Rong et al. (2007). The ensemble learning method was applied to enlarge the original data set by building a bagged random forest to generate many virtual examples. After which, the new data set was used to train a single decision tree, which selected the most efficient features to represent the speech signals for emotion recognition. The genetic algorithm was applied to select an optimal feature set for emotion recognition (Oudeyer, 2003). After the acoustic features are extracted and processed, they are sent to emotion classification module. Dellaert et al. (1996) used K-nearest neighbor (k-NN) classifier and majority voting of subspace specialists for the recognition of sadness, anger, happiness and fear and the maximum accuracy achieved was 79.5%. Neural network (NN) was employed to recognize eight emotions, i.e. happiness, teasing, fear, sadness, disgust, anger, surprise and neutral and an accuracy of 50% was achieved (Nicholson et al. 1999). The linear discrimination, k-NN classifiers, and SVM were used to distinguish negative and nonnegative emotions and a maximum accuracy of 75% was achieved (Lee & Narayanan, 2005). Petrushin (1999) developed a real-time emotion recognizer using Neural Networks for call center applications, and achieved 77% classification accuracy in recognizing agitation and calm emotions using eight features chosen by a feature selection algorithm. Yu et al. (2001) used SVMs to detect anger, happiness, sadness, and neutral with an average accuracy of 73%. Scherer (2000) explored the existence of a universal psychobiological mechanism of emotions in speech by studying the recognition of fear, joy, sadness, anger and disgust in nine languages, obtaining 66% of overall accuracy. Two hybrid classification schemes, stacked generalization and the un-weighted vote, were proposed and accuracies of 72.18% and 70.54% were achieved respectively, when they were used to recognize anger, disgust, fear, happiness, sadness and surprise (Morrison, 2007). Hybrid classification methods that combined the Support Vector Machines and the Decision Tree were proposed (Nguyen & Bass, 2005). The best accuracies for classifying neutral, anger, lombard and loud was 72.4%. In this chapter, we will discuss the application of machine learning methods in speech emotion recognition, where feature extraction, feature reduction and classification will be covered. The comparison results in speech emotion recognition using several popular classification methods have been given (Cen et al. 2009). In this chapter, we focus on feature processing, where the related experiment results in the classification of 15 emotional states www.intechopen.com

Application of Machine Learning 4
for the samples extracted from the LDC database are presented. The remaining part of this chapter is organized as follows. The acoustic feature extraction process and methods are detailed in Section 2, where the feature normalization, utterance segmentation and feature dimensionality reduction are covered. In the following section, the Support Vector Machine (SVM) for emotion classification is presented. Numerical results and performance comparison are shown in Section 4. Finally, the concluding remarks are made in Section 5. Speech feature extraction aims to find the acoustic correlates of emotions in human speech. Fig. 1 shows the block diagram for acoustic feature calculation, where S represents a speech sample (an utterance) and x denotes its acoustic features. Before the raw features are extracted, the speech signal is first pre-processed by pre-emphasis, framing and windowing processes. In our work, three short time cepstral features are extracted, which are Linear Prediction-based Cepstral Coefficients (LPCC), Perceptual Linear Prediction (PLP) Cepstral Coefficients, and Mel-Frequency Cepstral Coefficients (MFCC). These features are fused to achieve a feature matrix,

Acoustic Features
for each sentence S, where F is the number of frames in the utterance, and M is the number of features extracted from each frame. Feature normalization is carried out on the speaker level and the sentence level. As the features are extracted on a frame basis, the statistics of the features are calculated for every window of a specified number of frames. These include the mean, median, range, standard deviation, maximum, and minimum. Finally, PCA is employed to reduce the feature dimensionality. These will be elaborated in subsections below.

Signal Pre-processing: Pre-emphasis, Framing, Windowing
In order to emphasize important frequency component in the signal, a pre-emphasis process is carried out on the speech signal using a Finite Impulse Response (FIR) filter called preemphasis filter, given by The coefficient pre a can be chosen typically from [-1.0, 0.4] (Picone, 1993). In our implementation, it is set to be 0.9375 ) 16 , so that it can be efficiently implemented in fixed point hardware.
The filtered speech signal is then divided into frames. It is based on the assumption that the signal within a frame is stationary or quasi-stationary. Frame shift is the time difference between the start points of successive frames, and the frame length is the time duration of each frame. We extract the signal frames of length 25 msec from the filtered signal at every interval of 10 msec. A Hamming window is then applied to each signal frame to reduce signal discontinuity in order to avoid spectral leakage.

Feature Extraction
Three short time cepstral features, i.e. Linear Prediction-based Cepstral Coefficients (LPCC), Perceptual Linear Prediction (PLP) Cepstral Coefficients, and Mel-Frequency Cepstral Coefficients (MFCC), are extracted as acoustic features for speech emotion recognition.

A. LPCC
Linear Prediction (LP) analysis is one of the most important speech analysis technologies. It is based on the source-filter model, where the vocal tract transfer function is modeled by an all-pole filter with a transfer function given by where i a is the filter coefficients. The speech signal, t S assumed to be stationary over the analysis frame is approximated as a linear combination of the past p samples, given as www.intechopen.com

Application of Machine Learning 6
In (3) i a can be found by minimizing the mean square filter prediction error between t Ŝ and t S . The cepstral coefficents is considered to be more reliable and robust than the LP filter coefficents. It can be computed directly from the LP filter coefficients using the recursion given as where k c represents the cepstral coefficients.

B. PLP Cepstral Coefficients
PLP is first proposed by Hermansky (1990), which combines the Discrete Fourier Transform (DFT) and LP technique. In PLP analysis, the speech signal is processed based on hearing perceptual properties before LP analysis is carried out, in which the spectrum is analyzed on a warped frequency scale. The calculation of PLP cepstral coefficients involves 6 steps as shown in Fig. 2. Step 1 Spectral analysis  The short-time power spectrum is achieved for each speech frame.
Step 2 Critical-band Spectral resolution  The power spectrum is warped onto a Bark scale and convolved with the power spectral of the critical band filter, in order to simulate the frequency resolution of the ear which is approximately constant on the Bark scale.
Step 3 Equal-loudness pre-emphasis  An equal-loudness curve is used to compensate for the non-equal perception of loudness at different frequencies.
Step 4 Intensity loudness power law  Perceived loudness is approximately the cube root of the intensity.
Step 5 Autoregressive modeling  Inverse Discrete Fourier Transform (IDFT) is carried out to obtain the autoregressive coefficients and all-pole modeling is then performed.
Step 6 Cepstral analysis  PLP cepstral coefficients are calculated from the AR coefficients as the process in LPCC calculation.

www.intechopen.com
Machine Learning Methods In The Application Of Speech Emotion Recognition 7 C. MFCC The MFCC proposed by Davis and Mermelstein (1980) has become the most popular features used in speech recognition. The calculation of MFCC involves computing the cosine transform of the real logarithm of the short-time power spectrum on a Mel warped frequency scale. The process consists of the following process as shown in Fig. 3. 1) DFT is applied in each speech frame given as The Fourier spectrum is non-uniformly quantized to conduct Mel filter bank analysis. The window functions that are first uniformly spaced on the Mel-scale and then transformed back to the Hertz-scale are multiplied with the Fourier power spectrum and accumulated to achieve the Mel spectrum filter-bank coefficients. A Mel filter bank has filters linearly spaced at low frequencies and approximately logarithmically spaced at high frequencies, which can capture the phonetically important characteristics of the speech signal while suppressing insignificant spectral variation in the higher frequency bands (Davis and Mermelstein, 1980).
3) The Mel spectrum filter-bank coefficients is calculated as 4) The Discrete Cosine Transform (DCT) of the log filter bank energies is calculated to find the MFCC given as is the n th coefficient.

D. Delta and Acceleration Coefficients
After the three short time cepstral features, LPCC, PLP Cepstral Coefficients, and MFCC, are extracted, they are fused to form a feature vector for each of the speech frames. In the vector, besides the LPCC, PLP cepstral coefficients and MFCC, Delta and Acceleration (Delta Delta) of the raw features are also included, given as www.intechopen.com

Application of Machine Learning 8
where i x is the i th value in the feature vector.

E. Feature List
In conclusion, the list below shows the full feature set used in speech emotion recognition presented in this chapter. The feature vector has a dimension of M R , where M = 132 is the total number of the features calculated for each frame.

Feature Normalization
As acoustic variation in different speakers and different utterances can be found in phonologically identical utterances, speaker-and utterance-level normalization are usually performed to reduce these variations, and hence to increase recognition accuracy. In our work, the normalization is achieved by subtracting the mean and dividing by the standard deviation of the features given as www.intechopen.com

Machine Learning Methods In The Application Of Speech Emotion Recognition 9
where i x is the i th coefficient in the feature vector, ui μ and ui σ are the mean and standard deviation of i x within an utterance, and si μ and si σ are the mean and standard deviation of i x within the utterances spoken by the same speaker. In this way, the variation across speakers and utterances can be reduced.

Utterance Segmentation
As we have discussed, the three short time cepstral features are extracted for each speech frames. The information in the individual frames is not sufficient for capturing the longer time characteristics of the speech signal. To address the problem, we arrange the frames within an utterance into several segments as shown in Fig. 4. In this figure, f i represents a frame and s i denotes a segment. Each segment consists of a fixed number of frames. The sf represents the segment size, i.e. the number of frames in one segment, and ∆ is the overlap size, i.e. the number of frames overlapped in two consecutive segments.

Fig. 4. Utterance partition with frames and segments.
Here, the trade-off between computational complexity and recognition accuracy is considered in utterance segmentation. Generally speaking, finer partition and larger overlap between two consecutive segments potentially result in better classification performance at the cost of higher computational complexity. The statistics of the 132 features given in the previous sub-section is calculated for each segment, which is used in emotion classification instead of the original 132 features in each frame. This includes median, mean, standard deviation, maximum, minimum, and range (max-min). In total, the number of statistic parameters in a feature vector for each speech segment is 792 6 132   .

www.intechopen.com
Application of Machine Learning 10

Feature Dimensionality Reduction
Most machine learning and data mining techniques may not work effectively if the dimensionality of the data is high. Feature selection or feature reduction is usually carried out to reduce the dimensionality of the feature vectors. A short feature set can also improve computational efficiency involved in classification and avoids the problem of overfitting. Feature reduction aims to map the original high-dimensional data onto a lower-dimensional space, in which all of the original features are used. In feature selection, however, only a subset of the original features is chosen.
In our work, Principal Component Analysis (PCA) is employed to reduce the feature dimensionality. Assume the feature matrix, , with zero empirical mean, in which each row is a feature vector of a data sample, and S N is the number of data samples. The PCA transformation is given as is the Singular Value Decomposition (SVD) of T X . PCA mathematically transforms a number of potentially correlated variables into a smaller number of uncorrelated variables called Principal Components (PC). The first PC (the eigenvector with the largest eigenvalue) accounts for the greatest variance in the data, the second PC accounts for the second variance, and each succeeding PCs accounts for the remaining variability in order. Although PCA requires a higher computational cost compared to the other methods, for example, the Discrete Cosine Transform, it is an optimal linear transformation for keeping the subspace with the largest variance.

Support Vector Machines (SVMs) for Emotion Classification
SVMs that developed by Vapnik (1995) and his colleagues at AT&T Bell Labs in the mid 90's, have become of increasing interest in classification (Steinwart and Christmann, 2008). It has shown to have better generalization performance than traditional techniques in solving classification problems. In contrast to traditional techniques for pattern recognition that are based on the minimization of empirical risk learned from training datasets, it aims to minimize the structural risk to achieve optimum performance. It is based on the concept of decision planes that separate the objects belonging to different categories. In the SVMs, the input data are separated as two sets using a separating hyperplane that maximizes the margin between the two data sets. Assuming the training data samples are in the form of It can be re-written as Searching a pair of hyperplanes that gives the maximum margin can be achieved by solving the following optimization problem   2 Minimize subject ( ) 1, 1, 2,..., .
In (16), w represents the Euclidean norm of w . This can be formulated as a quadratic programming optimization problem and be solved by standard quadratic programming techniques.
Using the Lagrangian methodology, the dual problem of (16) is given as   Here i  is the Lagrangian variable.
The simplest case is that   x  is a linear function. If the data cannot be separated in a linear way, non-linear mappings are performed from the original space to a feature space via kernels. This aims to construct a linear classifier in the transformed space, which is the socalled "kernel trick". It can be seen from (17) that the training points appear as their inner products in the dual formulation. According to Mercer's theorem, any symmetric positive implicitly defines a mapping into a feature space (18) such that the function is an inner product in the feature space given as www.intechopen.com

Application of Machine Learning 12
The function is called kernels. The dual problem in the kernel form is then given as     By replacing the inner product in (17) with a kernel and solving for  , a maximal margin separating hyperplane can be obtained in the feature space defined by a kernel. Choosing suitable non-linear kernels, therefore, classifiers that are non-linear in the original space can become linear in the feature space. Some common kernel functions are shown below: A single SVM itself is a classification method for 2-category data. In speech emotion recognition, there are usually multiple emotion categories. Two common methods used to solve the problem are called one-versus-all and one-versus-one (Fradkin and Muchnik, 2006). In the former, one SVM is built for each emotion, which distinguishes this emotion from the rest. In the latter, one SVM is built to distinguish between every pair of categories. The final classification decision is made according to the results from all the SVMs with the majority rule. In the one-versus-all method, the emotion category of an utterance is determined by the classifier with the highest output based on the winner-takes-all strategy. In the one-versus-one method, every classifier assigns the utterance to one of the two emotion categories, then the vote for the assigned category is increased by one vote, and the emotion class is the one with most votes based on a max-wins voting strategy.

Experiments
The speech emotion database used in this study is extracted from the Linguistic Data Consortium (LDC) Emotional Prosody Speech corpus (catalog number LDC2002S28), which was recorded by the Department of Neurology, University of Pennsylvania Medical School. It comprises expressions spoken by 3 male and 4 female actors. The speech contents are neutral phrases like dates and numbers, e.g. "September fourth" or "eight hundred one", which are expressed in 14 emotional states (including anxiety, boredom, cold anger, hot anger, contempt, despair, disgust, elation, happiness, interest, panic, pride, sadness, and shame) as well as neutral state.
The number of utterances is approximately 2300. The histogram distribution of these samples for the emotions, speakers, and genders are shown in Fig. 5 The SVM classification method introduced in Section 3 is used to recognize the emotional states expressed in the speech samples extracted from the above database. The speech data are trained in speaker dependent training mode, in which the different characteristics of speech among the speakers are considered and an individual training process is hence carried out for each speaker. The database is divided into two parts, i.e. the training dataset and the testing dataset. Half of the data are employed to train the classifiers and the remainder are used for testing purpose.

Comparisons among different segmentation forms
It is reasonable that finer partition and larger overlap size tend to improve recognition accuracy. Computational complexity, however, should be considered in practical applications. In this experiment, we test the system with different segmentation forms, i.e. different segment sizes sf and different overlap sizes ∆. The segment size is first changed from 30 to 60 frames with a fixed overlap size of 20 frames. The numerical results are shown in Table 1, where the recognition accuracy in each emotion as well as the average accuracy is given. A trend of decreasing average accuracy is observed as the segment size is increased, which is illustrated in Fig. 6.  Fig. 6. Comparison of the average accuracies achieved with different segment sizes (ranging from 30 to 60) and a fixed overlap size of 20.
Secondly, the segment size is fixed to 40 and different overlap sizes ranging from 5 to 30 are used in the experiment. The recognition accuracies for all emotions are listed in Table 2. The trend of average accuracy with the increase of the overlap size is shown in Fig. 7 Fig. 7. Comparison of the average accuracies achieved with different overlap sizes (ranging from 5 to 30) and a fixed segment size of 40.

Comparisons among different feature sizes
This experiment aims to find the optimal dimensionality of the feature set. The segment size for calculating feature statistics is fixed with 40 = sf and 20 = Δ . The full feature set for each segment is a 792-dimensional vector as discussed in Section 2. The PCA is adopted to reduce feature dimensionality. The recognition accuracies achieved with different dimensionalities ranging from 300 to 20, as well as the full feature set with 792 features, are shown in Table 3. The average accuracies are illustrated in Fig. 8.   It can be seen from the figure that the average accuracy is not reduced even when the dimensionality of the feature vector is decreased from 792 to 250. The average accuracy is only decreased by 1.40% when the feature size is reduced to 150. This is only 18.94% of the size of the original full feature set. The recognition performance, however, is largely reduced when the feature size is lower than 150. The average accuracy is as low as 33.40% when there are only 20 parameters in a feature vector. It indicates that the classification performance is not deteriorated when the dimensionality of the feature vectors is reduced to a suitable value. The calculation complexity is also reduced with a decreased dimensionality.

Conclusion
The automatic recognition of emotional states from human speech has found a broad range of applications, and as such has drawn considerable attention and interest over the recent decade. Speech emotion recognition can be formulated as a standard pattern recognition problem and solved using machine learning technology. Specifically, feature extraction, processing and dimensionality reduction as well as pattern recognition have been discussed in this chapter. Three short time cepstral features, Linear Prediction-based Cepstral Coefficients (LPCC), Perceptual Linear Prediction (PLP) Cepstral Coefficients, and Mel-Frequency Cepstral Coefficients (MFCC), are used in our work to recognize speech emotions. Feature statistics are extracted based on speech segmentation for capturing longer time characteristics of speech signal. In order to reduce computational cost in classification, Principal Component Analysis (PCA) is employed for reducing feature dimensionality. The Support Vector Machine (SVM) is adopted as a classifier in emotion recognition system. The experiment in the classification of 15 emotional states for the samples extracted from the LDC database has been carried out. The recognition accuracies achieved with different segmentation forms and different feature set sizes are compared for speaker dependent training mode.