A hybrid emotion recognition on android smart phones

Weishan Zhang; Xin Meng; Qinghua Lu; Yuan Rao; Jiehan Zhou

doi:10.1109/GreenCom-iThings-CPSCom.2013.228

A hybrid emotion recognition on android smart phones

Weishan Zhang
, Xin Meng
, Qinghua Lu
, Yuan Rao
, Jiehan Zhou

Faculty of Electronic and Information Engineering

China University of Petroleum (East China)
CSIRO
University of Oulu

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

6 Scopus citations

Abstract

Awareness of emotion status of people is fairly important for aged ones, the ones with sub-health status, and various patients in order to keep them in good mood. The emotion recognition at run time is intrinsically challenging due to its complexity nature. On the one hand, the awareness of human emotion should be achieved as non-intrusive as possible. On the other hand, the android smart phones on the market are increasingly popular which are equipped with various sensors that can be used to achieve the awareness of emotion status. In this paper, we propose an approach based on the heart beat rate and contents of user's talk, which are obtained from built-in camera and microphone on smart phones. We first classify anger, joy, normal, and sadness based on heart rates, then the emotion recognition is further improved by emotional key words in a talk. We have evaluated this approach in terms of recognition accuracy and power consumption found that the accuracy can achieve 84.7%.

Original language	English
Title of host publication	Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013
Pages	1313-1318
Number of pages	6
DOIs	https://doi.org/10.1109/GreenCom-iThings-CPSCom.2013.228
State	Published - 2013
Event	2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013 - Beijing, China Duration: 20 Aug 2013 → 23 Aug 2013

Publication series

Name	Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013

Conference

Conference	2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013
Country/Territory	China
City	Beijing
Period	20/08/13 → 23/08/13

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 3 Good Health and Well-being

Keywords

Emotion recognition
Physiological signals
Speech recognition

Access to Document

10.1109/GreenCom-iThings-CPSCom.2013.228

Cite this

Zhang, W., Meng, X., Lu, Q., Rao, Y., & Zhou, J. (2013). A hybrid emotion recognition on android smart phones. In Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013 (pp. 1313-1318). Article 6682241 (Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013). https://doi.org/10.1109/GreenCom-iThings-CPSCom.2013.228

Zhang, Weishan ; Meng, Xin ; Lu, Qinghua et al. / A hybrid emotion recognition on android smart phones. Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013. 2013. pp. 1313-1318 (Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013).

@inproceedings{7bab66f5b19d4758a179772e59c6a45a,

title = "A hybrid emotion recognition on android smart phones",

abstract = "Awareness of emotion status of people is fairly important for aged ones, the ones with sub-health status, and various patients in order to keep them in good mood. The emotion recognition at run time is intrinsically challenging due to its complexity nature. On the one hand, the awareness of human emotion should be achieved as non-intrusive as possible. On the other hand, the android smart phones on the market are increasingly popular which are equipped with various sensors that can be used to achieve the awareness of emotion status. In this paper, we propose an approach based on the heart beat rate and contents of user's talk, which are obtained from built-in camera and microphone on smart phones. We first classify anger, joy, normal, and sadness based on heart rates, then the emotion recognition is further improved by emotional key words in a talk. We have evaluated this approach in terms of recognition accuracy and power consumption found that the accuracy can achieve 84.7\%.",

keywords = "Emotion recognition, Physiological signals, Speech recognition",

author = "Weishan Zhang and Xin Meng and Qinghua Lu and Yuan Rao and Jiehan Zhou",

year = "2013",

doi = "10.1109/GreenCom-iThings-CPSCom.2013.228",

language = "英语",

isbn = "9780769550466",

series = "Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013",

pages = "1313--1318",

booktitle = "Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013",

note = "2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013 ; Conference date: 20-08-2013 Through 23-08-2013",

}

Zhang, W, Meng, X, Lu, Q, Rao, Y & Zhou, J 2013, A hybrid emotion recognition on android smart phones. in Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013., 6682241, Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013, pp. 1313-1318, 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013, Beijing, China, 20/08/13. https://doi.org/10.1109/GreenCom-iThings-CPSCom.2013.228

A hybrid emotion recognition on android smart phones. / Zhang, Weishan; Meng, Xin; Lu, Qinghua et al.
Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013. 2013. p. 1313-1318 6682241 (Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - A hybrid emotion recognition on android smart phones

AU - Zhang, Weishan

AU - Meng, Xin

AU - Lu, Qinghua

AU - Rao, Yuan

AU - Zhou, Jiehan

PY - 2013

Y1 - 2013

N2 - Awareness of emotion status of people is fairly important for aged ones, the ones with sub-health status, and various patients in order to keep them in good mood. The emotion recognition at run time is intrinsically challenging due to its complexity nature. On the one hand, the awareness of human emotion should be achieved as non-intrusive as possible. On the other hand, the android smart phones on the market are increasingly popular which are equipped with various sensors that can be used to achieve the awareness of emotion status. In this paper, we propose an approach based on the heart beat rate and contents of user's talk, which are obtained from built-in camera and microphone on smart phones. We first classify anger, joy, normal, and sadness based on heart rates, then the emotion recognition is further improved by emotional key words in a talk. We have evaluated this approach in terms of recognition accuracy and power consumption found that the accuracy can achieve 84.7%.

AB - Awareness of emotion status of people is fairly important for aged ones, the ones with sub-health status, and various patients in order to keep them in good mood. The emotion recognition at run time is intrinsically challenging due to its complexity nature. On the one hand, the awareness of human emotion should be achieved as non-intrusive as possible. On the other hand, the android smart phones on the market are increasingly popular which are equipped with various sensors that can be used to achieve the awareness of emotion status. In this paper, we propose an approach based on the heart beat rate and contents of user's talk, which are obtained from built-in camera and microphone on smart phones. We first classify anger, joy, normal, and sadness based on heart rates, then the emotion recognition is further improved by emotional key words in a talk. We have evaluated this approach in terms of recognition accuracy and power consumption found that the accuracy can achieve 84.7%.

KW - Emotion recognition

KW - Physiological signals

KW - Speech recognition

UR - https://www.scopus.com/pages/publications/84893492907

U2 - 10.1109/GreenCom-iThings-CPSCom.2013.228

DO - 10.1109/GreenCom-iThings-CPSCom.2013.228

M3 - 会议稿件

AN - SCOPUS:84893492907

SN - 9780769550466

T3 - Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013

SP - 1313

EP - 1318

BT - Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013

T2 - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013

Y2 - 20 August 2013 through 23 August 2013

ER -

Zhang W, Meng X, Lu Q, Rao Y, Zhou J. A hybrid emotion recognition on android smart phones. In Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013. 2013. p. 1313-1318. 6682241. (Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013). doi: 10.1109/GreenCom-iThings-CPSCom.2013.228

A hybrid emotion recognition on android smart phones

Abstract

Publication series

Conference

UN SDGs

Keywords

Access to Document

Other files and links

Fingerprint

Cite this