A hybrid emotion recognition on android smart phones

Weishan Zhang; Xin Meng; Qinghua Lu; Yuan Rao; Jiehan Zhou

doi:10.1109/GreenCom-iThings-CPSCom.2013.228

A hybrid emotion recognition on android smart phones

Weishan Zhang
, Xin Meng
, Qinghua Lu
, Yuan Rao
, Jiehan Zhou

电子与信息学部

China University of Petroleum (East China)
CSIRO
University of Oulu

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

6 引用（Scopus）

摘要

Awareness of emotion status of people is fairly important for aged ones, the ones with sub-health status, and various patients in order to keep them in good mood. The emotion recognition at run time is intrinsically challenging due to its complexity nature. On the one hand, the awareness of human emotion should be achieved as non-intrusive as possible. On the other hand, the android smart phones on the market are increasingly popular which are equipped with various sensors that can be used to achieve the awareness of emotion status. In this paper, we propose an approach based on the heart beat rate and contents of user's talk, which are obtained from built-in camera and microphone on smart phones. We first classify anger, joy, normal, and sadness based on heart rates, then the emotion recognition is further improved by emotional key words in a talk. We have evaluated this approach in terms of recognition accuracy and power consumption found that the accuracy can achieve 84.7%.

源语言	英语
主期刊名	Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013
页	1313-1318
页数	6
DOI	https://doi.org/10.1109/GreenCom-iThings-CPSCom.2013.228
出版状态	已出版 - 2013
活动	2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013 - Beijing, 中国期限: 20 8月 2013 → 23 8月 2013

出版系列

姓名	Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013

会议

会议	2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013
国家/地区	中国
市	Beijing
时期	20/08/13 → 23/08/13

联合国可持续发展目标

此成果有助于实现下列可持续发展目标：

可持续发展目标 3 良好健康与福祉

访问文件

10.1109/GreenCom-iThings-CPSCom.2013.228

其它文件与链接

链接到 Scopus 的出版物

引用此

Zhang, W., Meng, X., Lu, Q., Rao, Y., & Zhou, J. (2013). A hybrid emotion recognition on android smart phones. 在 Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013 (页码 1313-1318). 文章 6682241 (Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013). https://doi.org/10.1109/GreenCom-iThings-CPSCom.2013.228

Zhang, Weishan ; Meng, Xin ; Lu, Qinghua 等. / A hybrid emotion recognition on android smart phones. Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013. 2013. 页码 1313-1318 (Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013).

@inproceedings{7bab66f5b19d4758a179772e59c6a45a,

title = "A hybrid emotion recognition on android smart phones",

abstract = "Awareness of emotion status of people is fairly important for aged ones, the ones with sub-health status, and various patients in order to keep them in good mood. The emotion recognition at run time is intrinsically challenging due to its complexity nature. On the one hand, the awareness of human emotion should be achieved as non-intrusive as possible. On the other hand, the android smart phones on the market are increasingly popular which are equipped with various sensors that can be used to achieve the awareness of emotion status. In this paper, we propose an approach based on the heart beat rate and contents of user's talk, which are obtained from built-in camera and microphone on smart phones. We first classify anger, joy, normal, and sadness based on heart rates, then the emotion recognition is further improved by emotional key words in a talk. We have evaluated this approach in terms of recognition accuracy and power consumption found that the accuracy can achieve 84.7\%.",

keywords = "Emotion recognition, Physiological signals, Speech recognition",

author = "Weishan Zhang and Xin Meng and Qinghua Lu and Yuan Rao and Jiehan Zhou",

year = "2013",

doi = "10.1109/GreenCom-iThings-CPSCom.2013.228",

language = "英语",

isbn = "9780769550466",

series = "Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013",

pages = "1313--1318",

booktitle = "Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013",

note = "2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013 ; Conference date: 20-08-2013 Through 23-08-2013",

}

Zhang, W, Meng, X, Lu, Q, Rao, Y & Zhou, J 2013, A hybrid emotion recognition on android smart phones. 在 Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013., 6682241, Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013, 页码 1313-1318, 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013, Beijing, 中国, 20/08/13. https://doi.org/10.1109/GreenCom-iThings-CPSCom.2013.228

A hybrid emotion recognition on android smart phones. / Zhang, Weishan; Meng, Xin; Lu, Qinghua 等.
Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013. 2013. 页码 1313-1318 6682241 (Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013).

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

TY - GEN

T1 - A hybrid emotion recognition on android smart phones

AU - Zhang, Weishan

AU - Meng, Xin

AU - Lu, Qinghua

AU - Rao, Yuan

AU - Zhou, Jiehan

PY - 2013

Y1 - 2013

N2 - Awareness of emotion status of people is fairly important for aged ones, the ones with sub-health status, and various patients in order to keep them in good mood. The emotion recognition at run time is intrinsically challenging due to its complexity nature. On the one hand, the awareness of human emotion should be achieved as non-intrusive as possible. On the other hand, the android smart phones on the market are increasingly popular which are equipped with various sensors that can be used to achieve the awareness of emotion status. In this paper, we propose an approach based on the heart beat rate and contents of user's talk, which are obtained from built-in camera and microphone on smart phones. We first classify anger, joy, normal, and sadness based on heart rates, then the emotion recognition is further improved by emotional key words in a talk. We have evaluated this approach in terms of recognition accuracy and power consumption found that the accuracy can achieve 84.7%.

AB - Awareness of emotion status of people is fairly important for aged ones, the ones with sub-health status, and various patients in order to keep them in good mood. The emotion recognition at run time is intrinsically challenging due to its complexity nature. On the one hand, the awareness of human emotion should be achieved as non-intrusive as possible. On the other hand, the android smart phones on the market are increasingly popular which are equipped with various sensors that can be used to achieve the awareness of emotion status. In this paper, we propose an approach based on the heart beat rate and contents of user's talk, which are obtained from built-in camera and microphone on smart phones. We first classify anger, joy, normal, and sadness based on heart rates, then the emotion recognition is further improved by emotional key words in a talk. We have evaluated this approach in terms of recognition accuracy and power consumption found that the accuracy can achieve 84.7%.

KW - Emotion recognition

KW - Physiological signals

KW - Speech recognition

UR - https://www.scopus.com/pages/publications/84893492907

U2 - 10.1109/GreenCom-iThings-CPSCom.2013.228

DO - 10.1109/GreenCom-iThings-CPSCom.2013.228

M3 - 会议稿件

AN - SCOPUS:84893492907

SN - 9780769550466

T3 - Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013

SP - 1313

EP - 1318

BT - Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013

T2 - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013

Y2 - 20 August 2013 through 23 August 2013

ER -

Zhang W, Meng X, Lu Q, Rao Y, Zhou J. A hybrid emotion recognition on android smart phones. 在 Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013. 2013. 页码 1313-1318. 6682241. (Proceedings - 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, GreenCom-iThings-CPSCom 2013). doi: 10.1109/GreenCom-iThings-CPSCom.2013.228

A hybrid emotion recognition on android smart phones

摘要

出版系列

会议

联合国可持续发展目标

访问文件

其它文件与链接

学术指纹

引用此