跳到主要导航 跳到搜索 跳到主要内容

Temporal difference learning to detect unsafe system states

  • Huazhong Ning
  • , Wei Xu
  • , Yue Zhou
  • , Yihong Gong
  • , Thomas Huang
  • University of Illinois at Urbana-Champaign
  • NEC Corporation

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

5 引用 (Scopus)

摘要

This paper proposes a general framework to detect unsafe states of a system whose basic realtime parameters are captured by multi-sensors. Our approach is to learn a danger level function which can be used to alert the users in advance of dangerous situations. The main challenge to this learning problem is the labelling issue, i.e., it is difficult to assign an objective danger level at each time step to the training data, except at the collapse points where a penalty can be assigned and at the successful ends where a certain reward can be assigned. In this paper, we treat the danger level as expected future reward (penalty is regarded as negative reward) and use temporal difference (TD) learning [2] to learn a function to approximate the expected future reward. The TD learning obtains the approximation by propagating the penalty/reward observable at collapse points or successful ends to the entire feature space following some constraints. Our approach is applied to, but not limited to, the application of monitoring of driving safety and the experimental results demonstrate the effectiveness of the approach.

源语言英语
主期刊名2008 19th International Conference on Pattern Recognition, ICPR 2008
出版状态已出版 - 2008
已对外发布是
活动2008 19th International Conference on Pattern Recognition, ICPR 2008 - Tampa, FL, 美国
期限: 8 12月 2008 → 11 12月 2008

丛书

姓名Proceedings - International Conference on Pattern Recognition
ISSN(印刷版)1051-4651

会议

会议2008 19th International Conference on Pattern Recognition, ICPR 2008
国家/地区美国
市Tampa, FL
时期8/12/08 → 11/12/08

学术指纹

探究 'Temporal difference learning to detect unsafe system states' 的科研主题。它们共同构成独一无二的学术指纹。

引用此