Skip to main navigation Skip to search Skip to main content

Select and focus: Action recognition with spatial-temporal attention

  • Xi'an Jiaotong University
  • Xi'an Aeronautical University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

With the rapid development of neural networks, human action recognition has been achieved great improvement by using convolutional neural networks (CNN) or recurrent neural networks (RNN). In this paper, we propose a model based on weighted spatial-temporal attention for action recognition. This model selects the key parts in each video frame and important frames in each video sequence. Then the model focuses on analyzing these key parts and frames. Therefore, the most important tasks of our model is to find out the key parts spatially and the important frames temporally for recognizing the action. Our model is trained and tested on three datasets including UCF-11, UCF-101, and HMDB51. The experiments demonstrate that our model can achieve a satisfactory result for human action recognition.

Original languageEnglish
Title of host publicationIntelligent Robotics and Applications - 12th International Conference, ICIRA 2019, Proceedings
EditorsHaibin Yu, Jinguo Liu, Lianqing Liu, Yuwang Liu, Zhaojie Ju, Dalin Zhou
PublisherSpringer Verlag
Pages461-471
Number of pages11
ISBN (Print)9783030275341
DOIs
StatePublished - 2019
Event12th International Conference on Intelligent Robotics and Applications, ICIRA 2019 - Shenyang, China
Duration: 8 Aug 201911 Aug 2019

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11742 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference12th International Conference on Intelligent Robotics and Applications, ICIRA 2019
Country/TerritoryChina
CityShenyang
Period8/08/1911/08/19

Keywords

  • Attention
  • Deep learning
  • Human action recognition

Fingerprint

Dive into the research topics of 'Select and focus: Action recognition with spatial-temporal attention'. Together they form a unique fingerprint.

Cite this