Skip to main navigation Skip to search Skip to main content

A linear online guided policy search algorithm

  • Biao Sun
  • , Fangzhou Xiong
  • , Zhiyong Liu
  • , Xu Yang
  • , Hong Qiao
  • University of Science and Technology Beijing
  • CAS - Institute of Automation
  • University of Chinese Academy of Sciences
  • CAS Center for Excellence in Brain Science and Intelligence Technology
  • Chinese Academy of Sciences

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Scopus citations

Abstract

In reinforcement learning (RL), the guided policy search (GPS), a variant of policy search method, can encode the policy directly as well as search for optimal solutions in the policy space. Even though this algorithm is provided with asymptotic local convergence guarantees, it can not work in a online way for conducting tasks in complex environments since it is trained with a batch manner which requires that all of the training samples should be given at the same time. In this paper, we propose an online version for GPS algorithm, which can learn policies incrementally without complete knowledge of initial positions for training. The experiments witness its efficacy on handling sequentially arriving training samples in a peg insertion task.

Original languageEnglish
Title of host publicationNeural Information Processing - 24th International Conference, ICONIP 2017, Proceedings
EditorsDongbin Zhao, Yuanqing Li, El-Sayed M. El-Alfy, Derong Liu, Shengli Xie
PublisherSpringer Verlag
Pages434-441
Number of pages8
ISBN (Print)9783319701387
DOIs
StatePublished - 2017
Externally publishedYes
Event24th International Conference on Neural Information Processing, ICONIP 2017 - Guangzhou, China
Duration: 14 Nov 2017 → 18 Nov 2017

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10638 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference24th International Conference on Neural Information Processing, ICONIP 2017
Country/TerritoryChina
CityGuangzhou
Period14/11/17 → 18/11/17

Keywords

  • Online learning
  • Policy search
  • Reinforcement learning

Fingerprint

Dive into the research topics of 'A linear online guided policy search algorithm'. Together they form a unique fingerprint.

Cite this