跳到主要导航 跳到搜索 跳到主要内容

A Real 3D Embodied Dataset for Robotic Active Visual Learning

  • Qianfan Zhao
  • , Lu Zhang
  • , Lingxi Wu
  • , Hong Qiao
  • , Zhiyong Liu
  • CAS - Institute of Automation
  • University of Chinese Academy of Sciences
  • University of California at Santa Barbara

科研成果: 期刊稿件 › 文章 › 同行评审

21 引用 (Scopus)

摘要

Active interaction with environments is one of the striking characteristics of robotic active vision, which allows robots to move to facilitate visual tasks. Recently, several embodied AI platforms have been proposed as the synthetic environments to study robotic active vision, without needing to interact in real world. However, by using synthetic data, model trained on these platforms will suffer performance degradation when applied in reality. In this letter, a real 3D embodied dataset is proposed for robotic active visual learning. The proposed dataset consists of real point cloud data densely collected in 7 real-world indoor scenes. In our embodied dataset, researchers are able to simulate the movements and interactions of robots in indoor environments and obtain real visual data, which will not lead to performance degradation in reality. Furthermore, we proposed a 3D divergency policy that can guide robots to move and collect data to improve visual performance in novel environments. The proposed policy is designed following a simple fact: a good 3D detector should produce consistent 3D detection results for the same object from different viewpoints. Therefore, our policy encourages the robot to explore the area where the detector generates different 3D bounding boxes for the same object and helps the robot improve its visual performance in novel scenes.

源语言英语
页(从-至)6646-6652
页数7
期刊IEEE Robotics and Automation Letters
卷7
期3
DOI
出版状态已出版 - 1 7月 2022
已对外发布是

学术指纹

探究 'A Real 3D Embodied Dataset for Robotic Active Visual Learning' 的科研主题。它们共同构成独一无二的学术指纹。

引用此