AutoHR: A Strong End-to-End Baseline for Remote Heart Rate Measurement with Neural Searching

  • Zitong Yu
  • , Xiaobai Li
  • , Xuesong Niu
  • , Jingang Shi
  • , Guoying Zhao

Research output: Contribution to journalArticlepeer-review

143 Scopus citations

Abstract

Remote photoplethysmography (rPPG), which aims at measuring heart activities without any contact, has great potential in many applications (e.g., remote healthcare). Existing end-to-end rPPG and heart rate (HR) measurement methods from facial videos are vulnerable to the less-constrained scenarios (e.g., with head movement and bad illumination). In this letter, we explore the reason why existing end-to-end networks perform poorly in challenging conditions and establish a strong end-to-end baseline (AutoHR) for remote HR measurement with neural architecture search (NAS). The proposed method includes three parts: 1) a powerful searched backbone with novel Temporal Difference Convolution (TDC), intending to capture intrinsic rPPG-aware clues between frames; 2) a hybrid loss function considering constraints from both time and frequency domains; and 3) spatio-temporal data augmentation strategies for better representation learning. Comprehensive experiments are performed on three benchmark datasets, and we achieved superior performance on both intra- and cross-dataset testings.

Original languageEnglish
Article number9133501
Pages (from-to)1245-1249
Number of pages5
JournalIEEE Signal Processing Letters
Volume27
DOIs
StatePublished - 2020

Keywords

  • heart rate
  • neural architecture search
  • RPPG

Fingerprint

Dive into the research topics of 'AutoHR: A Strong End-to-End Baseline for Remote Heart Rate Measurement with Neural Searching'. Together they form a unique fingerprint.

Cite this