Domain Incremental Object Detection Based on Feature Space Topology Preserving Strategy

Research output: Contribution to journalArticlepeer-review

9 Scopus citations

Abstract

Object detection with the capacity to incrementally adapt to new domains is a crucial yet relatively under-explored research topic. The catastrophic forgetting problem presents a significant challenge to achieve this goal, where the model's performance improves quickly in new conditions but deteriorates sharply in old ones after several incremental learning sessions. Drawing on recent discoveries in visual memories of the human brain, we introduce the Topology-Preserving Domain Incremental Object Detection (TP-DIOD) approach, which aims to address the catastrophic forgetting problem by extracting the topological structure of the feature space learned by the Convolutional Neural Network (CNN) model and preserving this topology during the subsequent incremental learning sessions. Specifically, we model the feature space topology using the self-organizing map (SOM) and construct an anchor image set based on the centroid vectors of the SOM nodes to memorize the feature space topology. We then develop the anchor loss function to penalize the topological changes of the feature space during the subsequent incremental learning sessions. Experimental evaluations on two sets of datasets demonstrate the effectiveness of the proposed TP-DIOD method in mitigating the catastrophic forgetting problem and achieving high accuracy on both old and new domain datasets.

Original languageEnglish
Pages (from-to)424-437
Number of pages14
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume34
Issue number1
DOIs
StatePublished - 1 Jan 2024

Keywords

  • Topology-preserving
  • domain incremental
  • object detection

Fingerprint

Dive into the research topics of 'Domain Incremental Object Detection Based on Feature Space Topology Preserving Strategy'. Together they form a unique fingerprint.

Cite this