跳到主要导航 跳到搜索 跳到主要内容

Cross-Frequency Implicit Neural Representation with Self-Evolving Parameters

  • Xi'an Jiaotong University
  • University of Electronic Science and Technology of China

科研成果: 期刊稿件文章同行评审

摘要

Implicit neural representation (INR) has emerged as a powerful paradigm for visual data representation. However, classical INR methods represent data in the original space mixed with different frequency components, and several feature encoding parameters (e.g., the frequency parameter \omega or the rank R) need manual configurations. In this work, we propose a self-evolving cross-frequency INR using the Haar wavelet transform (termed CF-INR), which decouples data into four frequency components and employs INRs in the wavelet space. CF-INR allows the characterization of different frequency components separately, thus enabling higher accuracy for data representation. To more precisely characterize cross-frequency components, we propose a cross-frequency tensor decomposition paradigm for CF-INR with self-evolving parameters, which automatically updates the rank parameter R and the frequency parameter \omega for each frequency component through self-evolving optimization. This self-evolution paradigm eliminates the laborious manual tuning of these parameters, and learns a customized cross-frequency feature encoding configuration for each dataset. We evaluate CF-INR on a variety of visual data representation and inverse imaging problems, including image regression, inpainting, denoising, and cloud removal. Extensive experiments demonstrate that CF-INR outperforms state-of-the-art methods in each case.

学术指纹

探究 'Cross-Frequency Implicit Neural Representation with Self-Evolving Parameters' 的科研主题。它们共同构成独一无二的指纹。

引用此