Skip to main navigation Skip to search Skip to main content

MDFP-Net: A Model-Driven Deep Neural Network for Fourier Ptychography

  • Baopeng Li
  • , Qi Xie
  • , Caiwen Ma
  • , Zhibin Pan
  • , Mingyang Yang
  • , Hui Zhao
  • , Wei Gao
  • , Xuewu Fan
  • , Deyu Meng
  • CAS - Xi'an Institute of Optics and Precision Mechanics
  • Xi'an Jiaotong University
  • University of Chinese Academy of Sciences

Research output: Contribution to journalArticlepeer-review

2 Scopus citations

Abstract

Fourier ptychography (FP) is a new computational imaging technique with the advantage of being able to provide super-resolution imaging. FP has a very complex degradation process. Merging with Fourier transforms and pupil aperture scanning causes difficulty in reconstructing high-resolution images by the commonly used deep neural network methods, e.g., based on convolutional neural networks (CNNs). In this paper, we propose a new optimization algorithm for FP, which is carefully designed so that it only constrains concise operations. Then, we unfold the proposed algorithm to design a new neural network, MDFP-Net, specifically for the FP task. MDFP-Net is consistent with a few stages, which well corresponds to the iterations of the proposed optimization algorithm for FP. This not only makes MDFP-Net more intuitively interpretable, but also makes MDFP-Net much more suitable for FP tasks than commonly used CNNs. Moreover, we have built a long-distance reflection FP measurement system and tested our neural network in real experiments. Simulation and real experimental results show that the proposed network can provide better reconstruction results than either traditional algorithms or other deep learning methods. Code is available at https://github.com/BP113/MDFPNET.

Original languageEnglish
Pages (from-to)1059-1077
Number of pages19
JournalComputational Visual Media
Volume11
Issue number5
DOIs
StatePublished - 2025

Keywords

  • Fourier ptychography (FP)
  • image super-resolution
  • interpretable deep learning
  • phase retrieval

Fingerprint

Dive into the research topics of 'MDFP-Net: A Model-Driven Deep Neural Network for Fourier Ptychography'. Together they form a unique fingerprint.

Cite this