跳到主要导航 跳到搜索 跳到主要内容

CMDS-AD: Cross-Modal Dual-Stream Decoupling for Few-Shot Anomaly Detection

  • Junhao Cai
  • , Junyu Chen
  • , Deyu Zeng
  • , Junhao Pang
  • , Qiwei Liang
  • , Xiaopin Zhong
  • , Zongze Wu
  • Shenzhen University
  • Guangzhou Maritime University
  • The Hong Kong University of Science and Technology (Guangzhou)

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

摘要

Few-shot anomaly detection remains challenging due to limited training data. Multi-modal anomaly detection (MAD) offers a viable solution, leveraging 3D geometric cues to enrich 2D RGB representations and compensate for this scarcity. However, existing MAD methods apply spatially uniform feature processing, conflating stable macroscopic structures with high-frequency localized defect signals, exacerbating cross-modal misalignment and inflating false-positive rates. To overcome this, we present CMDS-AD, a Cross-Modal Dual-Stream Anomaly Detection framework. A LoRA-guided diffusion model generates diverse RGB samples to mitigate extreme data scarcity. For 3D normal augmentation, we employ a pre-trained diffusion model as a normal estimator. Crucially, this estimator inherently acts as a non-linear low-pass filter, directly extracting low-frequency normal representations from RGB inputs. This establishes an auxiliary estimated stream of purely low-frequency information, anchoring robust structural templates and assisting the uncompressed real stream, containing coupled high- and low-frequency components, to precisely isolate micro-defects. A Coordinate-Aware Hierarchical Feature Mapper adaptively aligns cross-modal semantics, while a multiplicative scoring mechanism filters modality-specific noise. Under the extreme 1-shot setting, CMDS-AD achieves absolute performance gains of 5.7% (I-AUROC) and 2.0% (AUPRO) on MVTec 3D-AD, alongside 7.7% and 5.6% improvements on EyeCandies, establishing a new state-of-the-art. Code is available at Junhaocai27/CMDS-AD.

源语言英语
主期刊名Computer Vision – ECCV 2026 - 19th European Conference, 2026, Proceedings
编辑Paolo Favaro, Zuzana Kukelova, Atsuto Maki, Anna Rohrbach, Konrad Schindler, Federico Tombari
出版商Springer Science and Business Media Deutschland GmbH
页431-448
页数18
ISBN(印刷版)9783032370150
DOI
出版状态已出版 - 2026
已对外发布是
活动19th European Conference on Computer Vision, ECCV 2026 - Malmö, 瑞典
期限: 8 9月 2026 → 12 9月 2026

丛书

姓名Lecture Notes in Computer Science
卷17071 LNCS
ISSN(印刷版)0302-9743
ISSN(电子版)1611-3349

会议

会议19th European Conference on Computer Vision, ECCV 2026
国家/地区瑞典
市Malmö
时期8/09/26 → 12/09/26

学术指纹

探究 'CMDS-AD: Cross-Modal Dual-Stream Decoupling for Few-Shot Anomaly Detection' 的科研主题。它们共同构成独一无二的学术指纹。

引用此