TY - JOUR
T1 - VDMamba
T2 - Vector Decomposition in Vision Mamba for Image Deraining and Beyond
AU - Jiang, Kui
AU - Jiang, Junjun
AU - Wang, Shiqi
AU - Ren, Wenqi
AU - Lin, Chia Wen
AU - Li, Zhengguo
N1 - Publisher Copyright:
© 1999-2012 IEEE. All rights reserved.
PY - 2026
Y1 - 2026
N2 - Recent research employs Mamba for image restoration, yet the intrinsic coupling between deraining characteristics and Mamba architectures remains underexplored. We propose VDMamba, a vector decomposition-based vision Mamba approach that leverages 1D sequential representations to characterize direction-aware rain distributions in the frequency embedding space. The core innovation is the Mamba-based Vector Decomposition and Synthesis Module (VDSM). VDSM derives vertical and horizontal 1D vectors from frequency components and utilizes single-direction Mamba scanning to eliminate direction-specific perturbations. This enables the exploration of global relationships for accurate learning without complex scanning designs. Additionally, these components are encoded via bidirectional coupling for refinement. Experiments on various tasks, including deraining, dehazing, and low-light enhancement, demonstrate VDMamba’s competitive performance. Specifically, it achieves a 0.58 dB PSNR improvement in deraining compared to the NeRD method, while reducing model parameters by 94.3%, computational cost by 88.3%, and inference time by 77.5%.
AB - Recent research employs Mamba for image restoration, yet the intrinsic coupling between deraining characteristics and Mamba architectures remains underexplored. We propose VDMamba, a vector decomposition-based vision Mamba approach that leverages 1D sequential representations to characterize direction-aware rain distributions in the frequency embedding space. The core innovation is the Mamba-based Vector Decomposition and Synthesis Module (VDSM). VDSM derives vertical and horizontal 1D vectors from frequency components and utilizes single-direction Mamba scanning to eliminate direction-specific perturbations. This enables the exploration of global relationships for accurate learning without complex scanning designs. Additionally, these components are encoded via bidirectional coupling for refinement. Experiments on various tasks, including deraining, dehazing, and low-light enhancement, demonstrate VDMamba’s competitive performance. Specifically, it achieves a 0.58 dB PSNR improvement in deraining compared to the NeRD method, while reducing model parameters by 94.3%, computational cost by 88.3%, and inference time by 77.5%.
KW - Image deraining
KW - Mamba
KW - mutual representation
KW - vector decomposition and synthesis
UR - https://www.scopus.com/pages/publications/105028729052
U2 - 10.1109/TMM.2026.3651113
DO - 10.1109/TMM.2026.3651113
M3 - 文章
AN - SCOPUS:105028729052
SN - 1520-9210
VL - 28
SP - 3339
EP - 3352
JO - IEEE Transactions on Multimedia
JF - IEEE Transactions on Multimedia
ER -