UM
Hyperspectral Image Super-Resolution via Deep Progressive Zero-Centric Residual Learning
Zhu,Zhiyu1; Hou,Junhui1; Chen,Jie1; Zeng,Huanqiang2; Zhou,Jiantao3
2021
Source PublicationIEEE Transactions on Image Processing
ISSN1057-7149
Volume30Pages:1423-1438
AbstractThis paper explores the problem of hyperspectral image (HSI) super-resolution that merges a low resolution HSI (LR-HSI) and a high resolution multispectral image (HR-MSI). The cross-modality distribution of the spatial and spectral information makes the problem challenging. Inspired by the classic wavelet decomposition-based image fusion, we propose a novel lightweight deep neural network-based framework, namely progressive zero-centric residual network (PZRes-Net), to address this problem efficiently and effectively. Specifically, PZRes-Net learns a high resolution and zero-centric residual image, which contains high-frequency spatial details of the scene across all spectral bands, from both inputs in a progressive fashion along the spectral dimension. And the resulting residual image is then superimposed onto the up-sampled LR-HSI in a mean-value invariant manner, leading to a coarse HR-HSI, which is further refined by exploring the coherence across all spectral bands simultaneously. To learn the residual image efficiently and effectively, we employ spectral-spatial separable convolution with dense connections. In addition, we propose zero-mean normalization implemented on the feature maps of each layer to realize the zero-mean characteristic of the residual image. Extensive experiments over both real and synthetic benchmark datasets demonstrate that our PZRes-Net outperforms state-of-the-art methods to a significant extent in terms of both 4 quantitative metrics and visual quality, e.g., our PZRes-Net improves the PSNR more than 3dB, while saving 2.3\times parameters and consuming 15\times less FLOPs. The code is publicly available at https://github.com/zbzhzhy/PZRes-Net
Keywordcross-modality deep learning Hyperspectral imagery image fusion super-resolution zero-mean normalization
DOI10.1109/TIP.2020.3044214
URLView the original
Language英语
Fulltext Access
Citation statistics
Cited Times [WOS]:1   [WOS Record]     [Related Records in WOS]
Document TypeJournal article
CollectionUniversity of Macau
Corresponding AuthorHou,Junhui
Affiliation1.Department of Computer Science,City University of Hong Kong,Hong Kong,Hong Kong
2.School of Information Science and Engineering,Huaqiao University,Xiamen,China
3.Department of Computer and Information Science,University of Macau,Macau,Macao
Recommended Citation
GB/T 7714
Zhu,Zhiyu,Hou,Junhui,Chen,Jie,et al. Hyperspectral Image Super-Resolution via Deep Progressive Zero-Centric Residual Learning[J]. IEEE Transactions on Image Processing,2021,30:1423-1438.
APA Zhu,Zhiyu,Hou,Junhui,Chen,Jie,Zeng,Huanqiang,&Zhou,Jiantao.(2021).Hyperspectral Image Super-Resolution via Deep Progressive Zero-Centric Residual Learning.IEEE Transactions on Image Processing,30,1423-1438.
MLA Zhu,Zhiyu,et al."Hyperspectral Image Super-Resolution via Deep Progressive Zero-Centric Residual Learning".IEEE Transactions on Image Processing 30(2021):1423-1438.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Zhu,Zhiyu]'s Articles
[Hou,Junhui]'s Articles
[Chen,Jie]'s Articles
Baidu academic
Similar articles in Baidu academic
[Zhu,Zhiyu]'s Articles
[Hou,Junhui]'s Articles
[Chen,Jie]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Zhu,Zhiyu]'s Articles
[Hou,Junhui]'s Articles
[Chen,Jie]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.