UM
Improving the Harmony of the Composite Image by Spatial-Separated Attention Module
Cun,Xiaodong; Pun,Chi Man
2020
Source PublicationIEEE Transactions on Image Processing
ISSN1057-7149
Volume29Pages:4759-4771
AbstractImage composition is one of the most important applications in image processing. However, the inharmonious appearance between the spliced region and background degrade the quality of the image. Thus, we address the problem of Image Harmonization: Given a spliced image and the mask of the spliced region, we try to harmonize the 'style' of the pasted region with the background (non-spliced region). Previous approaches have been focusing on learning directly by the neural network. In this work, we start from an empirical observation: the differences can only be found in the spliced region between the spliced image and the harmonized result while they share the same semantic information and the appearance in the non-spliced region. Thus, in order to learn the feature map in the masked region and the others individually, we propose a novel attention module named Spatial-Separated Attention Module (SAM). Furthermore, we design a novel image harmonization framework by inserting the SAM in the coarser low-level features of the Unet structure by two different ways. Besides image harmonization, we make a big step for harmonizing the composite image without the specific mask under previous observation. The experiments show that the proposed SAM performs better than other state-of-the-art attention modules in our task. Moreover, we demonstrate the advantages of our model against other state-of-the-art image harmonization methods via criteria from multiple points of view.
Keywordattention mechanism Image harmonization image synthesis
DOI10.1109/TIP.2020.2975979
URLView the original
Language英语
Fulltext Access
Citation statistics
Cited Times [WOS]:0   [WOS Record]     [Related Records in WOS]
Document TypeJournal article
CollectionUniversity of Macau
Corresponding AuthorCun,Xiaodong
AffiliationDepartment of Computer and Information Science,University of Macau,Taipa,Macao
First Author AffilicationUniversity of Macau
Corresponding Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Cun,Xiaodong,Pun,Chi Man. Improving the Harmony of the Composite Image by Spatial-Separated Attention Module[J]. IEEE Transactions on Image Processing,2020,29:4759-4771.
APA Cun,Xiaodong,&Pun,Chi Man.(2020).Improving the Harmony of the Composite Image by Spatial-Separated Attention Module.IEEE Transactions on Image Processing,29,4759-4771.
MLA Cun,Xiaodong,et al."Improving the Harmony of the Composite Image by Spatial-Separated Attention Module".IEEE Transactions on Image Processing 29(2020):4759-4771.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Cun,Xiaodong]'s Articles
[Pun,Chi Man]'s Articles
Baidu academic
Similar articles in Baidu academic
[Cun,Xiaodong]'s Articles
[Pun,Chi Man]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Cun,Xiaodong]'s Articles
[Pun,Chi Man]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.