UM
Substructural Regularization With Data-Sensitive Granularity for Sequence Transfer Learning
Sun, Shichang; Liu, Hongbo; Meng, Jiana; Chen, C. L. Philip; Yang, Yu
2018-06
Source PublicationIEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS
ISSN2162-237X
Volume29Issue:6Pages:2545-2557
AbstractSequence transfer learning is of interest in both academia and industry with the emergence of numerous new text domains from Twitter and other social media tools. In this paper, we put forward the data-sensitive granularity for transfer learning, and then, a novel substructural regularization transfer learning model (STLM) is proposed to preserve target domain features at substructural granularity in the light of the condition of labeled data set size. Our model is underpinned by hidden Markov model and regularization theory, where the substructural representation can be integrated as a penalty after measuring the dissimilarity of substructures between target domain and STLM with relative entropy. STLM can achieve the competing goals of preserving the target domain substructure and utilizing the observations from both the target and source domains simultaneously. The estimation of STLM is very efficient since an analytical solution can be derived as a necessary and sufficient condition. The relative usability of substructures to act as regularization parameters and the time complexity of STLM are also analyzed and discussed. Comprehensive experiments of part-of-speech tagging with both Brown and Twitter corpora fully justify that our model can make improvements on all the combinations of source and target domains.
KeywordData-sensitive granularity hidden Markov model (HMM) relative entropy (RE) sequence transfer learning substructural regularization
DOI10.1109/TNNLS.2016.2638321
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaComputer Science ; Engineering
WOS SubjectComputer Science, Artificial Intelligence ; Computer Science, Hardware & Architecture ; Computer Science, Theory & Methods ; Engineering, Electrical & Electronic
WOS IDWOS:000432398300040
PublisherIEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
The Source to ArticleWOS
Fulltext Access
Citation statistics
Cited Times [WOS]:5   [WOS Record]     [Related Records in WOS]
Document TypeJournal article
CollectionUniversity of Macau
Recommended Citation
GB/T 7714
Sun, Shichang,Liu, Hongbo,Meng, Jiana,et al. Substructural Regularization With Data-Sensitive Granularity for Sequence Transfer Learning[J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS,2018,29(6):2545-2557.
APA Sun, Shichang,Liu, Hongbo,Meng, Jiana,Chen, C. L. Philip,&Yang, Yu.(2018).Substructural Regularization With Data-Sensitive Granularity for Sequence Transfer Learning.IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS,29(6),2545-2557.
MLA Sun, Shichang,et al."Substructural Regularization With Data-Sensitive Granularity for Sequence Transfer Learning".IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 29.6(2018):2545-2557.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Sun, Shichang]'s Articles
[Liu, Hongbo]'s Articles
[Meng, Jiana]'s Articles
Baidu academic
Similar articles in Baidu academic
[Sun, Shichang]'s Articles
[Liu, Hongbo]'s Articles
[Meng, Jiana]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Sun, Shichang]'s Articles
[Liu, Hongbo]'s Articles
[Meng, Jiana]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.