UM
Linguistic Knowledge-Aware Neural Machine Translation
Li, Qiang; Wong, Derek F.; Chao, Lidia S.; Zhu, Muhua; Xiao, Tong; Zhu, Jingbo; Zhang, Min
2018-12
Source PublicationIEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING
ISSN2329-9290
Volume26Issue:12Pages:2341-2354
AbstractRecently, researchers have shown an increasing interest in incorporating linguistic knowledge into neural machine translation (NMT). To this end, previous works choose either to alter the architecture of NMT encoder to incorporate syntactic information into the translation model, or to generalize the embedding layer of the encoder to encode additional linguistic features. The former approach mainly focuses on injecting the syntactic structure of the source sentence into the encoding process, leading to a complicated model that lacks the flexibility to incorporate other types of knowledge. The latter extends word embeddings by considering additional linguistic knowledge as features to enrich the word representation. It thus does not explicitly balance the contribution from word embeddings and the contribution from additional linguistic knowledge. To address these limitations, this paper proposes a knowledge-aware NMT approach that models additional linguistic features in parallel to the word feature. The core idea is that we propose modeling a series of linguistic features at the word level (knowledge block) using a recurrent neural network (RNN). And in sentence level, those word-corresponding feature blocks are further encoded using a RNN encoder. In decoding, we propose a knowledge gate and an attention gate to dynamically control the proportions of information contributing to the generation of target words from different sources. Extensive experiments show that our approach is capable of better accounting for importance of additional linguistic, and we observe significant improvements from 1.0 to 2.3 BLEU points on Chinese <-> English and English -> German translation tasks.
KeywordAttention gate knowledge block knowledge gate neural machine translation (NMT)
DOI10.1109/TASLP.2018.2864648
URLView the original
Indexed BySCI
Language英语
WOS Research AreaAcoustics ; Engineering
WOS SubjectAcoustics ; Engineering, Electrical & Electronic
WOS IDWOS:000446325200008
PublisherIEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
The Source to ArticleWOS
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionUniversity of Macau
Recommended Citation
GB/T 7714
Li, Qiang,Wong, Derek F.,Chao, Lidia S.,et al. Linguistic Knowledge-Aware Neural Machine Translation[J]. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING,2018,26(12):2341-2354.
APA Li, Qiang.,Wong, Derek F..,Chao, Lidia S..,Zhu, Muhua.,Xiao, Tong.,...&Zhang, Min.(2018).Linguistic Knowledge-Aware Neural Machine Translation.IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING,26(12),2341-2354.
MLA Li, Qiang,et al."Linguistic Knowledge-Aware Neural Machine Translation".IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING 26.12(2018):2341-2354.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Li, Qiang]'s Articles
[Wong, Derek F.]'s Articles
[Chao, Lidia S.]'s Articles
Baidu academic
Similar articles in Baidu academic
[Li, Qiang]'s Articles
[Wong, Derek F.]'s Articles
[Chao, Lidia S.]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Li, Qiang]'s Articles
[Wong, Derek F.]'s Articles
[Chao, Lidia S.]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.