Linguistic Knowledge-Aware Neural Machine Translation
Li, Qiang; Wong, Derek F.; Chao, Lidia S.; Zhu, Muhua; Xiao, Tong; Zhu, Jingbo; Zhang, Min
AbstractRecently, researchers have shown an increasing interest in incorporating linguistic knowledge into neural machine translation (NMT). To this end, previous works choose either to alter the architecture of NMT encoder to incorporate syntactic information into the translation model, or to generalize the embedding layer of the encoder to encode additional linguistic features. The former approach mainly focuses on injecting the syntactic structure of the source sentence into the encoding process, leading to a complicated model that lacks the flexibility to incorporate other types of knowledge. The latter extends word embeddings by considering additional linguistic knowledge as features to enrich the word representation. It thus does not explicitly balance the contribution from word embeddings and the contribution from additional linguistic knowledge. To address these limitations, this paper proposes a knowledge-aware NMT approach that models additional linguistic features in parallel to the word feature. The core idea is that we propose modeling a series of linguistic features at the word level (knowledge block) using a recurrent neural network (RNN). And in sentence level, those word-corresponding feature blocks are further encoded using a RNN encoder. In decoding, we propose a knowledge gate and an attention gate to dynamically control the proportions of information contributing to the generation of target words from different sources. Extensive experiments show that our approach is capable of better accounting for importance of additional linguistic, and we observe significant improvements from 1.0 to 2.3 BLEU points on Chinese <-> English and English -> German translation tasks.
KeywordAttention gate knowledge block knowledge gate neural machine translation (NMT)
URLView the original
Indexed BySCI
WOS Research AreaAcoustics ; Engineering
WOS SubjectAcoustics ; Engineering, Electrical & Electronic
WOS IDWOS:000446325200008
The Source to ArticleWOS
Fulltext Access
Citation statistics
Cited Times [WOS]:5   [WOS Record]     [Related Records in WOS]
Document TypeJournal article
CollectionUniversity of Macau
Recommended Citation
GB/T 7714
Li, Qiang,Wong, Derek F.,Chao, Lidia S.,et al. Linguistic Knowledge-Aware Neural Machine Translation[J]. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING,2018,26(12):2341-2354.
APA Li, Qiang.,Wong, Derek F..,Chao, Lidia S..,Zhu, Muhua.,Xiao, Tong.,...&Zhang, Min.(2018).Linguistic Knowledge-Aware Neural Machine Translation.IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING,26(12),2341-2354.
MLA Li, Qiang,et al."Linguistic Knowledge-Aware Neural Machine Translation".IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING 26.12(2018):2341-2354.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Li, Qiang]'s Articles
[Wong, Derek F.]'s Articles
[Chao, Lidia S.]'s Articles
Baidu academic
Similar articles in Baidu academic
[Li, Qiang]'s Articles
[Wong, Derek F.]'s Articles
[Chao, Lidia S.]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Li, Qiang]'s Articles
[Wong, Derek F.]'s Articles
[Chao, Lidia S.]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.