Conference Publication Details
Mandatory Fields
Peyman Passban, Chris Hokamp, Andy Way and Qun Liu
EAMT 2016
Improving Phrase-Based SMT Using Cross-Granularity Embedding Similarity
2016
May
Published
1
()
Optional Fields
Statistical machine translation, phrase embeddings, incorporating contextual information.
129
140
Riga, Latvia
30-MAY-16
01-JUN-16
The phrase–based statistical machine translation (PBSMT) model can be viewed as a log-linear combination of translation and language model features. Such a model typically relies on the phrase table as the main resource for bilingual knowledge, which in its most basic form consists of aligned phrases, along with four probability scores. These scores only indicate the cooccurrence of phrase pairs in the training corpus, and not necessarily their semantic relatedness. The basic phrase table is also unable to incorporate contextual information about the segments where a particular phrase tends to occur. In this paper, we define six new features which express the semantic relatedness of bilingual phrases. Our method utilizes both source and target side information to enrich the phrase table. The new features are inferred from a bilingual corpus by a neural network (NN). We evaluate our model on the English–Farsi (En–Fa) and English–Czech (En–Cz) pairs and observe considerable improvements in the all En↔Fa and En↔Cz directions
http://www.aclweb.org/anthology/W16-3403
Grant Details
Science Foundation Ireland (SFI)
12/CE/I2267