Journal of Computer Science and Technology
Quick Search in JCST
 Advanced Search 
      Home | PrePrint | SiteMap | Contact Us | FAQ
 
Indexed by   SCIE, EI ...
Bimonthly    Since 1986
Journal of Computer Science and Technology 2011, Vol. 26 Issue (1) :57-67    DOI: 10.1007/s11390-011-1111-1
Special Section on Natural Language Processing Current Issue | Archive | Adv Search << Previous Articles | Next Articles >>
Improvement of Machine Translation Evaluation by Simple Linguistically Motivated Features
Mu-Yun Yang (杨沐昀), Member, CCF, IEEE, Shu-Qi Sun (孙叔琦), Jun-Guo Zhu (朱俊国), Sheng Li (李生), Tie-Jun Zhao (赵铁军), Senior Member, CCF, Member, IEEE, and Xiao-Ning Zhu (朱晓宁)
School of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001, China

Abstract
Reference
Related Articles
Download: [PDF 575KB]     Export: BibTeX or EndNote (RIS)  
Abstract 

Adopting the regression SVM framework, this paper proposes a linguistically motivated feature engineering strategy to develop an MT evaluation metric with a better correlation with human assessments. In contrast to current practices of "greedy" combination of all available features, six features are suggested according to the human intuition for translation quality. Then the contribution of linguistic features is examined and analyzed via a hill-climbing strategy. Experiments indicate that, compared to either the SVM-ranking model or the previous attempts on exhaustive linguistic features, the regression SVM model with six linguistic information based features generalizes across different datasets better, and augmenting these linguistic features with proper non-linguistic metrics can achieve additional improvements.

Articles by authors
Keywordsmachine translation   automatic evaluation   regression SVM (supporting vector machine)   linguistic feature     
Received 2009-12-31;
Fund:

Supported by the National Natural Science Foundation of China under Grant Nos. 60773066 and 60736014, the National High Technology Development 863 Program of China under Grant No. 2006AA010108, and the Natural Scientific Research Innovation Foundation in Harbin Institute of Technology under Grant No. HIT.NSFIR.20009070.

Cite this article:   
Mu-Yun Yang (杨沐昀), Member, CCF, IEEE, Shu-Qi Sun (孙叔琦), Jun-Guo Zhu (朱俊国), Sheng Li (李生), Tie-Jun Zhao (赵铁军), Senior Member, CCF, Member, IEEE, and Xiao-Ning Zhu (朱晓宁).Improvement of Machine Translation Evaluation by Simple Linguistically Motivated Features[J]  Journal of Computer Science and Technology, 2011,V26(1): 57-67
URL:  
http://jcst.ict.ac.cn:8080/jcst/EN/10.1007/s11390-011-1111-1
Copyright 2010 by Journal of Computer Science and Technology