Skip to main content
SpringerLink
Log in

A ranking method for example based machine translation results by learning from user feedback

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Example-Based Machine Translation (EBMT) is a corpus based approach to Machine Translation (MT), that utilizes the translation by analogy concept. In our EBMT system, translation templates are extracted automatically from bilingual aligned corpora by substituting the similarities and differences in pairs of translation examples with variables. In the earlier versions of the discussed system, the translation results were solely ranked using confidence factors of the translation templates. In this study, we introduce an improved ranking mechanism that dynamically learns from user feedback. When a user, such as a professional human translator, submits his evaluation of the generated translation results, the system learns “context-dependent co-occurrence rules” from this feedback. The newly learned rules are later consulted, while ranking the results of the subsequent translations. Through successive translation-evaluation cycles, we expect that the output of the ranking mechanism complies better with user expectations, listing the more preferred results in higher ranks. We also present the evaluation of our ranking method which uses the precision values at top results and the BLEU metric.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Chiang D (2005) A hierarchical phrase-based model for statistical machine translation. In: Proceedings of the 43rd annual meeting of the ACL (ACL 2005), Ann Arbor, Michigan, pp 263–270

  2. Cicekli I, Güvenir HA (2001) Learning translation templates from bilingual translation examples. Appl Intell 15(1):57–76

    Article  MATH  Google Scholar 

  3. Cicekli I, Güvenir HA (2003) Learning translation templates from bilingual translation examples. In: Carl M, Way A (eds) Recent advances in example-based machine translation. Kluwer Academic, Boston, pp 247–278

    Google Scholar 

  4. Cicekli I (2005) Inducing translation templates with type constraints. J Mach Transl 19:283–299

    Article  Google Scholar 

  5. Daybelge T (2007) Improving the precision of example-based machine translation by learning from user feedback. Master’s thesis, Department of Computer Engineering, Bilkent University, Ankara, Turkey

  6. Daybelge T, Cicekli I (2007) A rule-based morphological disambiguator for Turkish. In: Proceedings of recent advances in natural language processing (RANLP 2007), Borovets, Bulgaria, pp 145–149

  7. Ding Y, Palmer M (2005) Machine translation using probabilistic synchronous dependency insertion grammars. In: Proceedings of the 43rd annual meeting of the ACL (ACL 2005), Ann Arbor, Michigan, USA, pp 541–548

  8. Doğan H (2007) Example based machine translation with type associated translation templates. Master’s thesis, Department of Computer Engineering, Bilkent University, Ankara, Turkey

  9. Gough N, Way A (2004) Robust large-scale EBMT with marker-based segmentation. In: Proceedings of the 10th conference on theoretical and methodological issues in machine translation (TMI-2004), Baltimore, MD, pp 95–104

  10. Güvenir HA, Cicekli I (1998) Learning translation templates from examples. Inf Syst 23(6):353–363

    Article  Google Scholar 

  11. Imamura K (2002) Application of translation knowledge acquired by hierarchical phrase alignment for pattern-based MT. In: Proceedings of the 9th conference on theoretical and methodological issues in machine translation (TMI-2002), Valetta, Malta, pp 74–84

  12. Imamura K, Sumita E, Matsumoto Y (2003) Feedback cleaning of machine translation rules using automatic evaluation. In: Proceedings of the 41st annual meeting of the association for computational linguistics, pp 347–350

  13. Istek O, Cicekli I (2007) A link grammar for an agglutinative language. In: Proceedings of recent advances in natural language processing (RANLP 2007), Borovets, Bulgaria, pp 285–290

  14. Font Llitjos A, Carbonell JG (2004) The translation correction tool: English-Spanish user studies. In: Proceedings of LREC-2004, pp 447–454

  15. Font Llitjos A, Carbonell JG, Levie A (2005) A framework for interactive and automatic refinement of transfer-based machine translation. In: Proceedings of EAMT-2005, pp 87–96

  16. Menezes A, Richardson SD (2001) A best first alignment algorithm for automatic extraction of transfer mappings from bilingual corpora In: Proceedings of the workshop on example-based machine translation’ im MT summit VIII, pp 35–42

  17. Meyers A, Kosaka M, Grishman R (2000) Chart-based transfer rule application in machine translation. In: Proceedings of COLING-2000, pp 537–543

  18. Nagao M (1984) A framework of a mechanical translation between Japanese and English by analogy principle. In: Proceedings of the international NATO symposium on artificial and human intelligence, New York, pp 173–180

  19. Nesson R, Shieber SM, Rush A (2006) Induction of probabilistic synchronous tree insertion grammars for machine translation. In: Proceedings of the 7th conference of the association for machine translation in the Americas (AMTA 2006), Boston, Massachusetts

  20. Oflazer K (1994) Two-level description of Turkish morphology. Lit Linguist Comput 9(2):137–148

    Article  Google Scholar 

  21. Oz Z, Cicekli I (1998) Ordering translation templates by assigning confidence factors. In: AMTA ’98: Proceedings of the third conference of the association for machine translation in the Americas on machine translation and the information soup. Lecture notes in computer science, vol 1529. Springer, London, pp 51–61

    Google Scholar 

  22. Papineni K, Roukos S, Ward T, Zhu W-J (2002) Bleu: a method for automatic evaluation of machine translation. In: Proceedings of the 40th annual meeting of the association for computational linguistics, Philadelphia, pp 311–318

  23. Shieber SM, Schabes Y (1990) Synchronous tree-adjoining grammars. In: Proceedings of the 13th COLING, pp 253–258

  24. Venugopal A, Zollmann A, Vogel S (2007) An efficient two-pass approach to synchronous-CFG driven statistical MT. In: Proceedings of NAACL HLT 2007, Rochester, NY, pp 500–507

  25. Xerox (2010) Xerox English morphological analyzer. Accessible at http://legacy.xrce.xerox.com/competencies/content-analysis/demos/english.en.html, accessed 7 March 2010

  26. Yamada K, Knight K (2001) A syntax-based statistical translation model. In: Proceedings of the 39th annual meeting of the ACL (ACL 2001), pp 523–530

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Bilkent University, 06800, Bilkent, Ankara, Turkey

    Turhan Daybelge & Ilyas Cicekli

Authors
  1. Turhan Daybelge
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ilyas Cicekli
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ilyas Cicekli.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Daybelge, T., Cicekli, I. A ranking method for example based machine translation results by learning from user feedback. Appl Intell 35, 296–321 (2011). https://doi.org/10.1007/s10489-010-0222-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-010-0222-7

Keywords

Search

Navigation