Skip to main content

Advertisement

Springer Nature Link
Log in

Statistical Feature Aided Intelligent Deep Learning Machine Translation in Internet of Things

  • Published:
Mobile Networks and Applications Aims and scope Submit manuscript

Abstract

Internet of Things (IoT) networks have been widely deployed to achieve communication among machines and humans. Machine translation can enable human-machine interactions for IoT equipment. In this paper, we propose to combine the neural machine translation (NMT) and statistical machine translation (SMT) to improve translation precision. In our design, we propose a hybrid deep learning (DL) network that uses the statistical feature extracted from the words as the data set. Namely, we use the SMT model to score the generated words in each decoding step of the NMT model, instead of directly processing their outputs. These scores will be converted to the generation probability corresponding to words by classifiers and used for generating the output of the hybrid MT system. For the NMT, the DL network consists of the input layer, embedding layer, recurrent layer, hidden layer, and output layer. At the offline training stage, the NMT network is jointly trained with SMT models. Then at the online deployment stage, we load the fine-trained models and parameters to generate the outputs. Experimental results on French-to-English translation tasks show that the proposed scheme can take advantage of both NMT and SMT methods, thus higher translation precision could be achieved.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Arthur P, Neubig G, Nakamura S (2016) Incorporating discrete translation lexicons into neural machine translation. In: Proc. Conf. Empirical methods natural lang. process

  2. Dahl G, Yu D, Deng L, Acero A (2012) Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition. Audio, Speech, Language Process, IEEE Trans 20(1):30–42

    Article  Google Scholar 

  3. Heafield K (2011) Kenlm: Faster and smaller language model queries. In: Proceedings of the sixth workshop on statistical machine translation. WMT ’11, Association for Computational Linguistics, USA, pp 187–197

  4. Jean S, Cho K, Memisevic R, Bengio Y (2015) On using very large target vocabulary for neural machine translation. In: Proc. 53rd annu, meeting assoc. comput. linguistics 7th int. joint conf. natural lang. process, vol 1. Association for Computational Linguistics, Beijing, China, pp 1–10

  5. Krizhevsky A, Sutskever I, Hinton G (2012) Imagenet classification with deep convolutional neural networks. In: Proc. adv. neural inf. process. syst, pp 1097–1105

  6. Och F, Nev H (2002) Discriminative training and maximum entropy models for statistical machine translation. In: Association for Computational Linguistics, Philadelphia, Pennsylvania, USA, pp 295–302

  7. Palangi H, Deng L, Shen Y, Gao J, He X, Chen J, Song X, Ward R (Apr 2016) Deep sentence embedding using long short-term memory networks: Analysis and application to information retrieval. IEEE/ACM Trans Audio, Speech and Lang Proc 24(4):694–707

    Article  Google Scholar 

  8. Tu Z., Lu Z., Liu Y., Liu X., Li H. (2016) Modeling coverage for neural machine translation. In: Proc. 40th annu. meeting assoc. comput. linguistics. pp 76–85

  9. Wang X., Tu Z., Zhang M. (2018) Incorporating statistical machine translation word knowledge into neural machine translation. IEEE/ACM Trans Audio Speech, Language Process 26(12):2255–2266

    Article  Google Scholar 

  10. Wang X, Lu Z, Tu Z, Li H, Xiong D, Zhang Mx (2016) Neural machine translation advised by statistical machine translation. In: Proc. AAAI conf. artif intell

  11. Zhu X, Yang M, Zhao T, Zhu C (2018) Minimum bayes-risk phrase table pruning for pivot-based machine translation in internet of things. IEEE Access 6:55754–55764

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported in part by the State Key Program of National Social Science of China (No. 18AZD035), the Key Research & Development and Transformation Plan of Science and Technology Program for Tibet Autonomous Region (No. XZ201901-GB-16), the Special Fund from the Central Finance to Support the Development of Local Universities (No.ZFYJY201902001) and the National Natural Science Foundation of China (No.71964030).

Author information

Authors and Affiliations

  1. School of Electronics and Information Technology, Sun Yat-sen University, Guangzhou, 510006, China

    Yidian Zhang & Lin Zhang

  2. School of Information Science and Technology, Tibet University, Lhasa, 850000, China

    Lin Zhang, Ping Lan & Zhiqiang Wu

  3. Center of Tibetan Studies (Everest Research Institute), Tibet University, Lhasa, 850000, China

    Wenyong Li, Dan Yang & Zhiqiang Wu

  4. School of Business Administration, Southwestern University of Finance and Economics, Chengdu, 611130, China

    Wenyong Li

  5. Beijing Foreign Studies University, Beijing, 10089, China

    Dan Yang

Authors
  1. Yidian Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lin Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ping Lan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Wenyong Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Dan Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Zhiqiang Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lin Zhang.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, Y., Zhang, L., Lan, P. et al. Statistical Feature Aided Intelligent Deep Learning Machine Translation in Internet of Things. Mobile Netw Appl 28, 325–333 (2023). https://doi.org/10.1007/s11036-022-01936-4

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11036-022-01936-4

Keywords