Skip to main content
SpringerLink
Log in

Multi-modal interaction using time division long-term evolution (TD-LTE) for space designing exhibition

  • Original Paper
  • Published:
Wireless Networks Aims and scope Submit manuscript

Abstract

The pavilion combines multi-modal interaction based on Time-Division Long Term Evolution (TD-LTE) to increase the exhibition's interactivity and attractiveness with development of digital technology. Multi-modal interaction enables consumers to engage easily and intuitively with exhibitions or display material with the use of a touch screen, voice recognition, posture detection, and other interactive tools for immersive displays. This paper investigates the construction of a multi-modal interactive exhibition space using digital media technology. In contrast to the usual data collection techniques, which are costly, deficient in 3D pictures, suffer from a lack of spatial position data, and have other drawbacks, key techniques such as deep learning and posture estimation employed in immersive displays sometimes require huge training datasets to enhance the generality of the models. A 6D network architecture for target object estimation is proposed in this research to lower the cost of data collection. The interactive experience of visitors in the exhibition space, exhibit display, and exhibition space management can be improved by multi-modal interaction based on TD-LTE. Visitors can peruse exhibit material, watch movies, and play interactive games more freely due to the engagement modes. Exhibition managers may optimize the layout of the exhibition space and the placement of the exhibits through real-time monitoring, data collection, and analysis. The multi-mode interaction mode based on TD-LTE wireless communication technology can give visitors a rich and more user-friendly exhibition experience with a wide range of application prospects and potentials.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5:
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Availability of data and material

The data used to support the findings of this study are available from the corresponding author upon request.

References

  1. Steinicke, F., Wolf, K. (2020) New digital realities–blending our reality with virtuality. i-com, 19, pp. 61–65

  2. Kim, S., Kang, S., Ryu, K. R., & Song, G. (2019). Real-time occupancy prediction in a large exhibition hall using deep learning approach. Energy and Buildings, 199, 216–222.

    Article  Google Scholar 

  3. Zhao, L., (2022). Personalized healthcare museum exhibition system design based on VR and deep learning driven multimedia and multimodal sensing. Personal and Ubiquitous Computing, pp.1–16.

  4. Wang, M., Lu, S., Zhu, D., Lin, J. and Wang, Z., 2018. A high-speed and low-complexity architecture for softmax function in deep learning. In 2018 IEEE asia pacific conference on circuits and systems (APCCAS) (pp. 223–226). IEEE.

  5. Shang, Y., Pu, Y., Yu, Y., Gao, N., & Lu, Y. (2023). Role of the e-exhibition industry in the green growth of businesses and recovery. Economic Change and Restructuring, 56(3), 2003–2020.

    Article  Google Scholar 

  6. Kim, Y., Jeong, H., Cho, J. D., & Shin, J. (2021). Construction of a soundscape-based media art exhibition to improve user appreciation experience by using deep neural networks. Electronics, 10(10), 1170.

    Article  Google Scholar 

  7. Lu, S., Ding, Y., Liu, M., Yin, Z., Yin, L., & Zheng, W. (2023). Multiscale feature extraction and fusion of image and text in VQA. International Journal of Computational Intelligence Systems, 16(1), 54.

    Article  Google Scholar 

  8. Zhou, X., & Zhang, L. (2022). SA-FPN: An effective feature pyramid network for crowded human detection. Applied Intelligence, 52(11), 12556–12568.

    Article  Google Scholar 

  9. Zhou, L., Ye, Y., Tang, T., Nan, K., & Qin, Y. (2021). Robust matching for SAR and optical images using multiscale convolutional gradient features. IEEE Geoscience and Remote Sensing Letters, 19, 1–5.

    Google Scholar 

  10. Inci, A.F., Isgenc, M.M. and Marculescu, D., (2020). DeepNVM: A framework for modeling and analysis of non-volatile memory technologies for deep learning applications. In 2020 Design, Automation & Test in Europe Conference & Exhibition (DATE) (pp. 1295–1298). IEEE.

  11. Huang, N.C., Chen, S.Y. and Wu, K.C., (2019). Sensor-based approximate adder design for accelerating error-tolerant and deep-learning applications. In 2019 Design, Automation & Test in Europe Conference & Exhibition (DATE) (pp. 692–697). IEEE.

  12. Mondal, S., Ling, Y.S. and Ambikapathi, A., (2021). H-stegonet: A hybrid deep learning framework for robust steganalysis. In 2021 IEEE International Conference on Multimedia and Expo (ICME) (pp. 1–6). IEEE.

  13. Liu, P., Liu, W. and Ma, H., (2017). Weighted sequence loss based spatial-temporal deep learning framework for human body orientation estimation. In 2017 IEEE International Conference on Multimedia and Expo (ICME) (pp. 97–102). IEEE.

  14. Ouyang, W., Chu, X. and Wang, X., (2014). Multi-source deep learning for human pose estimation. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2329–2336).

  15. Zhou, G., Song, B., Liang, P., Xu, J., & Yue, T. (2022). Voids filling of DEM with multiattention generative adversarial network model. Remote Sensing, 14(5), 1206.

    Article  Google Scholar 

  16. Pan, S., Lin, M., Xu, M., Zhu, S., Bian, L. A., & Li, G. (2021). A low-profile programmable beam scanning holographic array antenna without phase shifters. IEEE Internet of Things Journal, 9(11), 8838–8851.

    Article  Google Scholar 

  17. Luvizon, D.C., Picard, D. and Tabia, H., (2018). 2d/3d pose estimation and action recognition using multitask deep learning. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 5137–5146).

  18. Chen, Y., Tian, Y., & He, M. (2020). Monocular human pose estimation: A survey of deep learning-based methods. Computer Vision and Image Understanding, 192, 102897.

    Article  Google Scholar 

  19. Gamra, M. B., & Akhloufi, M. A. (2021). A review of deep learning techniques for 2D and 3D human pose estimation. Image and Vision Computing, 114, 104282.

    Article  Google Scholar 

  20. Hong, C., Yu, J., Zhang, J., Jin, X., & Lee, K. H. (2018). Multimodal face-pose estimation with multitask manifold deep learning. IEEE transactions on industrial informatics, 15(7), 3952–3961.

    Article  Google Scholar 

  21. Chatzis, T., Stergioulas, A., Konstantinidis, D., Dimitropoulos, K., & Daras, P. (2020). A comprehensive study on deep learning-based 3D hand pose estimation methods. Applied Sciences, 10(19), 6850.

    Article  Google Scholar 

  22. Liu, S., Yin, Y., & Ostadabbas, S. (2019). In-bed pose estimation: Deep learning with shallow dataset. IEEE journal of translational engineering in health and medicine, 7, 1–12.

    Article  Google Scholar 

  23. Zeng, A., Yu, K.T., Song, S., Suo, D., Walker, E., Rodriguez, A. and Xiao, J., (2017). Multi-view self-supervised deep learning for 6d pose estimation in the amazon picking challenge. In 2017 IEEE international conference on robotics and automation (ICRA) (pp. 1386–1383). IEEE.

  24. Ali, G., Le, H.Q., Kim, J., Hwang, S.W. and Hwang, J.I., (2019). Design of seamless multi-modal interaction framework for intelligent virtual agents in wearable mixed reality environment. In Proceedings of the 32nd International Conference on Computer Animation and Social Agents (pp. 47–52).

  25. Yu, W., & Jiang, T. (2021). Research on the direction of innovation and entrepreneurship education reform within the digital media art design major in the digital economy. Frontiers in psychology, 12, 719754.

    Article  Google Scholar 

  26. Li, T., Hua, S., Kang, L., & Chang, S. H. (2021). Research on TD-LTE wireless communication network propagation model optimization based on visual simulation and GIS. EURASIP Journal on Wireless Communications and Networking, 2021(1), 1–14.

    Article  Google Scholar 

Download references

Acknowledgements

The paper did not receive any financial support

Author information

Authors and Affiliations

  1. College of Communication and Art Design, University of Shanghai for Science and Technology, Shanghai, 200098, China

    Yang Jie

Authors
  1. Yang Jie
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yang Jie.

Ethics declarations

Conflict of interest

Declares that he has no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jie, Y. Multi-modal interaction using time division long-term evolution (TD-LTE) for space designing exhibition. Wireless Netw 29, 3625–3636 (2023). https://doi.org/10.1007/s11276-023-03427-0

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11276-023-03427-0

Keywords

Search

Navigation