Skip to main content
SpringerLink
Log in

Facial acupoint location method based on Faster PFLD

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

With the development of science and technology, more and more healthcare robots emerge, and they, such as facial massage robots, can be combined with acupuncture points to massage and improve the massage effect when working, but the automatic positioning of acupuncture points is still in its infancy, and there are still many shortcomings in the field of automatic positioning of facial acupuncture points, so we improved PFLD, proposed a lightweight network called Faster PFLD-S with Faster PFLD-L, in the WFLW dataset was tested and the results showed that the Faster PFLD-S was faster than PFLD by 27.34%, and the accuracy has been improved, the speed of the Faster PFLD-L is increased by 14.21% on the basis of PFLD, and the accuracy is better than the Faster PFLD-S, and then we propose a model of facial acupuncture point localization that uses the Faster PFLD-L network It can quickly and accurately locate facial acupuncture points in an environment with fuzzy noise, and the average MSE error of acupuncture point localization is 2.2128.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Availability of data and material

This data that support the findings of this study are available from the corresponding author upon reasonable request.

References

  1. Fung, P.C.: Probing the mystery of Chinese medicine meridian channels with special emphasis on the connective tissue interstitial fluid system, mechanotransduction, cells durotaxis and mast cell degranulation. Chin. Med 4(10), 1–6 (2009)

    Google Scholar 

  2. Li, F., He, T., Xu, Q., et al.: What is the acupoint? A preliminary review of Acupoints. Pain Med. 16(10), 1905–1915 (2015)

    Article  Google Scholar 

  3. Morales, A., Piella, G., Sukno, F.M.: Survey on 3D face reconstruction from uncalibrated images. Comput. Sci. Review 40, 100400 (2021)

    Article  Google Scholar 

  4. Bai, Z., Cui, Z., Liu, X., et al.: Riggable 3d face reconstruction via in-network optimization. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 6216–6225 (2021)

  5. Wood, E., Baltrušaitis, T., Hewitt, C., et al.: 3d face reconstruction with dense landmarks. Computer Vision–ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23–27, 2022, Proceedings, Part XIII. Cham: Springer Nature Switzerland, 2022, pp. 160–177

  6. Li, S., Deng, W.: Deep facial expression recognition: a survey. IEEE Trans. Aff. Comput. 13(3): 1195–1215 (2020)

  7. Wang, K., Peng, X., Yang, J., et al.: Suppressing uncertainties for large-scale facial expression recognition. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 6897–6906 (2020)

  8. Zhang, Y., Wang, C., Deng, W.: Relative uncertainty learning for facial expression recognition. Adv. Neural. Inf. Process. Syst. 34, 17616–17627 (2021)

    Google Scholar 

  9. Ge, H., Zhu, Z., Dai, Y., et al.: Facial expression recognition based on deep learning. Comput. Methods Programs Biomed. 215, 106621 (2022)

    Article  Google Scholar 

  10. Adjabi, I., Ouahabi, A., Benzaoui, A., et al.: Past, present, and future of face recognition: a review. Electronics 9(8), 1188 (2020)

    Article  Google Scholar 

  11. Wang, M., Deng, W.: Deep face recognition: a survey. Neurocomputing 429, 215–244 (2021)

    Article  Google Scholar 

  12. Wang, Z., Huang, B., Wang, G., et al.: Masked face recognition dataset and application. IEEE Trans. Biometrics Behav. Identity Sci. (2023)

  13. Cootes, T.F., Taylor, C.J., Cooper, D.H., et al.: Active shape models-their training and application. Comput. Vis. Image Underst. 61(1), 38–59 (1995)

    Article  Google Scholar 

  14. Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. In: Proceedings of the 5th European Conference on Computer Vision-Volume II - Volume II. Springer, Berlin, Heidelberg (1998)

  15. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 60(2), 91–110 (2004)

    Article  Google Scholar 

  16. Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: IEEE Computer Society Conference on Computer Vision & Pattern Recognition. IEEE (2005)

  17. Sun, Y., Wang, X., Tang, X.: Deep convolutional network cascade for facial point detection. Computer Vision and Pattern Recognition. IEEE, 3476–3483 (2013)

  18. Zhang, Z., Luo, P., Chen, C.L., et al.: Facial landmark detection by deep multitask learning. In: European Conference on Computer Vision, pp. 94–108 (2014)

  19. Guo, X., Li, S., Zhang, J., et al.: PFLD: A Practical Facial Landmark Detector (2019)

  20. Howard, A., Sandler, M., Chen, B., et al.: Searching for MobileNetV3. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE (2020)

  21. Feng, Z.H., Kittler, J., Awais, M., et al.: Wing loss for robust facial landmark localisation with convolutional neural networks. Int. J. Comput. Vis. (2018)

  22. Zhu, X., Zhen, L., Liu, X., et al.: Face Alignment Across Large Poses: A 3D Solution. IEEE (2015)

  23. Kumar, A., Chellappa, R.: Disentangling 3D Pose in A Dendritic CNN for Unconstrained 2D Face Alignment. IEEE (2018)

  24. Chenglong, Z., Yan, F.: Design and implementation of facial acupoint recognition system based on augmented reality technology. Comput. Knowl. Technol. Acad. Exchange (2022)

  25. Wu, W., Qian, C., Yang, S, et al.: Look at Boundary: A Boundary-Aware Face Alignment Algorithm. IEEE (2018)

  26. Tingting, Y.: The 10 acupoints that make the face “slim.” China Cosm.: Fashion Edn. 5, 1 (2004)

    Google Scholar 

  27. Cao, X., Wei, Y., Wen, F., Sun. J.: Face alignment by explicit shape regression. IJCV 107(2):177–190 (2014)

  28. Wu, W., Qian, C., Yang, S., Wang, Q., Cai, Y., Zhou. Q.: Look at boundary: a boundary-aware face alignment algorithm. In: CVPR (2018)

  29. Dong, X., Yan, Y., Ouyang, W., Yang, Y.: Style aggregated network for facial landmark detection. In: CVPR (2018)

  30. Kumar, A., Chellappa, R.: Disentangling 3d pose in a dendritic cnn for unconstrained 2d face alignment. In: CVPR (2018)

  31. Cao, X., Wei, Y., Wen, F., Sun, J.: Face alignment by ex-plicit shape regression. IJCV 107(2), 177–190 (2014)

    Article  Google Scholar 

  32. Xiong, X., la Torre, F.D.: Supervised descent method and its applications to face alignment. In: CVPR (2013)

  33. Zhu, S., Li, C., Loy, C.C., Tang, X.: Face alignment by coarse-to-fine shape searching. In: CVPR (2015)

  34. Wu, W., Yang, S.: Leveraging intra and inter-dataset variations for robust face alignment. In: CVPR Workshop (2017)

Download references

Funding

This work was supported by the National Natural Science Foundation of China (No. 61961011) and the National Natural Science Foundation of China (No. 61650106).

Author information

Authors and Affiliations

  1. School of Mechanical and Control Engineering, Guilin University of Technology, Guilin, 541004, China

    Ying-Bin Liu & Jian-Hua Qin

  2. The Second Affiliated Hospital of Guilin Medical University, Guilin, 541000, China

    Gui-Fen Zeng

Authors
  1. Ying-Bin Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jian-Hua Qin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gui-Fen Zeng
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Y-BL contributed to methodology, investigation, formal analysis, writing—original draft, and supervision. J-HQ contributed to conceptualization, methodology, and visualization. G-FZ contributed to investigation, formal analysis, writing—review and editing, and project administration.

Corresponding author

Correspondence to Jian-Hua Qin.

Ethics declarations

Conflict of interest

All authors declare that they have no conflict of interest.

Ethics approval and consent to participate

The study protocol was approved by the ethics review board of Guilin University of Technology. All of the procedures were performed in accordance with the Declaration of Helsinki and relevant policies in China.

Consent for publication

We have obtained written informed consent from all study participants.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, YB., Qin, JH. & Zeng, GF. Facial acupoint location method based on Faster PFLD. SIViP 17, 4455–4463 (2023). https://doi.org/10.1007/s11760-023-02679-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-023-02679-9

Keywords

Search

Navigation