Abstract
Developing affordable and customizable cyber-physical production system and Digital Twin (DT) implementations infuses new vitality for current Industry 4.0 and Smart Manufacturing initiatives. The ability to precisely address material handling processes for manufacturability analysis further connects the physical and cyber components of today’s smart manufacturing systems. In this work, we propose a product-centered signature mapping approach to automated digital twinning featuring a hybrid implementation of smart sensing, signature-based feature extractor, and knowledge taxonomy. First, we integrate 3D scanning and surface reconstruction at to implement shape retrieval from both the virtual environment (from Computer-Aided Engineering data) and the real-world production environment (from scanned point cloud frames). Second, Shape Terra, an algorithm for intrinsic curvatures, simulates Persistent Heat Values for fast signature extraction from retrieved shape files. Finally, a systematic integration of the proposed shape analysis based on knowledge taxonomy is prototypically implemented. The objective of this testbed is to illustrate a proof-of-concept DT-aided process autonomy fed by rapid 3D surface signatures. As a result, by hybridizing smart sensing and simulative approaches, we exploit shape signatures as manufacturing knowledge by integrating domain knowledge and data-driven decision-makings. Moreover, human–machine interoperability enabling system-level intelligent controls becomes feasible in complex material handling, shape forming, measuring, and inspection processes.
Similar content being viewed by others
References
Adamson, G., Wang, L., & Moore, P. (2017). Feature-based control and information framework for adaptive and distributed manufacturing in cyber physical systems. Journal of Manufacturing Systems, 43, 305–315.
Bai, X., Wilson, R., & Hancock, E. (2005). Characterising Graphs using the Heat Kernel. In British machine vision conference 2005. Retrieved from https://academic.microsoft.com/paper/1966071755
Bao, J., Guo, D., Li, J., & Zhang, J. (2019). The modelling and operations for the digital twin in the context of manufacturing. Enterprise Information Systems, 13(4), 534–556.
Beel, J., Gipp, B., Langer, S., & Breitinger, C. (2016). Research-paper recommender systems: A literature survey. International Journal on Digital Libraries, 17(4), 305–338.
Belkin, M., Sun, J., & Wang, Y. (2008). Discrete laplace operator on meshed surfaces. In Proceedings of the twenty-fourth annual symposium on Computational geometry, (pp. 278–287). Retrieved from https://academic.microsoft.com/paper/2097824281
Bernardini, F., Mittleman, J., Rushmeier, H., Silva, C., & Taubin, G. (1999). The ball-pivoting algorithm for surface reconstruction. IEEE Transactions on Visualization and Computer Graphics, 5(4), 349–359.
Bronstein, A., Bronstein, M., Guibas, L., & Ovsjanikov, M. (2011). Shape google: Geometric words and expressions for invariant shape retrieval. ACM Transactions on Graphics, 30(1), 1–20.
Bronstein, M., & Kokkinos, I. (2010). Scale-invariant heat kernel signatures for non-rigid shape recognition. In 2010 IEEE computer society conference on computer vision and pattern recognition, (pp. 1704–1711). Retrieved from https://academic.microsoft.com/paper/2007206727
Cai, N., Bendjebla, S., Lavernhe, S., Mehdi-Souzani, C., & Anwer, N. (2018). Freeform machining feature recognition with manufacturability analysis. Procedia CIRP, 72, 1475–1480.
Charles, R., Su, H., Kaichun, M., & Guibas, L. (2017). PointNet: deep learning on point sets for 3D classification and segmentation. In 2017 IEEE conference on computer vision and pattern recognition (CVPR), (pp. 77–85). Retrieved from https://academic.microsoft.com/paper/2560609797
Davtalab, O., Kazemian, A., Yuan, X., & Khoshnevis, B. (2020). Automated inspection in robotic additive manufacturing using deep learning for layer deformation detection. Journal of Intelligent Manufacturing, 1–14. Retrieved from https://academic.microsoft.com/paper/3092226864
Denkena, B., Henning, H., & Lorenzen, L.-E. (2010). Genetics and intelligence: New approaches in production engineering. Production Engineering, 4(1), 65–73.
Dey, T., Li, K., Luo, C., Ranjan, P., Safa, I., & Wang, Y. (2010). Persistent heat signature for pose-oblivious matching of incomplete models. Computer Graphics Forum, 29(5), 1545–1554.
Dong, J., & Vijayan, S. (1997). Features extraction with the consideration of manufacturing processes. International Journal of Production Research, 35(8), 2135–2155.
Ebel, H., Riedelsheimer, T., & Stark, R. (2021). Enabling automated engineering’s project progress measurement by using data flow models and digital twins. International Journal of Engineering Business Management. Retrieved from https://academic.microsoft.com/paper/3198913245
ElGhawalby, H., & Hancock, E. (2015). Heat kernel embeddings, differential geometry and graph structure. Axioms, 4(3), 275–293.
Geng, W., Chen, Z., He, K., & Wu, Y. (2016). Feature recognition and volume generation of uncut regions for electrical discharge machining. Advances in Engineering Software, 91, 51–62.
Harik, R., Shi, Y., & Baek, S. (2017). Shape Terra: Mechanical feature recognition based on a persistent heat signature. Computer-Aided Design and Applications, 14(2), 206–218.
Huang, W., Mei, X., Jiang, G., Hou, D., Bi, Y., & Wang, Y. (2021). An on-machine tool path generation method based on hybrid and local point cloud registration for laser deburring of ceramic cores. Journal of Intelligent Manufacturing, 1–16.
Jiang, Z., Guo, Y., & Wang, Z. (2021). Digital twin to improve the virtual-real integration of industrial IoT. Journal of Industrial Information Integration, 22, 100196.
Jones, P., Maggioni, M., & Schul, R. (2008). Manifold parametrizations by eigenfunctions of the Laplacian and heat kernels. Proceedings of the National Academy of Sciences of the United States of America, 105(6), 1803–1808.
Kazhdan, M., Bolitho, M., & Hoppe, H. (2006). Poisson surface reconstruction. In Proceedings of the fourth Eurographics symposium on Geometry processing, (pp. 61–70). Retrieved from https://academic.microsoft.com/paper/2008073424
Kokkinos, I., & Yuille, A. (2008). Scale invariance without scale selection. In 2008 IEEE conference on computer vision and pattern recognition, (pp. 1–8). Retrieved from https://academic.microsoft.com/paper/2148261123
Lai, Z.-H., Tao, W., Leu, M., & Yin, Z. (2020). Smart augmented reality instructional system for mechanical assembly towards worker-centered intelligent manufacturing. Journal of Manufacturing Systems, 55, 69–81.
Lee, C., & Park, S. (2014). Survey on the virtual commissioning of manufacturing systems. Journal of Computational Design and Engineering, 1(3), 213–222.
Li, J., Zhou, Q., Huang, X., Li, M., & Cao, L. (2021). In situ quality inspection with layer-wise visual images based on deep transfer learning during selective laser melting. Journal of Intelligent Manufacturing, 1–15.
Liu, X., Li, Y., Ma, S., & Lee, C.-H. (2015). A tool path generation method for freeform surface machining by introducing the tensor property of machining strip width. Computer-Aided Design, 66, 1–13.
Marchetta, M., & Forradellas, R. (2010). An artificial intelligence planning approach to manufacturing feature recognition. Computer-Aided Design, 42(3), 248–256.
Monostori, L., Kádár, B., Bauernhansl, T., Kondoh, S., Kumara, S., Reinhart, G., Sauer, O., Schuh, G., Sihn, W., & Ueda, K. (2016). Cyber-physical systems in manufacturing. Cirp Annals-Manufacturing Technology, 65(2), 621–641.
Mortlock, T., Muthirayan, D., Yu, S.-Y., Khargonekar, P., & Faruque, M. (2021). Graph learning for cognitive digital twins in manufacturing systems. arXiv:2109.08632.
Newcombe, R.A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A.J., Kohi, P., Shotton, J., Hodges, S., & Fitzgibbon, A. (2011). KinectFusion: Real-time dense surface mapping and tracking. In 2011 10th IEEE international symposium on mixed and augmented reality, (pp. 127–136). Retrieved from https://academic.microsoft.com/paper/1987648924
Nie, W., Zhao, Y., Liu, A.-A., Gao, Z., & Su, Y. (2020). Multi-graph Convolutional Network for Unsupervised 3D Shape Retrieval. In Proceedings of the 28th ACM international conference on multimedia, (pp. 3395–3403). Retrieved from https://academic.microsoft.com/paper/3092933617
Nonaka, Y., Erdős, G., Kis, T., Kovács, A., Monostori, L., Nakano, T., & Váncza, J. (2013). Generating alternative process plans for complex parts. Cirp Annals-Manufacturing Technology, 62(1), 453–458.
Nonaka, Y., Erdős, G., Kis, T., Nakano, T., & Váncza, J. (2012). Scheduling with alternative routings in CNC workshops. Cirp Annals-Manufacturing Technology, 61(1), 449–454.
Park, Y., Woo, J., & Choi, S. (2020). A cloud-based digital twin manufacturing system based on an interoperable data schema for smart manufacturing. International Journal of Computer Integrated Manufacturing, 33(12), 1259–1276.
Pokojski, J., Szustakiewicz, K., Woźnicki, Ł, Oleksiński, K., & Pruszyński, J. (2021). Industrial application of knowledge-based engineering in commercial CAD/CAE systems. Journal of Industrial Information Integration, 25, 100255.
Rameshbabu, V., & Shunmugam, M. (2009). Hybrid feature recognition method for setup planning from STEP AP-203. Robotics and Computer-Integrated Manufacturing, 25(2), 393–408.
Redelinghuys, A., Basson, A., & Kruger, K. (2020). A six-layer architecture for the digital twin: A manufacturing case study implementation. Journal of Intelligent Manufacturing, 31(6), 1383–1402.
Saidy, C., Xia, K., Sacco, C., Kirkpatrick, M., Kircaliali, A., Nguyen, L., & Harik, R. (2020). Building future factories: a smart robotic assembly platform using virtual commissioning, data analytics, and accelerated computing. SAMPE.
Schleich, B., Anwer, N., Mathieu, L., & Wartzack, S. (2017). Shaping the digital twin for design and production engineering. Cirp Annals-Manufacturing Technology, 66(1), 141–144.
Shi, Y., Zhang, Y., Baek, S., Backer, W., & Harik, R. (2018). Manufacturability analysis for additive manufacturing using a novel feature recognition technique. Computer-Aided Design and Applications, 15(6), 941–952.
Shi, Y., Zhang, Y., & Harik, R. (2020a). Manufacturing feature recognition with a 2D convolutional neural network. Cirp Journal of Manufacturing Science and Technology, 30, 36–57.
Shi, Y., Zhang, Y., Xia, K., & Harik, R. (2020b). A Critical Review of Feature Recognition Techniques. Computer-Aided Design and Applications, 17(5), 861–899.
Sun, J., Ovsjanikov, M., & Guibas, L. (2009). A concise and provably informative multi-scale signature based on heat diffusion. In SGP '09 Proceedings of the Symposium on Geometry Processing (Vol. 28, pp. 1383–1392).
Sundararajan, V., & Wright, P. (2004). Volumetric feature recognition for machining components with freeform surfaces. Computer-Aided Design, 36(1), 11–25.
Sunil, V., & Pande, S. (2008). Automatic recognition of features from freeform surface CAD models. Computer-Aided Design, 40(4), 502–517.
Tao, F., Qi, Q., Wang, L., & Nee, A. (2019). Digital twins and cyber-physical systems toward smart manufacturing and industry 4.0: correlation and comparison. Engineering, 5(4), 653–661.
Vaxman, A., Ben-Chen, M., & Gotsman, C. (2010). A multi-resolution approach to heat kernels on discrete surfaces. International Conference on Computer Graphics and Interactive Techniques, 29(4), 121.
Wells, L., Dastoorian, R., & Camelio, J. (2021). A novel NURBS surface approach to statistically monitor manufacturing processes with point cloud data. Journal of Intelligent Manufacturing, 32(2), 329–345.
Wells, L., Megahed, F., Niziolek, C., Camelio, J., & Woodall, W. (2013). Statistical process monitoring approach for high-density point clouds. Journal of Intelligent Manufacturing, 24(6), 1267–1279.
Xia, K., Sacco, C., Kirkpatrick, M., Harik, R., & Bayoumi, A.-M. (2019). Virtual Comissioning of Manufacturing System Intelligent Control. SAMPE 2019 - Charlotte, NC. Retrieved from https://academic.microsoft.com/paper/2939160706
Xia, K., Sacco, C., Kirkpatrick, M., Saidy, C., Nguyen, L., Kircaliali, A., & Harik, R. (2020). A digital twin to train deep reinforcement learning agent for smart manufacturing plants: Environment, interfaces and intelligence. Journal of Manufacturing Systems., 58, 210–230.
Xia, K., Saidy, C., Kirkpatrick, M., Anumbe, N., Sheth, A., & Harik, R. (2021a). Towards semantic integration of machine vision systems to aid manufacturing event understanding. Sensors, 21(13), 4276.
Xia, T., Zhang, W., Chiu, W., & Jing, C. (2021b). Using cloud computing integrated architecture to improve delivery committed rate in smart manufacturing. Enterprise Information Systems, 15(9), 1260–1279.
Yli-Ojanperä, M., Sierla, S., Papakonstantinou, N., & Vyatkin, V. (2019). Adapting an agile manufacturing concept to the reference architecture model industry 4.0: A survey and case study. Journal of Industrial Information Integration, 15, 147–160.
Zhang, X., & Ming, X. (2020). Reference subsystems for Smart Manufacturing Collaborative System (SMCS) from multi-processes, multi-intersections and multi-operators. Enterprise Information Systems, 14(3), 282–307.
Zhang, X., Nassehi, A., & Newman, S. (2014). Feature recognition from CNC part programs for milling operations. The International Journal of Advanced Manufacturing Technology, 70(1), 397–412.
Zhang, X., Tsang, W.-M., Yamazaki, K., & Mori, M. (2013). A study on automatic on-machine inspection system for 3D modeling and measurement of cutting tools. Journal of Intelligent Manufacturing, 24(1), 71–86.
Zhang, X., Zheng, Y., Suresh, V., Wang, S., Li, Q., Li, B., & Qin, H. (2020). Correlation approach for quality assurance of additive manufactured parts based on optical metrology. Journal of Manufacturing Processes, 53, 310–317.
Zhao, C., Du, S., Lv, J., Deng, Y., & Li, G. (2021). A novel parallel classification network for classifying three-dimensional surface with point cloud data. Journal of Intelligent Manufacturing, 1–13
Zhou, Y., & Tuzel, O. (2018). VoxelNet: End-to-end learning for point cloud based 3D object detection. In 2018 IEEE/CVF conference on computer vision and pattern recognition, (pp. 4490–4499). Retrieved from https://academic.microsoft.com/paper/2963727135
Acknowledgements
This material is based upon work supported by the National Science Foundation under Grant No. 2119654 and the South Carolina Research Authority. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation or the South Carolina Research Authority.
Funding
Funding was provided by South Carolina Research Authority (10009353, 10009367) and National Science Foundation (2119654).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Xia, K., Wuest, T. & Harik, R. Automated manufacturability analysis in smart manufacturing systems: a signature mapping method for product-centered digital twins. J Intell Manuf 34, 3069–3090 (2023). https://doi.org/10.1007/s10845-022-01991-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10845-022-01991-4