Abstract
In semiconductor manufacturing, patterns formed by defective dies in a wafer bin map (WBM) reveal possible problems during the wafer fabrication process. Therefore, the identification of these patterns is important for root cause diagnosis and yield enhancement. Recently, as the manufacturing process becomes increasingly complicated, mixed-type defect patterns have been frequently observed on the WBMs. The joint classification and segmentation of each pattern contained in the mixed-type pattern is challenging, especially when these patterns are connected or overlapped. This study proposes a shape prior guided method in which the shape templates are deformed to match the patterns with a spatial transformer network. The deformation based method is able to give plausible results while reducing computation cost of the network. Furthermore, the method is flexible and easily extended to deal with complex shapes by defining different shape templates. The experimental results demonstrate the effectiveness of the proposed method in the identification of the pattern types, as well as the separation of each isolated pattern.
Similar content being viewed by others
Data availability
The data that support the findings of this study are available from the corresponding author upon request.
References
Abd Al Rahman, M., Danishvar, S., & Mousavi, A. (2021). An improved capsule network (wafercaps) for wafer bin map classification based on dcgan data upsampling. IEEE Transactions on Semiconductor Manufacturing, 35(1), 50–59. https://doi.org/10.1109/TSM.2021.3134625
Adly, F., Alhussein, O., Yoo, P. D., Al-Hammadi, Y., Taha, K., Muhaidat, S., Jeong, Y.-S., Lee, U., & Ismail, M. (2015). Simplified subspaced regression network for identification of defect patterns in semiconductor wafer maps. IEEE Transactions on Industrial Informatics, 11(6), 1267–1276. https://doi.org/10.1109/TSM.2018.2841416
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017). Segnet: A deep convolutional encoder-decoder architecture for image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(12), 2481–2495. https://doi.org/10.1109/TPAMI.2016.2644615
Chien, C.-F., Hsu, C.-Y., & Chen, P.-N. (2013). Semiconductor fault detection and classification for yield enhancement and manufacturing intelligence. Flexible Services and Manufacturing Journal, 25(3), 367–388. https://doi.org/10.1007/s10696-012-9161-4
Chiu, M.-C., & Chen, T.-M. (2021). Applying data augmentation and mask R-CNN-based instance segmentation method for mixed-type wafer maps defect patterns classification. IEEE Transactions on Semiconductor Manufacturing, 34(4), 455–463. https://doi.org/10.1109/TSM.2021.3118922
Çiçek, Ö., Abdulkadir, A., Lienkamp, S.S., Brox, T., & Ronneberger, O. (2016). 3D U-Net: Learning dense volumetric segmentation from sparse annotation. In International conference on medical image computing and computer-assisted intervention (pp. 424-432). https://doi.org/10.1007/978-3-319-46723-8_49
Cremers, D., Osher, S. J., & Soatto, S. (2006). Kernel density estimation and intrinsic alignment for shape priors in level set segmentation. International Journal of Computer Vision, 69(3), 335–351. https://doi.org/10.1007/s11263-006-7533-5
He, F., Liu, T., & Tao, D. (2020). Why resnet works? Residuals generalize. IEEE Transactions on neural Networks and Learning Systems, 31(12), 5349–5362. https://doi.org/10.1109/TNNLS.2020.2966319
He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770-778). https://doi.org/10.48550/arXiv.1512.03385
Hsu, C.-Y., Chen, W.-J., & Chien, J.-C. (2020). Similarity matching of wafer bin maps for manufacturing intelligence to empower industry 3.5 for semiconductor manufacturing. Computers & Industrial Engineering, 142, 106358. https://doi.org/10.1016/j.cie.2020.106358
Hsu, C.-Y., & Chien, J.-C. (2022). Ensemble convolutional neural networks with weighted majority for wafer bin map pattern classification. Journal of Intelligent Manufacturing, 33(3), 831–844. https://doi.org/10.1007/s10845-020-01687-7
Jaderberg, M., Simonyan, K., Zisserman, A., & kavukcuoglu, K. (2015). Spatial transformer networks. In: Cortes, C., Lawrence, N., Lee, D., Sugiyama, M., & Garnett, R. (Eds.), Advances in neural information processing systems (Vol. 28). https://doi.org/10.48550/arXiv.1506.02025
Jin, C. H., Kim, H.-J., Piao, Y., Li, M., & Piao, M. (2020). Wafer map defect pattern classification based on convolutional neural network features and error-correcting output codes. Journal of Intelligent Manufacturing, 31(8), 1861–1875. https://doi.org/10.1007/s10845-020-01540-x
Kim, J., Lee, Y., & Kim, H. (2018). Detection and clustering of mixed-type defect patterns in wafer bin maps. IISE Transactions, 50(2), 99–111. https://doi.org/10.1080/24725854.2017.1386337
Kim, T., & Behdinan, K. (2023). Advances in machine learning and deep learning applications towards wafer map defect recognition and classification: A review. Journal of Intelligent Manufacturing, 34, 3215–3247. https://doi.org/10.1007/s10845-022-01994-1
Kim, T. S., Lee, J. W., Lee, W. K., & Sohn, S. Y. (2022). Novel method for detection of mixed-type defect patterns in wafer maps based on a single shot detector algorithm. Journal of Intelligent Manufacturing, 33(6), 1715–1724. https://doi.org/10.1007/s10845-021-01755-6
Kingma, D.P., & Ba, J. (2014). Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980
Kong, Y., & Ni, D. (2019). Recognition and location of mixed-type patterns in wafer bin maps. In 2019 IEEE international conference on smart manufacturing, industrial & logistics engineering (SMILE) (pp. 4-8). https://doi.org/10.1109/SMILE45626.2019.8965309
Kong, Y., & Ni, D. (2020). Qualitative and quantitative analysis of multi-pattern wafer bin maps. IEEE Transactions on Semiconductor Manufacturing, 33(4), 578–586. https://doi.org/10.1109/TSM.2020.3022431
Kyeong, K., & Kim, H. (2018). Classification of mixed-type defect patterns in wafer bin maps using convolutional neural networks. IEEE Transactions on Semiconductor Manufacturing, 31(3), 395–402. https://doi.org/10.1109/TSM.2018.2841416
Lee, M. C. H., Petersen, K., Pawlowski, N., Glocker, B., & Schaap, M. (2019). TETRIS: Template transformer networks for image segmentation with shape priors. IEEE Transactions on Medical Imaging, 38(11), 2596–2606. https://doi.org/10.1109/TMI.2019.2905990
Milletari, F., Rothberg, A., Jia, J., & Sofka, M. (2017). Integrating statistical prior knowledge into convolutional neural networks. In International conference on medical image computing and computer-assisted intervention (pp. 161-168). https://doi.org/10.1007/978-3-319-66182-7_19
Nag, S., Makwana, D., & R, S. C. T., Mittal, S., & Mohan, C. K. (2022). Wafersegclassnet–A light-weight network for classification and segmentation of semiconductor wafer defects. Computers in Industry, 142, 103720. https://doi.org/10.1016/j.compind.2022.103720
Nakazawa, T., & Kulkarni, D. V. (2018). Wafer map defect pattern classification and image retrieval using convolutional neural network. IEEE Transactions on Semiconductor Manufacturing, 31(2), 309–314. https://doi.org/10.1109/TSM.2018.2795466
O’Leary, J., Sawlani, K., & Mesbah, A. (2020). Deep learning for classification of the chemical composition of particle defects on semiconductor wafers. IEEE Transactions on Semiconductor Manufacturing, 33(1), 72–85. https://doi.org/10.1109/TSM.2019.2963656
Pak, D.H., Caballero, A., Sun, W., & Duncan, J.S. (2020). Efficient aortic valve multilabel segmentation using a spatial transformer network. In 2020 IEEE 17th international symposium on biomedical imaging (ISBI) (pp. 1738-1742). https://doi.org/10.1109/TMI.2019.2905990
Piao, M., & Jin, C. H. (2023). CNN and ensemble learning based wafer map failure pattern recognition based on local property based features. Journal of Intelligent Manufacturing, 34, 3599–3621. https://doi.org/10.1007/s10845-022-02023-x
Ronneberger, O., Fischer, P., & Brox, T. (2015). U-net: Convolutional networks for biomedical image segmentation. In Medical image computing and computer-assisted intervention–MICCAI 2015: 18th international conference, Munich, Germany, October 5–9, 2015, Proceedings, Part III 18 (pp. 234-241). https://doi.org/10.1007/978-3-319-24574-4_28
Shelhamer, E., Long, J., & Darrell, T. (2017). Fully convolutional networks for semantic segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(4), 640–651. https://doi.org/10.1109/TPAMI.2016.2572683
Shin, W., Kahng, H., & Kim, S. B. (2022). Mixup-based classification of mixed-type defect patterns in wafer bin maps. Computers & Industrial Engineering, 167, 107996. https://doi.org/10.1016/j.cie.2022.107996
Tsoumakas, G., & Katakis, I. (2007). Multi-label classification: An overview. International Journal of Data Warehousing and Mining (IJDWM), 3(3), 1–13. https://doi.org/10.4018/jdwm.2007070101
Wang, J., Xu, C., Yang, Z., Zhang, J., & Li, X. (2020). Deformable convolutional networks for efficient mixed-type wafer defect pattern recognition. IEEE Transactions on Semiconductor Manufacturing, 33(4), 587–596. https://doi.org/10.1109/TSM.2020.3020985
Wang, R., & Chen, N. (2022). Detection and recognition of mixed-type defect patterns in wafer bin maps via tensor voting. IEEE Transactions on Semiconductor Manufacturing, 35(3), 485–494. https://doi.org/10.1109/TSM.2022.3183008
Yan, J., Sheng, Y., & Piao, M. (2023). Semantic segmentation based wafer map mixed-type defect pattern recognition. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (Early Access). https://doi.org/10.1109/TCAD.2023.3274958
Yuan, T., & Kuo, W. (2008). Spatial defect pattern recognition on semiconductor wafers using model-based clustering and bayesian inference. European Journal of Operational Research, 190(1), 228–240. https://doi.org/10.1016/j.ejor.2007.06.007
Yu, J., & Liu, J. (2020). Two-dimensional principal component analysis-based convolutional autoencoder for wafer map defect detection. IEEE Transactions on Industrial Electronics, 68(9), 8789–8797. https://doi.org/10.1109/TIE.2020.3013492
Zheng, S., Jayasumana, S., Romera-Paredes, B., Vineet, V., Su, Z., Du, D., Huang, C., & Torr, P.H. (2015). Conditional random fields as recurrent neural networks. In Proceedings of the IEEE international conference on computer vision (pp. 1529-1537). https://doi.org/10.1109/ICCV.2015.179
Zotti, C., Luo, Z., Lalande, A., & Jodoin, P.-M. (2018). Convolutional neural network with shape prior applied to cardiac MRI segmentation. IEEE Journal of Biomedical and Health Informatics, 23(3), 1119–1128. https://doi.org/10.1109/TMI.2019.2905990
Funding
The study is supported by Key Program of National Natural Science Foundation of China (No. 72334004), General Program of National Natural Science Foundation of China (No. 71971143), Youth Program of National Natural Science Foundation of China (No. 72101065, No. 72101106), Guangdong Basic and Applied Basic Research Foundation (No. 2021A1515110336), Guangdong Provincial Philosophy and Social Sciences Planning Project (No. GD22CGL35), Special Projects in Key Fields of Ordinary Colleges and Universities in Guangdong Province (No. 2022ZDZX2054), University Innovation Team Project of Guangdong Province (No. 2021WCXTD002), and Shenzhen Science and Technology Program (No. RCBS20210609103119020, No. RCBS20221008093124063).
Author information
Authors and Affiliations
Contributions
All authors contributed to the idea of the study. The first draft of the manuscript was written by RW and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Wang, R., Wang, S. & Niu, B. Shape prior guided defect pattern classification and segmentation in wafer bin maps. J Intell Manuf 36, 319–330 (2025). https://doi.org/10.1007/s10845-023-02242-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10845-023-02242-w