Abstract
Particle detection aims to accurately locate and count valid particles in pad images to ensure the performance of electrical connections in the chip-on-glass (COG) process. However, existing methods fail to achieve both high detection accuracy and inference efficiency in real applications. To solve this problem, we design a computation-efficient particle detection network (PAD-Net) with an encoder–decoder architecture, making a good trade-off between inference efficiency and accuracy. In the encoder part, MobileNetV3 is tailored to greatly reduce parameters at a little cost of accuracy drop. And the decoder part is designed by using the light-weight RefineNet, which can further boost particle detection performance. Besides, the proposed network adopts the adaptive attention loss (termed AAL), which improves the detection accuracy with a negligible increase in computation cost. Finally, we employ a knowledge distillation strategy to further enhance the final detection performance without increasing the parameters and floating-point operations (FLOPs) of PAD-Net. Experimental results on the real datasets demonstrate that our methods can achieve high-accuracy and real-time detection performance on valid particles compared with the state-of-the-art methods.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Badmos, O., Kopp, A., Bernthaler, T., et al. (2020). Image-based defect detection in lithium-ion battery electrode using convolutional neural networks. Journal of Intelligent Manufacturing, 31(4), 885–897.
Bian, C., Feng, W., Wan, L., et al. (2021). Structural knowledge distillation for efficient skeleton-based action recognition. IEEE Transactions on Image Processing, 30, 2963–2976.
Chen, K., & Liu, E. (2018). Conductive particles detection in the TFT-LCD manufacturing process with u-resnet. In: Chinese Conference on Pattern Recognition and Computer Vision, (pp 162–173).
Chollet, F. (2017). Xception: Deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (pp 1251–1258)
Gao, H., Wang, Z., Cai, L., et al. (2021). Channelnets: Compact and efficient convolutional neural networks via channel-wise convolutions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 43(8), 2570–2581.
He, T., Shen, C., Tian, Z., et al. (2019). Knowledge adaptation for efficient semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (pp. 578–587).
Hinton, G., Vinyals, O., Dean, J., et al. (2015). Distilling the knowledge in a neural network. arXiv:1503.02531
Howard, A., Sandler, M., Chen, B., et al. (2019). Searching for mobilenetv3. In: Proceedings of the IEEE International Conference on Computer Vision, (pp. 1314–1324).
Howard, A. G., Zhu, M., Chen, B., et al. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv:1704.04861
Lin, C. S., Lu, K., Lin, T. C., et al. (2011). An automatic inspection method for the fracture conditions of anisotropic conductive film in the tft-lcd assembly process. International Journal of Optomechatronics, 5(9), 286–298.
Lin, G., Milan, A., Shen, C., et al. (2017). Refinenet: Multi-path refinement networks for high-resolution semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1925–1934
Lin, P., Sun, P., Cheng, G., et al. (2020). Graph-guided architecture search for real-time semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (pp. 4202–4211).
Liu, E., Chen, K., Xiang, Z., et al. (2020a). Conductive particle detection via deep learning for acf bonding in tft-lcd manufacturing. Journal of Intelligent Manufacturing, 31(4), 1037–1049.
Liu, L., Chen, J., Wu, H., et al. (2020b). Efficient crowd counting via structured knowledge transfer. In: Proceedings of the 28th ACM International Conference on Multimedia, (pp. 2645–2654)
Liu, R., Sun, Z., Wang, A., et al. (2020c). Real-time defect detection network for polarizer based on deep learning. Journal of Intelligent Manufacturing, 31(8), 1813–1823.
Liu, Y., Chen, K., Liu, C., et al. (2019). Structured knowledge distillation for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (pp. 2604–2613)
Long, J., Shelhamer, E., & Darrell, T. (2015). Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (pp 3431–3440)
Nekrasov, V., Chen, H., Shen, C., et al. (2019). Fast neural architecture search of compact semantic segmentation models via auxiliary cells. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (pp. 9126–9135)
Nekrasov, V., Shen, C., & Reid, I. (2018). Light-weight refinenet for real-time semantic segmentation. In: British Machine Vision Conference
Ni, G., Liu, L., Du, X., et al. (2017). Accurate aoi inspection of resistance in lcd anisotropic conductive film bonding using differential interference contrast. Optik, 130, 786–796.
Passalis, N., Tzelepi, M., & Tefas, A. (2021). Probabilistic knowledge transfer for lightweight deep representation learning. IEEE Transactions on Neural Networks and Learning Systems, 32(5), 2030–2039.
Ronneberger, O., Fischer, P., & Brox, T. (2015). U-net: Convolutional networks for biomedical image segmentation. In: International Conference on Medical image computing and computer-assisted intervention, (pp. 234–241)
Sandler, M., Howard, A., Zhu, M., et al. (2018). Mobilenetv2: Inverted residuals and linear bottlenecks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (pp. 4510–4520)
Stern, M. L., & Schellenberger, M. (2021). Fully convolutional networks for chip-wise defect detection employing photoluminescence images. Journal of Intelligent Manufacturing, 32(1), 113–126.
Tabernik, D., Sela, S., Skvarc, J., et al. (2020). Segmentation-based deep-learning approach for surface-defect detection. Journal of Intelligent Manufacturing, 31(3), 759–776.
Tian, Y., Lei, Y., Zhang, J., et al. (2020). Padnet: Pan-density crowd counting. IEEE Transactions on Image Processing, 29, 2714–2727.
Wang, Y., Ma, L., & Jiang, H. (2019a). Detecting conductive particles in tft-lcd with u-multinet. In: 2019 8th International Symposium on Next Generation Electronics (ISNE), IEEE, (pp. 1–3).
Wang, P., Gao, C., Wang, Y., et al. (2020a). Mobilecount: An efficient encoder–decoder framework for real-time crowd counting. Neurocomputing, 407, 292–299.
Wang, Y., Ma, L., Jiu, M., et al. (2020b). Detection of conductive particles in tft-lcd circuit using generative adversarial networks. IEEE Access, 8, 101,338-101,350.
Wang, Y., Zhou, Q., Liu, J., et al. (2019b). Lednet: A lightweight encoder–decoder network for real-time semantic segmentation. In: 2019 IEEE International Conference on Image Processing, (pp 1860–1864).
Yim, J., Joo, D., Bae, J., et al. (2017). A gift from knowledge distillation: Fast optimization, network minimization and transfer learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (pp 4133–4141)
Yu-ye, C., Ke, X., Zhen-xiong, G., et al. (2017). Detection of conducting particles bonding in the circuit of liquid crystal display. Chinese Journal of Liquid Crystals and Displays, 32(7), 553-559.
Zhang, X., Zhou, X., Lin, M., et al. (2018). Shufflenet: An extremely efficient convolutional neural network for mobile devices. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (pp. 6848–6856)
Acknowledgements
This research was supported by the key project of the National Natural Science Foundation of China under Grant Nos. U1604262, U1904211 and 62101502.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Wang, Y., Ma, L., Jian, L. et al. Conductive particle detection via efficient encoder–decoder network. J Intell Manuf 34, 3563–3577 (2023). https://doi.org/10.1007/s10845-022-02024-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10845-022-02024-w