Skip to main content
Log in

Image Segmentation of Rectal Tumor Based on Improved U-Net Model with Deep Learning

  • Published:
Journal of Signal Processing Systems Aims and scope Submit manuscript

Abstract

Rectal tumor is a common malignancy in the intestine. The death rate of rectal tumor ranks fourth among the malignant tumors of digestive system, which seriously threaten the life and health of patients. Endoscopic ultrasonography is the most commonly used method to detect rectal tumors. After obtaining CT images, doctors diagnose the condition with the naked eye and experience, which brings a certain workload to both the doctor and the patient. With the development of in-depth learning and the continuous iterative convolution neural network, more and more techniques have been applied in the field of medical image. Therefore, this paper studies and improves an ultrasonic image segmentation U-Net model for rectal tumors based on fuzzy logic attention mechanism. This paper first preprocesses the original image, enhances the details and reduces the image size.Then the image feature map is weighted by fuzzy logic and attention mechanism. In addition, the loop-back residual mechanism is used to optimize the model. At last, the results of several models are analyzed and compared. The results show that, compared with the U-Net model, the optimized model has a nearly 3% increase in image segmentation precision, almost unchanged recall, and both IoU and Dice have increased by about 2%. Overall, the model has good segmentation performance, and the introduction of RoI aware U-Net greatly reduces the use of video memory.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10

Similar content being viewed by others

References

  1. Gao, H., Zeng, X., Pan, D., & Zheng, B. (2020). Rectal tumor segmentation method based on improved u-net model. Journal of Computer Applications, 40(8), 2392–2397.

    Google Scholar 

  2. Gai, K., & Qiu, M. (2018). Optimal resource allocation using reinforcement learning for IoT content-centric services. Applied Soft Computing, 70, 12–21.

    Article  Google Scholar 

  3. Gai, K., & Qiu, M. (2018). Reinforcement learning-based content-centric services in mobile sensing. IEEE Network, 32(4), 34–39.

    Article  Google Scholar 

  4. Guo, Y., Zhuge, Q., Hu, J., et al. (2011). Optimal data allocation for scratch-pad memory on embedded multi-core systems. IEEE International Conference on Parallel Processing (ICPP), pp. 464–471.

  5. Zhang, L., Qiu, M., Tseng, W., & Sha, E. (2010). Variable partitioning and scheduling for MPSoC with virtually shared scratch pad memory. Journal of Signal Processing Systems, 58(2), 247–265.

    Article  Google Scholar 

  6. Qiu, M., Chen, Z., & Liu, M. (2014). Low-power low-latency data allocation for hybrid scratch-pad memory. IEEE Embedded Systems Letters, 6(4), 69–72.

    Article  Google Scholar 

  7. Qiu, M., Li, H., & Sha, E. (2009). Heterogeneous real-time embedded software optimization considering hardware platform, ACM symposium on Applied Computing, pp. 1637-1641.

  8. Qiu, M., Xue, C., Shao, Z., & Sha, E. (2007). Energy minimization with soft real-time and DVS for uniprocessor and multiprocessor embedded systems, ACM/IEEE Design, Automation, Test in Europe Conf. (DATE), pp. 1-6.

  9. Guo, Y., Zhuge, Q., Hu, J., et al. (2013). Data placement and duplication for embedded multicore systems with scratch pad memory, IEEE Transactions on Computer-Aided Design of Integrated Circuits.

  10. Qiu, M., Khisamutdinov, E., Zhao, Z., et al. (2013). RNA nanotechnology for computer design and in vivo computation, Philosophical Transactions of the Royal Society A.

  11. Qiu, M., Zhang, K., & Huang, M. (2004). An empirical study of web interface design on small display devices, IEEE/WIC/ACM International Conference on Web Intelligence (WI’04), pp 29-35.

  12. Zhang, Q., Huang, T., et al. (2013). A case study of sensor data collection and analysis in smart city, provenance in smart food supply chain. International Journal of Distributed Sensor Networks, 9(11).

  13. Su, H., Qiu, M., & Wang, H. (2012). Secure wireless communication system for smart grid with rechargeable electric vehicles. IEEE Communications Magazine, 50(8), 62–68.

    Article  Google Scholar 

  14. Qiu, M., Ming, Z., Wang, J., Yang, L., & Xiang, Y. (2014). Enabling cloud computing in emergency management systems. IEEE Cloud Computing, 1(4), 60–67.

    Article  Google Scholar 

  15. Shao, Z., Wang, M., Chen, Y., et al. (2007). Real-time dynamic voltage loop scheduling for multi-core embedded systems, IEEE Transactions on Circuits and Systems II, 54 (5), 445-449.

  16. Niu, J., Liu, C., Gao, Y., et al. (2013). Energy efficient task assignment with guaranteed probability satisfying timing constraints for embedded systems. IEEE Transactions on Parallel and Distributed Systems, 25(8), 2043–2052.

    Article  Google Scholar 

  17. Sulaiman, S. N., & Isa, N. A. M. (2010). Adaptive fuzzy-k-means clustering algorithm for image segmentation. IEEE Transactions on Consumer Electronics, 56(4), 2661–2668.

    Article  Google Scholar 

  18. Pal, N. R., & Pal, S. K. (1993). A review on image segmentation techniques. Pattern recognition, 26(9):1277–1294.

  19. Wani, M. A., & Batchelor, B. G. (1994). Edge-region-based segmentation of range images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(3), 314–319.

    Article  Google Scholar 

  20. Angelina, S., Suresh, L. P., & Veni, S. K. (2012). Image segmentation based on genetic algorithm for region growth and region merging. In: 2012 International Conference on Computing, Electronics and Electrical Technologies (ICCEET), IEEE, pp 970–974.

  21. Ugarriza, L. G., Saber, E., Vantaram, S. R., Amuso, V., Shaw, M., & Bhaskar, R. (2009). Automatic image segmentation by dynamic region growth and multiresolution merging. IEEE Transactions on Image Processing, 18(10), 2275–2288.

    Article  MathSciNet  MATH  Google Scholar 

  22. Qiu, M., Cao, D., Su, H., & Gai, K. (2016). Data transfer minimization for financial derivative pricing using Monte Carlo simulation with GPU in 5G. IEEE International Journal of Communication Systems, 29(16), 2364–2374.

    Article  Google Scholar 

  23. Liu, M., Zhang, S., et al. (2012). H Infinite State Estimation for Discrete-Time Chaotic Systems Based on a Unified Model, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), Vol. 42.

  24. Zhao, H., Chen, M., et al. (2016). A novel pre-cache schema for high performance Android system. Future Generation Computer Systems, 56, 766–772.

    Article  Google Scholar 

  25. Lin, K., Wang, W., Bi, Y., et al. (2016). Human localization based on inertial sensors and fingerprints in the Industrial Internet of Things. Computer Networks, 101, 113–126.

    Article  Google Scholar 

  26. Lu, Z., Wang, N., et al. (2018). IoTDeM: An IoT Big Data-oriented MapReduce performance prediction extended model in multiple edge clouds. Journal of Parallel and Distributed Computing, 118, 316–327.

    Article  Google Scholar 

  27. Qiu, M., Liu, J., Li, J., et al. (2011). A novel energy-aware fault tolerance mechanism for wireless sensor networks, IEEE/ACM International Conference on Green Computing and Communications.

  28. Qiu, H., Qiu, M., Memmi, G., Ming, Z., & Liu, M. (2018). A dynamic scalable blockchain based communication architecture for IoT, International Conference on Smart Blockchain, 159-166.

  29. Zhang, Z., Wu, J., et al. (2008). Jamming ACK attack to wireless networks and a mitigation approach. IEEE GLOBECOM, pp. 1–5.

  30. Tang, X., Li, K., et al. (2012). A hierarchical reliability-driven scheduling algorithm in grid systems. Journal of Parallel and Distributed Computing, 72(4), 525–535.

    Article  Google Scholar 

  31. Irving, Benjamin and Cifor, Amalia and Papież, Bartłomiej W., et al. (2014). Automated colorectal tumour segmentation in DCE-MRI using supervoxel neighbourhood contrast characteristics. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp 609–616.

  32. Van, H., Miriam, M., Lambregts, Doenja, M. J., Van ,G., Joost, J. M., Stanley, O., et al. (2016). Automated and semiautomated segmentation of rectal tumor volumes on diffusion-weighted MRI: can it replace manual volumetry? International Journal of Radiation Oncology* Biology* Physics, 94(4):824–831.

  33. Ran, Z., Jian, J., Wang, M., Zhao, X., & Gao, X. (2019). Automatic segmentation of tumor magnetic resonance imaging based on full convolutional neural network. Beijing Biomedical Engineering, 38(05), 465–471.

    Google Scholar 

  34. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016). Rethinking the inception architecture for computer vision. In: IEEE Conference on Computer Vision and Pattern Recognition, pp 2818–2826.

  35. Alom, M. Z., Yakopcic, C., Hasan, M., Taha, T. M., & Asari, V. K. (2019). Recurrent residual U-Net for medical image segmentation. Journal of Medical Imaging, 6(1).

  36. Xu, Z., Wang, S., Stanislawski, L. V., Jiang, Z., Jaroenchai, N., Sainju, A. M., et al. (2021). An attention u-net model for detection of fine-scale hydrologic streamlines. Environmental Modelling & Software, 140,.

  37. Fan, J., Yau, D. K., Elmagarmid, A. K., & Aref, W. G. (2001). Automatic image segmentation by integrating color-edge extraction and seeded region growing. IEEE transactions on image processing, 10(10), 1454–1466.

    Article  MATH  Google Scholar 

  38. Ma, W. Y., & Manjunath, B. (1997). Edge flow: a framework of boundary detection and image segmentation. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, IEEE, pp 744–749.

  39. Tabb, M., & Ahuja, N. (1997). Multiscale image segmentation by integrated edge and region detection. IEEE Transactions on Image Processing, 6(5), 642–655.

    Article  Google Scholar 

  40. Aguirre, N., Grall-Maës, E., Cymberknop, L. J., & Armentano, R. L. (2021). Blood pressure morphology assessment from photoplethysmogram and demographic information using deep learning with attention mechanism. Sensors, 21(6), 2167.

    Article  Google Scholar 

  41. Sahu, R. K., Müller, J., Park, J., Varadharajan, C., Arora, B., Faybishenko, B., & Agarwal, D. (2020). Impact of input feature selection on groundwater level prediction from a multi-layer perceptron neural network. Frontiers in Water, 2, 46.

    Article  Google Scholar 

  42. Guo, J., Li, Y., Lin, W., Chen, Y., & Li, J. (2018). Network decoupling: From regular to depthwise separable convolutions. arXiv preprint arXiv:180805517.

  43. Jang, J. S. (1993). Anfis: adaptive-network-based fuzzy inference system. IEEE Transactions on Systems, Man, and Cybernetics, 23(3), 665–685.

    Article  Google Scholar 

  44. Kalambet, Y., Kozmin, Y., Mikhailova, K., Nagaev, I., & Tikhonov, P. (2011). Reconstruction of chromatographic peaks using the exponentially modified Gaussian function. Journal of Chemometrics, 25(7), 352–356.

    Article  Google Scholar 

  45. Wang, Q., & Luo, L. (2021). Sequential fault detection and classification in chemical process using a deep convolutional encoder-decoder architecture based on system dynamics. In: IOP Conference Series: Earth and Environmental Science, IOP Publishing, vol 696, p 012052.

  46. LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989). Backpropagation applied to handwritten zip code recognition. Neural computation, 1(4), 541–551.

    Article  Google Scholar 

  47. Yu, H. (2019). Research on the classification of retinal diseases based on se-block. Master’s thesis, Jilin University.

  48. Li, G., Zhang, C., Lei, R., Zhang, X., Ye, Z., & Li, X. (2020). Hyperspectral remote sensing image classification using three-dimensional-squeeze-and-excitation-densenet (3d-se-densenet). Remote Sensing Letters, 11(2), 195–203.

    Article  Google Scholar 

  49. Axiang, Y., Chengrun, L., Shuyi, Y., & Hongjun, L. (2021). Multi-attention mechanism of mask wearing detection network. Journal of Nanjing Normal University (Engineering Technology Edition)[ISSN: 1006-6977/CN: 61-1281/TN], (1):23–29.

  50. Tang, W. (2019). Research on liver ct image segmentation method based on deep learning. Master’s thesis, Chongqing University.

  51. He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. IEEE Conference on Computer Vision and Pattern Recognition, pp 770–778.

Download references

Acknowledgements

This work is supported by the National Natural Science Foundation of China (No.62072008, No.62031013).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Faguo Zhou.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This article is part of the Topical Collection on: Big Data Security Track

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhou, F., Ye, Y. & Song, Y. Image Segmentation of Rectal Tumor Based on Improved U-Net Model with Deep Learning. J Sign Process Syst 94, 1145–1157 (2022). https://doi.org/10.1007/s11265-021-01710-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11265-021-01710-x

Keywords

Navigation