Abstract
The proliferation of high-content microscopes (\(\sim \)32 GB for a single image) and the increasing amount of image data generated daily have created a pressing need for compact storage solutions. Not only is the storage of such massive image data cumbersome, but it also requires a significant amount of storage and data bandwidth for transmission. To address this issue, we present a novel deep learning technique called Guided U-Net (GU-Net) that compresses images by training a U-Net architecture with a loss function that incorporates shape, budget, and skeleton losses. The trained model learns to selects key points in the image that need to be stored, rather than the entire image. Compact image representation is different from image compression because the former focuses on assigning importance to each pixel in an image and selecting the most important ones for storage whereas the latter encodes information of the entire image for more efficient storage. Experimental results on four datasets (CMATER, UiTMito, MNIST, and HeLA) show that GU-Net selects only a small percentage of pixels as key points (3%, 3%, 5%, and 22% on average, respectively), significantly reducing storage requirements while preserving essential image features. Thus, this approach offers a more efficient method of storing image data, with potential applications in a range of fields where large-scale imaging is a vital component of research and development.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Abu-Ain, W., Abdullah, S.N.H.S., Bataineh, B., Abu-Ain, T., Omar, K.: Skeletonization algorithm for binary images. Procedia Technol. 11, 704–709 (2013)
Atienza, R.: Pyramid U-network for skeleton extraction from shape points. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (2019)
Bhowmik, S., Malakar, S., Sarkar, R., Basu, S., Kundu, M., Nasipuri, M.: Off-line Bangla handwritten word recognition: a holistic approach. Neural Comput. Appl. 31, 5783–5798 (2019)
Boland, M.V., Murphy, R.F.: A neural network classifier capable of recognizing the patterns of all major subcellular structures in fluorescence microscope images of hela cells. Bioinformatics 17(12), 1213–1223 (2001)
Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 6, 679–698 (1986)
Castleman, K.R.: Digital Image Processing. Prentice Hall Press, Hoboken (1996)
Guo, Z., Hall, R.W.: Fast fully parallel thinning algorithms. CVGIP Image Understanding 55(3), 317–328 (1992)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Ko, D.H., Hassan, A.U., Majeed, S., Choi, J.: SkelGAN: a font image skeletonization method. J. Inf. Process. Syst. 17(1), 1–13 (2021)
Malakar, S., Sharma, P., Singh, P.K., Das, M., Sarkar, R., Nasipuri, M.: A holistic approach for handwritten Hindi word recognition. Int. J. Comput. Vision Image Process. (IJCVIP) 7(1), 59–78 (2017)
Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28
Rosenfeld, A.: A characterization of parallel thinning algorithms. Inf. Control 29(3), 286–291 (1975)
Sekh, A.A., et al.: Physics-based machine learning for subcellular segmentation in living cells. Nat. Mach. Intell. 3(12), 1071–1080 (2021)
Shen, W., Zhao, K., Jiang, Y., Wang, Y., Bai, X., Yuille, A.: Deepskeleton: learning multi-task scale-associated deep side outputs for object skeleton extraction in natural images. IEEE Trans. Image Process. 26(11), 5298–5311 (2017)
Villegas-Hernández, L.E., et al.: Chip-based multimodal super-resolution microscopy for histological investigations of cryopreserved tissue sections. Light Sci. Appl. 11(1), 43 (2022)
Yan, L., Corinna, C., Burges, C.: The MNIST dataset of handwritten digits (1998)
Zhang, T.Y., Suen, C.Y.: A fast parallel algorithm for thinning digital patterns. Commun. ACM 27(3), 236–239 (1984)
Acknowledgment
This work was supported by the nanoAI Research Council of Norway Project No. 325741, H2020 Project (OrganVision) 964800, and VirtualStain (UiT) Cristin Project ID: 2061348.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Banerjee, N., Malakar, S., Gupta, D.K., Horsch, A., Prasad, D.K. (2023). Guided U-Net Aided Efficient Image Data Storing with Shape Preservation. In: Lu, H., Blumenstein, M., Cho, SB., Liu, CL., Yagi, Y., Kamiya, T. (eds) Pattern Recognition. ACPR 2023. Lecture Notes in Computer Science, vol 14406. Springer, Cham. https://doi.org/10.1007/978-3-031-47634-1_24
Download citation
DOI: https://doi.org/10.1007/978-3-031-47634-1_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-47633-4
Online ISBN: 978-3-031-47634-1
eBook Packages: Computer ScienceComputer Science (R0)