Abstract
Tropical Cyclone (TC) intensity estimation is a continuous label classification problem, which aims to build a mapping relationship from TC images to intensities. Due to the similar visual appearance of TCs in adjacent intensities, the discriminative image representation plays an important role in TC intensity estimation. Existing works mainly revolve around the continuity of intensity which may result in a crowded feature distribution and perform poorly at distinguishing the boundaries of categories. In this paper, we focus on jointly learning category-level and instance-level representations from tropical cyclone images. Specially, we propose a general framework containing a CI-extractor and a classifier, inside which the CI-extractor is used to extract an instance-separable and category-discriminative representation between images. Meanwhile, an inter-class distance consistency (IDC) loss is applied on top of the framework which can lead to a more uniform feature distribution. In addition, a non-parameter smoothing algorithm is proposed to aggregate temporal information from the image sequence. Extensive experiments demonstrate that our method, with the result of 7.35 knots at RMSE, outperforms the state-of-the-art TC intensity estimation method on the TCIR dataset.
Supported by the National Natural Science Foundation of China (NSFC No. 62076031).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Chen, B., Chen, B.F., Lin, H.T.: Rotation-blended CNNs on a new open dataset for tropical cyclone image-to-intensity regression. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 90–99 (2018)
Chen, B.F., Chen, B., Lin, H.T., Elsberry, R.L.: Estimating tropical cyclone intensity by satellite imagery utilizing convolutional neural networks. Weather Forecast. 34(2), 447–465 (2019)
Chen, Z., Yu, X.: A novel tensor network for tropical cyclone intensity estimation. IEEE Trans. Geosci. Remote Sens. 59(4), 3226–3243 (2021). https://doi.org/10.1109/TGRS.2020.3017709
Chopra, S., Hadsell, R., LeCun, Y.: Learning a similarity metric discriminatively, with application to face verification. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005), vol. 1, pp. 539–546. IEEE (2005)
Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: ImageNet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009)
Deng, J., Guo, J., Xue, N., Zafeiriou, S.: ArcFace: additive angular margin loss for deep face recognition. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 4690–4699 (2019)
Dvorak, V.F.: Tropical cyclone intensity analysis and forecasting from satellite imagery. Mon. Weather Rev. 103(5), 420–430 (1975)
Hadsell, R., Chopra, S., LeCun, Y.: Dimensionality reduction by learning an invariant mapping. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2006), vol. 2, pp. 1735–1742. IEEE (2006)
Harwood, B., Kumar BG, V., Carneiro, G., Reid, I., Drummond, T.: Smart mining for deep metric learning. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2821–2829 (2017)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Kidder, S.Q., et al.: Satellite analysis of tropical cyclones using the advanced microwave sounding unit (AMSU). Bull. Am. Meteor. Soc. 81(6), 1241–1260 (2000)
Kim, S., Seo, M., Laptev, I., Cho, M., Kwak, S.: Deep metric learning beyond binary supervision. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2288–2297 (2019)
Liu, W., Wen, Y., Yu, Z., Yang, M.: Large-margin softmax loss for convolutional neural networks. arXiv preprint arXiv:1612.02295 (2016)
Luo, Y., Xu, Y., Li, S., Qian, Q., Xiao, B.: DR-transformer: a multi-features fusion framework for tropical cyclones intensity estimation. Appl. Sci. 11(13), 6208 (2021)
Van der Maaten, L., Hinton, G.: Visualizing data using t-SNE. J. Mach. Learn. Res. 9(11), 2579–2605 (2008)
Mishchuk, A., Mishkin, D., Radenovic, F., Matas, J.: Working hard to know your neighbor’s margins: local descriptor learning loss. arXiv preprint arXiv:1705.10872 (2017)
Olander, T.L., Velden, C.S.: The advanced Dvorak technique (ADT) for estimating tropical cyclone intensity: update and new capabilities. Weather Forecast. 34(4), 905–922 (2019)
Pradhan, R., Aygun, R.S., Maskey, M., Ramachandran, R., Cecil, D.J.: Tropical cyclone intensity estimation using a deep convolutional neural network. IEEE Trans. Image Process. 27(2), 692–702 (2017)
Schroff, F., Kalenichenko, D., Philbin, J.: FaceNet: a unified embedding for face recognition and clustering. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 815–823 (2015)
Sohn, K.: Improved deep metric learning with multi-class N-pair loss objective. In: Advances in Neural Information Processing Systems, pp. 1857–1865 (2016)
Sun, Y., et al.: Circle loss: a unified perspective of pair similarity optimization. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 6398–6407 (2020)
Velden, C.S., Herndon, D.: A consensus approach for estimating tropical cyclone intensity from meteorological satellites: Satcon. Weather Forecast. 35(4), 1645–1662 (2020)
Wang, F., Cheng, J., Liu, W., Liu, H.: Additive margin softmax for face verification. IEEE Signal Process. Lett. 25(7), 926–930 (2018)
Wang, F., Xiang, X., Cheng, J., Yuille, A.L.: NormFace: L2 hypersphere embedding for face verification. In: Proceedings of the 25th ACM International Conference on Multimedia, pp. 1041–1049 (2017)
Wang, H., et al.: CosFace: large margin cosine loss for deep face recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5265–5274 (2018)
Weinberger, K.Q., Saul, L.K.: Distance metric learning for large margin nearest neighbor classification. J. Mach. Learn. Res. 10(2), 207–244 (2009)
Xu, Y., Yang, H., Cheng, M., Li, S.: Cyclone intensity estimate with context-aware cyclegan. In: 2019 IEEE International Conference on Image Processing (ICIP), pp. 3417–3421. IEEE (2019)
Zhang, C.J., Wang, X.J., Ma, L.M., Lu, X.Q.: Tropical cyclone intensity classification and estimation using infrared satellite images with deep learning. IEEE J. Sel. Top. Appl. Earth Observations Remote Sens. 14, 2070–2086 (2021)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Wang, D., Xu, Y., Luo, Y., Qian, Q., Yuan, L. (2023). CIRL: A Category-Instance Representation Learning Framework for Tropical Cyclone Intensity Estimation. In: Wang, L., Gall, J., Chin, TJ., Sato, I., Chellappa, R. (eds) Computer Vision – ACCV 2022. ACCV 2022. Lecture Notes in Computer Science, vol 13842. Springer, Cham. https://doi.org/10.1007/978-3-031-26284-5_9
Download citation
DOI: https://doi.org/10.1007/978-3-031-26284-5_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-26283-8
Online ISBN: 978-3-031-26284-5
eBook Packages: Computer ScienceComputer Science (R0)