Abstract
An agent has to form a team at run-time in a dynamic environment for some tasks that are not completely specified. For instance, the mass of an object may not be given. Estimating the mass of an object helps in determining the team size, which can then be used for team formation. It has recently been shown that the mass of an object can be estimated from its image. In this paper we augment the existing image2mass model with material embedding. The resulting model has been extensively tested. The experimental results indicate that our model has achieved some improvements on the existing state-of-the-art model for some performance metrics.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Agmon, N., Stone, P.: Leading ad hoc agents in joint action settings with multiple teammates. In: AAMAS, pp. 341–348 (2012)
Aujeszky, T., Korres, G., Eid, M., Khorrami, F.: Estimating weight of unknown objects using active thermography. Robotics 8(4), 1–13 (2019)
Balaban, M.O., Ünal Şengör, G.F., Soriano, M.G., Ruiz, E.G.: Using image analysis to predict the weight of Alaskan salmon of different species. J. Food Sci. 75(3), E157–E162 (2010)
Bell, S., Upchurch, P., Snavely, N., Bala, K.: Opensurfaces: a richly annotated catalog of surface appearance. ACM Trans. Graph. 32(4), 1–17 (2013)
Bell, S., Upchurch, P., Snavely, N., Bala, K.: Material recognition in the wild with the materials in context database. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3479–3487 (2015)
Bozkurt, Y., Aktan, S., Ozkaya, S.: Body weight prediction using digital image analysis for slaughtered beef cattle. J. Appl. Anim. Res. 32(2), 195–198 (2007)
Chaithanya, C., Priya, S.: Object weight estimation from 2D images. ARPN J. Eng. Appl. Sci. 10(17) (2015)
Dohmen, R., Catal, C., Liu, Q.: Image-based body mass prediction of heifers using deep neural networks. Biosys. Eng. 204, 283–293 (2021)
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. Adv. Neural. Inf. Process. Syst. 25, 1097–1105 (2012)
Krotkov, E.: Robotic perception of material. In: IJCAI, pp. 88–95 (1995)
Le, S., Lee, M., Fang, A.: Non-linear image-based regression of body segment parameters. In: Lim, C.T., Goh, J.C.H. (eds.) 13th International Conference on Biomedical Engineering. IFMBE Proceedings, vol. 23, pp. 2038–2042. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-540-92841-6_508
Mavrakis, N., Stolkin, R.: Estimation and exploitation of objects’ inertial parameters in robotic grasping and manipulation: a survey. Robot. Auton. Syst. 124, 103374 (2020)
Nath, A., AR, A., Niyogi, R.: A distributed approach for road clearance with multi-robot in urban search and rescue environment. Int. J. Intell. Robot. Appl. 3(4), 392–406 (2019)
Nath, A., AR, A., Niyogi, R.: A distributed approach for autonomous cooperative transportation in a dynamic multi-robot environment. In: Proceedings of the 35th Annual ACM Symposium on Applied Computing, pp. 792–799 (2020)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
Singh, S.K., Vidyarthi, S.K., Tiwari, R.: Machine learnt image processing to predict weight and size of rice kernels. J. Food Eng. 274, 109828 (2020)
Standley, T., Sener, O., Chen, D., Savarese, S.: image2mass: estimating the mass of an object from its image. In: Conference on Robot Learning, pp. 324–333 (2017)
Szegedy, C., et al.: Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9 (2015)
Tadokoro, S., et al.: The robocup-rescue project: a robotic approach to the disaster mitigation problem. In: Proceedings ICRA, vol. 4, pp. 4089–4094. IEEE (2000)
Vidyarthi, S.K., Tiwari, R., Singh, S.K.: Size and mass prediction of almond kernels using machine learning image processing. bioRxiv p. 736348 (2020)
Vidyarthi, S.K., Tiwari, R., Singh, S.K., Xiao, H.W.: Prediction of size and mass of pistachio kernels using random forest machine learning. J. Food Process Eng. 43(9), e13473 (2020)
Acknowledgements
The third author was in part supported by a research grant from Google.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Patel, D., Nath, A., Niyogi, R. (2022). Adding Material Embedding to the image2mass Problem. In: Gervasi, O., Murgante, B., Misra, S., Rocha, A.M.A.C., Garau, C. (eds) Computational Science and Its Applications – ICCSA 2022 Workshops. ICCSA 2022. Lecture Notes in Computer Science, vol 13377. Springer, Cham. https://doi.org/10.1007/978-3-031-10536-4_6
Download citation
DOI: https://doi.org/10.1007/978-3-031-10536-4_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-10535-7
Online ISBN: 978-3-031-10536-4
eBook Packages: Computer ScienceComputer Science (R0)