Abstract
Hand posture estimation is an important step in hand gesture detection. It refers to the process of modeling hand in computer to accurately represent the actual hand obtained from an acquisition device. In the literature, several objective functions (mostly based on silhouette or point cloud) have been used to formulate and solve the problem of hand posture estimation as a minimisation problem using stochastic or deterministic algorithms. The main challenge is that the objective function is computationally expensive. In the case of using point clouds, decreasing the number of points results in a better computational cost, but it decreases the accuracy of hand posture estimation. We argue in this paper that hand posture estimation is a bi-objective problem with two conflicting objectives: minimising the error versus minimising the number of points in the point cloud. As an early effort, this paper first formulates hand posture estimation as a bi-objective optimisation problem and then approximates its true Pareto optimal front with an improved Multi-Objective Particle Swarm Optimisation (MOPSO) algorithm. The proposed algorithm is used to determine the Pareto optimal front for 16 hand postures and compared with the original MOPSO. The results proved that the objectives are in conflict and the improved MOPSO outperforms the original algorithm when solving this problem.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Coogan, T., Awad, G., Han, J., Sutherland, A.: Real time hand gesture recognition including hand segmentation and tracking. In: Bebis, G., et al. (eds.) ISVC 2006. LNCS, vol. 4291, pp. 495–504. Springer, Heidelberg (2006). doi:10.1007/11919476_50
Singhai, S., Satsangi, C.: Hand segmentation for hand gesture recognition. In: Workshop on Interactive Multimedia on Mobile and Portable Devices, vol. 1, pp. 48–52 (2014)
Lee, J., Kunii, T.L.: Model-based analysis of hand posture. IEEE Comput. Graph. Appl. 15(5), 77–86 (1995)
Bourke, A.K., Obrien, J.V., Lyons, G.M.: Evaluation of a threshold-based tri-axial accelerometer fall detection algorithm. Gait Posture 26(2), 194–199 (2007)
Darrell, T.J., Essa, I.A., Pentland, A.P.: Task-specific gesture analysis in real-time using interpolated views. IEEE Trans. Pattern Anal. Mach. Intell. 18(12), 1236–1242 (1996)
Isard, M., Blake, A.: Condensation conditional density propagation for visual tracking. Int. J. Comput. Vis. 29(1), 5–28 (1998)
Argyros, A.A., Lourakis, M.I.A.: Binocular hand tracking and reconstruction based on 2D shape matching. In: 18th International Conference on Pattern Recognition, ICPR 2006, vol. 1, pp. 207–210. IEEE (2006)
Barsoum, E.: Articulated hand pose estimation review. arXiv preprint arXiv:1604.06195 (2016)
Taylor, J., Bordeaux, L., Cashman, T., Corish, B., Keskin, C., Sharp, T., Soto, E., Sweeney, D., Valentin, J., Luff, B., et al.: Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences. ACM Trans. Graph. (TOG) 35(4), 143 (2016)
Sharp, T., Keskin, C., Robertson, D., Taylor, J., Shotton, J., Kim, D., Rhemann, C., Leichter, I., Vinnikov, A., Wei, Y., et al.: Accurate, robust, and flexible real-time hand tracking. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp. 3633–3642. ACM (2015)
Rautaray, S.S., Agrawal, A.: Vision based hand gesture recognition for human computer interaction: a survey. Artif. Intell. Rev. 43(1), 1–54 (2015)
Ji, S., Wei, X., Yang, M., Kai, Y.: 3D convolutional neural networks for human action recognition. IEEE Trans. Pattern Anal. Mach. Intell. 35(1), 221–231 (2013)
Fanelli, G., Gall, J., Van Gool, L.: Real time head pose estimation with random regression forests. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 617–624. IEEE (2011)
Kopinski, T., Gepperth, A., Handmann, U.: A simple technique for improving multi-class classification with neural networks. In: Proceedings, p. 469. Presses universitaires de Louvain (2015)
Sato, Y., Saito, M., Koike, H.: Real-time input of 3D pose and gestures of a user’s hand and its applications for HCI. In: Proceedings of 2001 IEEE Virtual Reality, pp. 79–86. IEEE (2001)
Tang, D., Yu, T.-H., Kim, T.-K.: Real-time articulated hand pose estimation using semi-supervised transductive regression forests. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 3224–3231 (2013)
Sun, X., Wei, Y., Liang, S., Tang, X., Sun, J.: Cascaded hand pose regression. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 824–832 (2015)
Coello, C.A.C., Pulido, G.T., Lechuga, M.S.: Handling multiple objectives with particle swarm optimization. IEEE Trans. Evol. Comput. 8(3), 256–279 (2004)
Ge, L., Liang, H., Yuan, J., Thalmann, D.: Robust 3D hand pose estimation in single depth images: from single-view CNN to multi-view CNNs. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3593–3601 (2016)
Tompson, J., Stein, M., Lecun, Y., Perlin, K.: Real-time continuous pose recovery of human hands using convolutional networks. ACM Trans. Graph. (ToG) 33(5), 169 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Saremi, S., Mirjalili, S., Lewis, A., Liew, A.WC. (2017). Let’s Consider Two Objectives When Estimating Hand Postures. In: Peng, W., Alahakoon, D., Li, X. (eds) AI 2017: Advances in Artificial Intelligence. AI 2017. Lecture Notes in Computer Science(), vol 10400. Springer, Cham. https://doi.org/10.1007/978-3-319-63004-5_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-63004-5_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-63003-8
Online ISBN: 978-3-319-63004-5
eBook Packages: Computer ScienceComputer Science (R0)