Abstract
Prolonged maintenance of poor sitting posture can have detrimental effects on human health. Thus, maintaining a healthy sitting posture is crucial for individuals who spend long durations sitting. The recent Vision Transformer (ViT) models have shown promising results in various computer vision tasks. However, it faces challenges such as limited receptive field and excessive parameter quantity. To tackle these issues, we propose SCFormer. To begin with, we utilize the Regular Split Channel (RSC) module to partition the feature map along the channel dimension using specific rules. This enables the flow of spatial information within the channel dimension while severing positional information between adjacent channels, ultimately improving the model’s generalization. To extract local feature information and reduce computational complexity, we employ striped windows with parallel self-attention mechanisms over a subset of channels in the feature map. Lastly, we introduce Global Window Feedback (GWF), which exploits redundant information within the channel dimension through simple linear operations, enabling the extraction of inter-window global information and expanding the receptive field. By incorporating these design elements and employing a hierarchical structure, SCFormer demonstrates competitive performance in sitting posture recognition tasks. We achieve successful identification of 10 classes of sitting postures on our dataset, attaining an accuracy of 95%, surpassing current state-of-the-art models.
Supported by Innovation Challenge Project of China (Ningbo) (No. 2022T001).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Cagnie, B., Danneels, L., Van Tiggelen, D., De Loose, V., Cambier, D.: Individual and work related risk factors for neck pain among office workers: a cross sectional study. Eur. Spine J. 16, 679–686 (2007). https://doi.org/10.1007/s00586-006-0269-7
Murphy, S., Buckle, P., Stubbs, D.: Classroom posture and self-reported back and neck pain in schoolchildren. Appl. Ergon. 35(2), 113–120 (2004)
O’Sullivan, P.B., Mitchell, T., Bulich, P., Waller, R., Holte, J.: The relationship beween posture and back muscle endurance in industrial workers with flexion-related low back pain. Man. Ther. 11(4), 264–271 (2006)
Ran, X., Wang, C., Xiao, Y., Gao, X., Zhu, Z., Chen, B.: A portable sitting posture monitoring system based on a pressure sensor array and machine learning. Sens. Actuators, A 331, 112900 (2021)
Chen, K.: Sitting posture recognition based on OpenPose. In: IOP Conference Series: Materials Science and Engineering, vol. 677, p. 032057. IOP Publishing (2019)
Han, K., Xiao, A., Wu, E., Guo, J., Xu, C., Wang, Y.: Transformer in transformer. In: Advances in Neural Information Processing Systems, vol. 34, pp. 15908–15919 (2021)
He, J., et al.: TransFG: a transformer architecture for fine-grained recognition. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 36, pp. 852–860 (2022)
Liu, Z., et al.: Swin transformer: hierarchical vision transformer using shifted windows. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 10012–10022 (2021)
Wan, Q., Zhao, H., Li, J., Xu, P.: Hip positioning and sitting posture recognition based on human sitting pressure image. Sensors 21(2), 426 (2021)
Hu, Q., Tang, X., Tang, W.: A smart chair sitting posture recognition system using flex sensors and FPGA implemented artificial neural network. IEEE Sens. J. 20(14), 8007–8016 (2020)
Meyer, J., Arnrich, B., Schumm, J., Troster, G.: Design and modeling of a textile pressure sensor for sitting posture classification. IEEE Sens. J. 10(8), 1391–1398 (2010)
Li, L., Yang, G., Li, Y., Zhu, D., He, L.: Abnormal sitting posture recognition based on multi-scale spatiotemporal features of skeleton graph. Eng. Appl. Artif. Intell. 123, 106374 (2023)
Fang, Y., Shi, S., Fang, J., Yin, W.: SPRNet: sitting posture recognition using improved vision transformer. In: 2022 International Joint Conference on Neural Networks (IJCNN), pp. 1–6. IEEE (2022)
Dosovitskiy, A., et al.: An image is worth \(16\times 16\) words: transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020)
Wang, W., et al.: Pyramid vision transformer: a versatile backbone for dense prediction without convolutions. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 568–578 (2021)
Dong, X., et al.: CSWin transformer: a general vision transformer backbone with cross-shaped windows. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 12124–12134 (2022)
Islam, M.A., Kowal, M., Jia, S., Derpanis, K.G., Bruce, N.D.: Global pooling, more than meets the eye: position information is encoded channel-wise in CNNs. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 793–801 (2021)
Vaswani, A., Ramachandran, P., Srinivas, A., Parmar, N., Hechtman, B., Shlens, J.: Scaling local self-attention for parameter efficient visual backbones. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 12894–12904 (2021)
Xiao, J., Fu, X., Zhou, M., Liu, H., Zha, Z.J.: Random shuffle transformer for image restoration. In: International Conference on Machine Learning, pp. 38039–38058. PMLR (2023)
Han, K., Wang, Y., Tian, Q., Guo, J., Xu, C., Xu, C.: GhostNet: more features from cheap operations. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1580–1589 (2020)
Wang, W., et al.: CrossFormer: a versatile vision transformer hinging on cross-scale attention. arXiv preprint arXiv:2108.00154 (2021)
Ren, S., Zhou, D., He, S., Feng, J., Wang, X.: Shunted self-attention via multi-scale token aggregation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10853–10862 (2022)
Acknowledgements
Shoudong Shi is the corresponding author of this work. This work was supported by the Innovation Challenge Project of China (Ningbo) under Grant No. 2022T001.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Qiu, K., Shi, S., Zhao, T., Ye, Y. (2024). SCFormer: A Vision Transformer with Split Channel in Sitting Posture Recognition. In: Rudinac, S., et al. MultiMedia Modeling. MMM 2024. Lecture Notes in Computer Science, vol 14554. Springer, Cham. https://doi.org/10.1007/978-3-031-53305-1_4
Download citation
DOI: https://doi.org/10.1007/978-3-031-53305-1_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-53304-4
Online ISBN: 978-3-031-53305-1
eBook Packages: Computer ScienceComputer Science (R0)