skip to main content
10.1145/3664647.3680941acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Heterogeneous Graph Guided Contrastive Learning for Spatially Resolved Transcriptomics Data

Published: 28 October 2024 Publication History

Abstract

Spatial transcriptomics provides revolutionary insights into cellular interactions and disease development mechanisms by combining high-throughput gene sequencing and spatially resolved imaging technologies to analyze genes naturally associated with spatially variable tissue genes. However, existing methods typically map aggregated multi-view features into a unified representation, ignoring the heterogeneity and view independence of genes and spatial information. To this end, we construct a heterogeneous Graph guided Contrastive Learning (stGCL) for aggregating spatial transcriptomics data. The method is guided by the inherent heterogeneity of cellular molecules by dynamically coordinating triple-level node attributes through comparative learning loss distributed across view domains, thus maintaining view independence during the aggregation process. In addition, we introduce a cross-view hierarchical feature alignment module employing a parallel approach to decouple spatial and genetic views on molecular structures while aggregating multi-view features according to information theory, thereby enhancing the integrity of inter- and intra-views. Rigorous experiments demonstrate that stGCL outperforms existing methods in various tasks and related downstream applications.

References

[1]
E Buache, N Etique, F Alpy, I Stoll, M Muckensturm, B Reina-San-Martin, MP Chenard, C Tomasetto, and MC Rio. 2011. Deficiency in trefoil factor 1 (TFF1) increases tumorigenicity of human breast cancer cells and mammary tumor development in TFF1-knockout mice. Oncogene, Vol. 30, 29 (2011), 3261--3273.
[2]
Zixuan Cang, Yanxiang Zhao, Axel A Almet, Adam Stabell, Raul Ramos, Maksim V Plikus, Scott X Atwood, and Qing Nie. 2023. Screening cell-cell communication in spatial transcriptomics via collective optimal transport. Nature methods, Vol. 20, 2 (2023), 218--228.
[3]
Hao Chen, Dongshunyi Li, and Ziv Bar-Joseph. 2023. SCS: cell segmentation for high-resolution spatial transcriptomics. Nature methods, Vol. 20, 8 (2023), 1237--1243.
[4]
Wei-Ting Chen, Ashley Lu, Katleen Craessaerts, Benjamin Pavie, Carlo Sala Frigerio, Nikky Corthout, Xiaoyan Qian, Jana Laláková, Malte Kühnemund, Iryna Voytyuk, et al. 2020. Spatial transcriptomics and in situ sequencing to study Alzheimer's disease. Cell, Vol. 182, 4 (2020), 976--991.
[5]
Daniel Dar, Nina Dar, Long Cai, and Dianne K Newman. 2021. Spatial transcriptomics of planktonic and sessile bacterial populations at single-cell resolution. Science, Vol. 373, 6556 (2021), eabi4882.
[6]
Shuangsang Fang, Bichao Chen, Yong Zhang, Haixi Sun, Longqi Liu, Shiping Liu, Yuxiang Li, and Xun Xu. 2023. Computational approaches and challenges in spatial transcriptomics. Genomics, Proteomics and Bioinformatics, Vol. 21, 1 (2023), 24--47.
[7]
Xiao He, Chang Tang, Xinwang Liu, Wei Zhang, Kun Sun, and Jiangfeng Xu. 2023. Object Detection in Hyperspectral Image via Unified Spectral-Spatial Feature Aggregation. IEEE Transactions on Geoscience and Remote Sensing (2023).
[8]
Xiao He, Chang Tang, Xin Zou, and Wei Zhang. 2023. Multispectral Object Detection via Cross-Modal Conflict-Aware Learning. In Proceedings of the 31st ACM International Conference on Multimedia. 1465--1474.
[9]
Jian Hu, Xiangjie Li, Kyle Coleman, Amelia Schroeder, Nan Ma, David J Irwin, Edward B Lee, Russell T Shinohara, and Mingyao Li. 2021. SpaGCN: Integrating gene expression, spatial location and histology to identify spatial domains and spatially variable genes by graph convolutional network. Nature methods, Vol. 18, 11 (2021), 1342--1351.
[10]
Yuran Jia, Junliang Liu, Li Chen, Tianyi Zhao, and Yadong Wang. 2024. THItoGene: a deep learning method for predicting spatial transcriptomics from histological images. Briefings in Bioinformatics, Vol. 25, 1 (2024), bbad464.
[11]
Jiachen Li, Siheng Chen, Xiaoyong Pan, Ye Yuan, and Hong-Bin Shen. 2022. Cell clustering for spatial transcriptomics data with graph neural networks. Nature Computational Science, Vol. 2, 6 (2022), 399--408.
[12]
Teng Liu, Zhao-Yu Fang, Xin Li, Li-Ning Zhang, Dong-Sheng Cao, and Ming-Zhu Yin. 2023. Graph deep learning enabled spatial domains identification for spatial transcriptomics. Briefings in Bioinformatics, Vol. 24, 3 (2023), bbad146.
[13]
Tianyu Liu, Yuge Wang, Rex Ying, and Hongyu Zhao. 2024. MuSe-GNN: Learning Unified Gene Representation From Multimodal Biological Graph Data. Advances in Neural Information Processing Systems, Vol. 36 (2024).
[14]
Yahui Long, Kok Siong Ang, Mengwei Li, Kian Long Kelvin Chong, Raman Sethi, Chengwei Zhong, Hang Xu, Zhiwei Ong, Karishma Sachaphibulkij, Ao Chen, et al. 2023. Spatially informed clustering, integration, and deconvolution of spatial transcriptomics with GraphST. Nature Communications, Vol. 14, 1 (2023), 1155.
[15]
Kristen R Maynard, Leonardo Collado-Torres, Lukas M Weber, Cedric Uytingco, Brianna K Barry, Stephen R Williams, Joseph L Catallini, Matthew N Tran, Zachary Besich, Madhavi Tippani, et al. 2021. Transcriptome-scale spatial gene expression in the human dorsolateral prefrontal cortex. Nature neuroscience, Vol. 24, 3 (2021), 425--436.
[16]
Andreas E Moor and Shalev Itzkovitz. 2017. Spatial transcriptomics: paving the way for tissue-level systems biology. Current opinion in biotechnology, Vol. 46 (2017), 126--133.
[17]
Giovanni Palla, Hannah Spitzer, Michal Klein, David Fischer, Anna Christina Schaar, Louis Benedikt Kuemmerle, Sergei Rybakov, Ignacio L Ibarra, Olle Holmberg, Isaac Virshup, et al. 2022. Squidpy: a scalable framework for spatial omics analysis. Nature methods, Vol. 19, 2 (2022), 171--178.
[18]
Jiancheng Pan, Qing Ma, and Cong Bai. 2023. A Prior Instruction Representation Framework for Remote Sensing Image-text Retrieval. In Proceedings of the 31st ACM International Conference on Multimedia. 611--620.
[19]
Jiancheng Pan, Qing Ma, and Cong Bai. 2023. Reducing Semantic Confusion: Scene-aware Aggregation Network for Remote Sensing Cross-modal Retrieval. In Proceedings of the 2023 ACM International Conference on Multimedia Retrieval. 398--406.
[20]
Duy Pham, Xiao Tan, Jun Xu, Laura F Grice, Pui Yeng Lam, Arti Raghubar, Jana Vukovic, Marc J Ruitenberg, and Quan Nguyen. 2020. stLearn: integrating spatial location, tissue morphology and gene expression to find cell types, cell-cell interactions and spatial trajectories within undissociated tissues. BioRxiv (2020), 2020--05.
[21]
Monika Piwecka, Nikolaus Rajewsky, and Agnieszka Rybak-Wolf. 2023. Single-cell and spatial transcriptomics: deciphering brain complexity in health and disease. Nature Reviews Neurology, Vol. 19, 6 (2023), 346--362.
[22]
Honglei Ren, Benjamin L Walker, Zixuan Cang, and Qing Nie. 2022. Identifying multicellular spatiotemporal organization of cells with SpaceFlow. Nature communications, Vol. 13, 1 (2022), 4076.
[23]
Beibei Ru, Jinlin Huang, Yu Zhang, Kenneth Aldape, and Peng Jiang. 2023. Estimation of cell lineages in tumors from spatial transcriptomics data. Nature Communications, Vol. 14, 1 (2023), 568.
[24]
Patrik L Ståhl, Fredrik Salmén, Sanja Vickovic, Anna Lundmark, José Fernández Navarro, Jens Magnusson, Stefania Giacomello, Michaela Asp, Jakub O Westholm, Mikael Huss, et al. 2016. Visualization and analysis of gene expression in tissue sections by spatial transcriptomics. Science, Vol. 353, 6294 (2016), 78--82.
[25]
Haotian Teng, Ye Yuan, and Ziv Bar-Joseph. 2022. Clustering spatial transcriptomics data. Bioinformatics, Vol. 38, 4 (2022), 997--1004.
[26]
Luyi Tian, Fei Chen, and Evan Z Macosko. 2023. The expanding vistas of spatial transcriptomics. Nature Biotechnology, Vol. 41, 6 (2023), 773--782.
[27]
Naftali Tishby, Fernando C Pereira, and William Bialek. 2000. The information bottleneck method. arXiv preprint physics/0004057 (2000).
[28]
Bo Wang, Jiawei Luo, Ying Liu, Wanwan Shi, Zehao Xiong, Cong Shen, and Yahui Long. 2023. Spatial-MGCN: a novel multi-view graph convolutional network for identifying spatial domains with attention mechanism. Briefings in Bioinformatics, Vol. 24, 5 (2023), bbad262.
[29]
Cameron G Williams, Hyun Jae Lee, Takahiro Asatsuma, Roser Vento-Tormo, and Ashraful Haque. 2022. An introduction to spatial transcriptomics for biomedical research. Genome Medicine, Vol. 14, 1 (2022), 68.
[30]
F Alexander Wolf, Philipp Angerer, and Fabian J Theis. 2018. SCANPY: large-scale single-cell gene expression data analysis. Genome biology, Vol. 19 (2018), 1--5.
[31]
Chang Xu, Xiyun Jin, Songren Wei, Pingping Wang, Meng Luo, Zhaochun Xu, Wenyi Yang, Yideng Cai, Lixing Xiao, Xiaoyu Lin, et al. 2022. DeepST: identifying spatial domains in spatial transcriptomics by deep learning. Nucleic Acids Research, Vol. 50, 22 (2022), e131--e131.
[32]
Hang Xu, Huazhu Fu, Yahui Long, Kok Siong Ang, Raman Sethi, Kelvin Chong, Mengwei Li, Rom Uddamvathanak, Hong Kai Lee, Jingjing Ling, et al. 2024. Unsupervised spatially embedded deep representation of spatial transcriptomics. Genome Medicine, Vol. 16, 1 (2024), 12.
[33]
Zhicheng Xu, Weiwen Wang, Tao Yang, Ling Li, Xizheng Ma, Jing Chen, Jieyu Wang, Yan Huang, Joshua Gould, Huifang Lu, et al. 2024. STOmicsDB: a comprehensive database for spatial transcriptomics data sharing, analysis and visualization. Nucleic Acids Research, Vol. 52, D1 (2024), D1053--D1061.
[34]
Zhuohan Yu, Yifu Lu, Yunhe Wang, Fan Tang, Ka-Chun Wong, and Xiangtao Li. 2022. Zinb-based graph embedding autoencoder for single-cell rna-seq interpretations. In Proceedings of the AAAI conference on artificial intelligence, Vol. 36. 4671--4679.
[35]
Ron Zeira, Max Land, Alexander Strzalkowski, and Benjamin J Raphael. 2022. Alignment and integration of spatial transcriptomics data. Nature Methods, Vol. 19, 5 (2022), 567--575.
[36]
Edward Zhao, Matthew R Stone, Xing Ren, Jamie Guenthoer, Kimberly S Smythe, Thomas Pulliam, Stephen R Williams, Cedric R Uytingco, Sarah EB Taylor, Paul Nghiem, et al. 2021. Spatial transcriptomics at subspot resolution with BayesSpace. Nature biotechnology, Vol. 39, 11 (2021), 1375--1384.
[37]
Xiang Zhou, Kangning Dong, and Shihua Zhang. 2023. Integrating spatial transcriptomics data across different conditions, technologies and developmental stages. Nature Computational Science, Vol. 3, 10 (2023), 894--906.
[38]
Xin Zou, Chang Tang, Wei Zhang, Kun Sun, and Liangxiao Jiang. 2023. Hierarchical Attention Learning for Multimodal Classification. In 2023 IEEE International Conference on Multimedia and Expo (ICME). IEEE, 936--941.
[39]
Xin Zou, Chang Tang, Xiao Zheng, Zhenglai Li, Xiao He, Shan An, and Xinwang Liu. 2023. DPNET: Dynamic Poly-attention Network for Trustworthy Multi-modal Classification. In Proceedings of the 31st ACM International Conference on Multimedia. 3550--3559.
[40]
Xin Zou, Chang Tang, Xiao Zheng, Kun Sun, Wei Zhang, and Deqiong Ding. 2023. Inclusivity induced adaptive graph learning for multi-view clustering. Knowledge-Based Systems, Vol. 267 (2023), 110424.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '24: Proceedings of the 32nd ACM International Conference on Multimedia
October 2024
11719 pages
ISBN:9798400706868
DOI:10.1145/3664647
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 October 2024

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. clustering
  2. cross-modality fusion
  3. multi-view learning

Qualifiers

  • Research-article

Funding Sources

  • National Science Foundation of China
  • the Fundamental Research Program of Shanxi Province
  • Shanxi Scholarship Council of China
  • the National Science Foundation of China
  • National Science Foundation of China
  • by the National Science Foundation of China

Conference

MM '24
Sponsor:
MM '24: The 32nd ACM International Conference on Multimedia
October 28 - November 1, 2024
Melbourne VIC, Australia

Acceptance Rates

MM '24 Paper Acceptance Rate 1,150 of 4,385 submissions, 26%;
Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 332
    Total Downloads
  • Downloads (Last 12 months)332
  • Downloads (Last 6 weeks)202
Reflects downloads up to 08 Mar 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media