Skip to main navigation Skip to search Skip to main content

Spatio-Temporal Hybrid Attentive Graph Network for Diagnosis of Mental Disorders on fMRI Time-Series Data

  • Rui Liu
  • , Zhi An Huang*
  • , Yao Hu
  • , Lei Huang
  • , Ka Chun Wong
  • , Kay Chen Tan
  • *Corresponding author for this work
  • Hong Kong Polytechnic University
  • City University of Hong Kong Shenzhen Research Institute
  • City University of Hong Kong

Research output: Contribution to journalArticlepeer-review

Abstract

Facing the prevalence of mental disorders around the world, the burden of healthcare services becomes increasingly imminent. To lessen patients' suffering, the timely diagnosis and therapy of mental disorders are particularly essential. Functional magnetic resonance imaging (fMRI), as the de facto non-invasive neuroimaging technique, can effectively examine the spatial and temporal patterns of brain activity. Recently, computer-aided diagnosis (CAD) approaches have emerged to assist doctors in interpreting fMRI images. However, existing CAD methods cannot fully exploit the spatio-temporal dependence in fMRI signals, possibly leading to inaccurate diagnosis. In this study, we propose a spatio-temporal hybrid attentive graph network (ST-HAG) for diagnosing autism spectrum disorder (ASD) and attention deficit hyperactivity disorder (ADHD) from fMRI data. Specifically, a hybrid graph convolution network is developed to effectively capture complex spatio-temporal dynamics. Meanwhile, a Transformer-based self-attention module helps ST-HAG to extract the full-scale temporal correlation. Finally, we use a gated fusion unit to learn discriminative spatio-temporal graph representations for classification. Cross-validation experiments demonstrate that the proposed ST-HAG achieves state-of-the-art performance with a mean accuracy of 71.9% and 74.8% for ASD and ADHD on ABIDE (1035 subjects) and ADHD-200 (939 subjects) datasets, respectively. Moreover, thanks to the adopted dynamic graph attentive representation, the potent interpretability enables ST-HAG to detect the remarkable temporal association patterns among different brain regions based on dynamic functional connectivity networks.

Original languageEnglish
Pages (from-to)4046-4058
Number of pages13
JournalIEEE Transactions on Emerging Topics in Computational Intelligence
Volume8
Issue number6
DOIs
StatePublished - 2024

Keywords

  • Attention deficit/hyperactivity disorder
  • autism spectrum disorder
  • brain graph construction
  • computer-aided diagnosis
  • functional magnetic resonance imaging
  • graph learning

Fingerprint

Dive into the research topics of 'Spatio-Temporal Hybrid Attentive Graph Network for Diagnosis of Mental Disorders on fMRI Time-Series Data'. Together they form a unique fingerprint.

Cite this