TY - JOUR
T1 - Spatio-Temporal Hybrid Attentive Graph Network for Diagnosis of Mental Disorders on fMRI Time-Series Data
AU - Liu, Rui
AU - Huang, Zhi An
AU - Hu, Yao
AU - Huang, Lei
AU - Wong, Ka Chun
AU - Tan, Kay Chen
N1 - Publisher Copyright:
© 2017 IEEE.
PY - 2024
Y1 - 2024
N2 - Facing the prevalence of mental disorders around the world, the burden of healthcare services becomes increasingly imminent. To lessen patients' suffering, the timely diagnosis and therapy of mental disorders are particularly essential. Functional magnetic resonance imaging (fMRI), as the de facto non-invasive neuroimaging technique, can effectively examine the spatial and temporal patterns of brain activity. Recently, computer-aided diagnosis (CAD) approaches have emerged to assist doctors in interpreting fMRI images. However, existing CAD methods cannot fully exploit the spatio-temporal dependence in fMRI signals, possibly leading to inaccurate diagnosis. In this study, we propose a spatio-temporal hybrid attentive graph network (ST-HAG) for diagnosing autism spectrum disorder (ASD) and attention deficit hyperactivity disorder (ADHD) from fMRI data. Specifically, a hybrid graph convolution network is developed to effectively capture complex spatio-temporal dynamics. Meanwhile, a Transformer-based self-attention module helps ST-HAG to extract the full-scale temporal correlation. Finally, we use a gated fusion unit to learn discriminative spatio-temporal graph representations for classification. Cross-validation experiments demonstrate that the proposed ST-HAG achieves state-of-the-art performance with a mean accuracy of 71.9% and 74.8% for ASD and ADHD on ABIDE (1035 subjects) and ADHD-200 (939 subjects) datasets, respectively. Moreover, thanks to the adopted dynamic graph attentive representation, the potent interpretability enables ST-HAG to detect the remarkable temporal association patterns among different brain regions based on dynamic functional connectivity networks.
AB - Facing the prevalence of mental disorders around the world, the burden of healthcare services becomes increasingly imminent. To lessen patients' suffering, the timely diagnosis and therapy of mental disorders are particularly essential. Functional magnetic resonance imaging (fMRI), as the de facto non-invasive neuroimaging technique, can effectively examine the spatial and temporal patterns of brain activity. Recently, computer-aided diagnosis (CAD) approaches have emerged to assist doctors in interpreting fMRI images. However, existing CAD methods cannot fully exploit the spatio-temporal dependence in fMRI signals, possibly leading to inaccurate diagnosis. In this study, we propose a spatio-temporal hybrid attentive graph network (ST-HAG) for diagnosing autism spectrum disorder (ASD) and attention deficit hyperactivity disorder (ADHD) from fMRI data. Specifically, a hybrid graph convolution network is developed to effectively capture complex spatio-temporal dynamics. Meanwhile, a Transformer-based self-attention module helps ST-HAG to extract the full-scale temporal correlation. Finally, we use a gated fusion unit to learn discriminative spatio-temporal graph representations for classification. Cross-validation experiments demonstrate that the proposed ST-HAG achieves state-of-the-art performance with a mean accuracy of 71.9% and 74.8% for ASD and ADHD on ABIDE (1035 subjects) and ADHD-200 (939 subjects) datasets, respectively. Moreover, thanks to the adopted dynamic graph attentive representation, the potent interpretability enables ST-HAG to detect the remarkable temporal association patterns among different brain regions based on dynamic functional connectivity networks.
KW - Attention deficit/hyperactivity disorder
KW - autism spectrum disorder
KW - brain graph construction
KW - computer-aided diagnosis
KW - functional magnetic resonance imaging
KW - graph learning
UR - https://www.scopus.com/pages/publications/85190746303
U2 - 10.1109/TETCI.2024.3386612
DO - 10.1109/TETCI.2024.3386612
M3 - 文章
AN - SCOPUS:85190746303
SN - 2471-285X
VL - 8
SP - 4046
EP - 4058
JO - IEEE Transactions on Emerging Topics in Computational Intelligence
JF - IEEE Transactions on Emerging Topics in Computational Intelligence
IS - 6
ER -