Abstract:Large Language Models (LLMs) have demonstrated strong semantic reasoning across multimodal domains. However, their integration with graph-based models of brain connectivity remains limited. In addition, most existing fMRI analysis methods rely on static Functional Connectivity (FC) representations, which obscure transient neural dynamics critical for neurodevelopmental disorders such as autism. Recent state-space approaches, including Mamba, model temporal structure efficiently, but are typically used as standalone feature extractors without explicit high-level reasoning. We propose NeuroMambaLLM, an end-to-end framework that integrates dynamic latent graph learning and selective state-space temporal modelling with LLMs. The proposed method learns the functional connectivity dynamically from raw Blood-Oxygen-Level-Dependent (BOLD) time series, replacing fixed correlation graphs with adaptive latent connectivity while suppressing motion-related artifacts and capturing long-range temporal dependencies. The resulting dynamic brain representations are projected into the embedding space of an LLM model, where the base language model remains frozen and lightweight low-rank adaptation (LoRA) modules are trained for parameter-efficient alignment. This design enables the LLM to perform both diagnostic classification and language-based reasoning, allowing it to analyze dynamic fMRI patterns and generate clinically meaningful textual reports.
| Subjects: | Image and Video Processing (eess.IV); Machine Learning (cs.LG) |
| Cite as: | arXiv:2602.13770 [eess.IV] |
| (or arXiv:2602.13770v2 [eess.IV] for this version) | |
| https://doi.org/10.48550/arXiv.2602.13770 arXiv-issued DOI via DataCite |
Submission history
From: Yasaman Torabi [view email]
[v1]
Sat, 14 Feb 2026 13:32:59 UTC (3,363 KB)
[v2]
Thu, 14 May 2026 08:14:48 UTC (3,529 KB)