Álvarez-Rodríguez, LorenaGarcía Prego, IvánMoura, Joaquim dePueyo-Bestué, AnaViladés, ElisaGarcía-Martín, ElenaSánchez, Clara I.Novo Buján, JorgeOrtega Hortas, Marcos2024-12-022024-12-022024L. Álvarez-Rodríguez, I. García Prego, J. de Moura, A. Pueyo, E. Vilades, E. Garcia-Martin, C. I. Sánchez, J. Novo, and M. Ortega, "3D Point Cloud Analysis via Transformer-Based Graph Learning for Multiple Sclerosis Screening in OCT Images", 28th International Conference on Knowledge-Based and Intelligent Information & Engineering Systems (KES 2024), Procedia Computer Science, Vol. 246, 2024, pp. 1080-1089, https://doi.org/10.1016/j.procs.2024.09.527http://hdl.handle.net/2183/40448Presented at: 28th International Conference on Knowledge-Based and Intelligent Information & Engineering Systems (KES 2024)[Abstract]: Multiple Sclerosis (MS), the leading cause of non-traumatic neurological impairment in young adults, manifests morphological changes in the retina observable in Optical Coherence Tomography (OCT) images. These changes in the Retinal Nerve Fibre Layer (RNFL) and the Ganglion Cell Layer - Bruch’s Membrane (GCL-BM) serve as potential computational biomarkers for MS. In this work, we propose a transformer-based graph learning approach for analyzing 3D point clouds generated from RNFL and GCL-BM contours, marking a first in the application of geometric deep learning (GDL) to MS diagnosis via OCT scans. Our proposal, tailored for efficiency, synergizes the global contextual strengths of transformers with the detailed, structure-aware capabilities of graph neural networks. Such integration allows for the nuanced analysis of complex retinal structures, significantly boosting the precision of MS detection by uncovering patterns not discernible to the human eye. Additionally, we conducted a comprehensive study on the optimal downsampling size of input 3D point clouds, ensuring efficient data processing without compromising diagnostic accuracy. Our optimal configuration achieved a test F1-Score of 0.88, using only 4.0% of total 3D points, showcasing the effectiveness of our method despite the higher computational demands compared to less complex, albeit less precise, configurations. These promising results are the first in the study of 3D analysis and transformer-based geometric deep learning for MS screening based on OCT images, which are revolutionizing neurophtalmological research.engAttribution-NonCommercial-NoDerivatives 4.0 (International) (CC BY-NC-ND )http://creativecommons.org/licenses/by-nc-nd/3.0/es/Geometric deep learningVisual transformersMedical imagingOCTMultiple sclerosisScreeningconference outputopen access10.1016/j.procs.2024.09.527