Retinal Microaneurysms Detection Using Adversarial Pre-training With Unlabeled Multimodal Images
Use este enlace para citar
http://hdl.handle.net/2183/29766
A non ser que se indique outra cousa, a licenza do ítem descríbese como Atribución-NoComercial-SinDerivadas 4.0 Internacional
Coleccións
- GI-VARPA - Artigos [76]
Metadatos
Mostrar o rexistro completo do ítemTítulo
Retinal Microaneurysms Detection Using Adversarial Pre-training With Unlabeled Multimodal ImagesData
2022Cita bibliográfica
HERVELLA, Álvaro S., et al. Retinal microaneurysms detection using adversarial pre-training with unlabeled multimodal images. Information Fusion, 2022, vol. 79, p. 146-161. https://doi.org/10.1016/j.inffus.2021.10.003
Resumo
[Abstract] The detection of retinal microaneurysms is crucial for the early detection of important diseases such as diabetic retinopathy. However, the detection of these lesions in retinography, the most widely available retinal imaging modality, remains a very challenging task. This is mainly due to the tiny size and low contrast of the microaneurysms in the images. Consequently, the automated detection of microaneurysms usually relies on extensive ad-hoc processing. In this regard, although microaneurysms can be more easily detected using fluorescein angiography, this alternative imaging modality is invasive and not adequate for regular preventive screening.
In this work, we propose a novel deep learning methodology that takes advantage of unlabeled multimodal image pairs for improving the detection of microaneurysms in retinography. In particular, we propose a novel adversarial multimodal pre-training consisting in the prediction of fluorescein angiography from retinography using generative adversarial networks. This pre-training allows learning about the retina and the microaneurysms without any manually annotated data. Additionally, we also propose to approach the microaneurysms detection as a heatmap regression, which allows an efficient detection and precise localization of multiple microaneurysms. To validate and analyze the proposed methodology, we perform an exhaustive experimentation on different public datasets. Additionally, we provide relevant comparisons against different state-of-the-art approaches. The results show a satisfactory performance of the proposal, achieving an Average Precision of 64.90%, 31.36%, and 33.55% in the E-Ophtha, ROC, and DDR public datasets. Overall, the proposed approach outperforms existing deep learning alternatives while providing a more straightforward detection method that can be effectively applied to raw unprocessed retinal images.
Palabras chave
Deep learning
Medical imaging
Multimodal imaging
Eye fundus
Generative adversarial networks
Microaneurysms
Medical imaging
Multimodal imaging
Eye fundus
Generative adversarial networks
Microaneurysms
Descrición
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG
Versión do editor
Dereitos
Atribución-NoComercial-SinDerivadas 4.0 Internacional