Mostrar o rexistro simple do ítem
Explained anomaly detection in text reviews: Can subjective scenarios be correctly evaluated?
dc.contributor.author | Novoa-Paradela, David | |
dc.contributor.author | Fontenla-Romero, Óscar | |
dc.contributor.author | Guijarro-Berdiñas, Bertha | |
dc.date.accessioned | 2024-04-19T10:17:30Z | |
dc.date.available | 2024-04-19T10:17:30Z | |
dc.date.issued | 2024-07 | |
dc.identifier.citation | D. Novoa-Paradela, O. Fontenla-Romero, y B. Guijarro-Berdiñas, «Explained anomaly detection in text reviews: Can subjective scenarios be correctly evaluated?», Engineering Applications of Artificial Intelligence, vol. 133, p. 108065, jul. 2024, doi: 10.1016/j.engappai.2024.108065. | es_ES |
dc.identifier.issn | 1873-6769 | |
dc.identifier.issn | 0952-1976 | |
dc.identifier.uri | http://hdl.handle.net/2183/36258 | |
dc.description | Funding for open access charge: Universidade da Coruña/CISUG | es_ES |
dc.description.abstract | In the current landscape, user opinions exert an unprecedented influence on the trajectory of companies. In the field of online review platforms, these opinions, transmitted through text reviews and numerical ratings, significantly shape the credibility of products and services. For this reason, detecting inappropriate reviews becomes crucial.↳ This paper addresses the problem of automatic anomalous review detection using a novel approach based on Anomaly Detection in the field of Natural Language Processing (NLP). Unlike other NLP tasks, anomaly detection in texts is a relatively emerging area. In this paper, we present a pipeline for opinion filtering that poses the problem of discerning between normal opinions containing relevant information about an item and anomalous opinions with unrelated content. Its key functionalities include: Classifying the reviews, assigning normality scores, and generating explanations for each classification, indispensable for the human who normally moderates these platforms. To evaluate the model, several Amazon datasets were used to demonstrate that the performance obtained is robust, obtaining an average F1 score of 91.4 detecting anomalies in the most complex scenario. In addition, a comparative study of three explainability techniques was conducted with 241 participants to measure the impact on understanding the classifications of the model and to rank their perceived usefulness of explanations. As a result, we obtained a system with great potential to automate tasks related to online review platforms, offering insights into anomaly detection applications in textual data and showing the difficulties that arise when the task to be explained presents a subjectivity component. | es_ES |
dc.description.sponsorship | This work was supported in part by grant Machine Learning on the Edge - Ayudas Fundación BBVA a Equipos de Investigación Científica 2019; the Spanish National Plan for Scientific and Technical Research and Innovation (PID2019-109238GB-C22 and TED2021-130599A-I00); the Xunta de Galicia (ED431C 2022/44) and ERDF funds. CITIC, as a Research Center of the University System of Galicia, is funded by Consellería de Educación, Universidade e Formación Profesional of the Xunta de Galicia, Spain through the European Regional Development Fund (ERDF) and the Secretaría Xeral de Universidades (Ref. ED431C 2022/44). Funding for open access charge: Universidade da Coruña/CISUG. | es_ES |
dc.description.sponsorship | Xunta de Galicia; ED431C 2022/44 | es_ES |
dc.description.sponsorship | Xunta de Galicia; ED431C 2022/44 | es_ES |
dc.language.iso | eng | es_ES |
dc.relation | info:eu-repo/grantAgreement/AEI/Plan Estatal de Investigación Científica y Técnica y de Innovación 2017-2020/PID2019-109238GB-C22/ES/APRENDIZAJE AUTOMATICO ESCALABLE Y EXPLICABLE | es_ES |
dc.relation | info:eu-repo/grantAgreement/AEI/Plan Estatal de Investigación Científica y Técnica y de Innovación 2021-2023/ TED2021-130599A-I00/ES/ALGORITMOS DE SELECCIÓN DE CARACTERÍSTICAS VERDES Y RÁPIDOS | es_ES |
dc.relation.uri | https://doi.org/10.1016/j.engappai.2024.108065 | es_ES |
dc.rights | Atribución 3.0 España | es_ES |
dc.rights.uri | http://creativecommons.org/licenses/by/3.0/es/ | * |
dc.subject | Anomaly detection | es_ES |
dc.subject | Text reviews | es_ES |
dc.subject | Transformers | es_ES |
dc.subject | Explainability | es_ES |
dc.title | Explained anomaly detection in text reviews: Can subjective scenarios be correctly evaluated? | es_ES |
dc.type | info:eu-repo/semantics/article | es_ES |
dc.rights.access | info:eu-repo/semantics/openAccess | es_ES |
UDC.journalTitle | Engineering Applications of Artificial Intelligence | es_ES |
UDC.volume | 133 | es_ES |
UDC.startPage | 108065 | es_ES |
Ficheiros no ítem
Este ítem aparece na(s) seguinte(s) colección(s)
-
GI-LIDIA - Artigos [59]