Breaking boundaries: Low-precision conditional mutual information for efficient feature selection

Abstract

[Abstract]: As internet-of-things (IoT) devices proliferate, the need for efficient data processing at the network edge becomes increasingly critical due to the vast amounts of data generated. This paper presents a groundbreaking approach that leverages edge computing to address these challenges, using low-precision conditional mutual information (CMI) for feature selection. Our novel methodology improves the efficiency of edge computing systems by significantly reducing memory and energy consumption while maintaining high accuracy. We adapt this approach to feature selection algorithms, specifically, conditional mutual information maximization (CMIM) and incremental association Markov blanket (IAMB), and demonstrate its effectiveness for diverse datasets, including complex DNA microarrays. Our results show that low-precision methods not only compare competitively with traditional 64-bit implementations, but also yield significant performance and resource savings. For IoT and other machine learning applications, this work represents a significant advance in the development of more sustainable and efficient algorithms that can optimize computational resources and reduce their environmental impact.