Improving handgun detectors with human pose classification

Abstract

[Abstract] Unfortunately, attacks with firearms such as handguns have become too common. CCTV surveillance systems can potentially help to prevent this kind of incidents, but require continuous human supervision, which is not feasible in practice. Image-based handgun detectors allow the automatic location of these weapons to send alerts to the security staff. Deep learning has been recently used for this purpose. However, the precision and sensitivity of these systems are not generally satisfactory, causing in most cases both false alarms and undetected handguns, particularly when the firearm is far from the camera. This paper proposes the use of information related to the pose of the subject to improve the performance of current handgun detectors. More concretely, a human full-body pose classifier has been developed which is capable of separating between shooting poses and other non-dangerous poses. The classified pose is then used to reduce both the number of false positives (FP) and false negatives (FN). The proposed method has been tested with several datasets and handgun detectors, showing an improvement under various metrics.