Grad-CAM++: Generalized Gradient-Based Visual Explanations for Deep Convolutional Networks 论文

2018引用 2978
Explainable Artificial Intelligence (XAI)Advanced Neural Network ApplicationsMultimodal Machine Learning Applications

详细信息

发表日期
2018-03-01
发表年份
2018

关键词

Explainable Artificial Intelligence (XAI)Advanced Neural Network ApplicationsMultimodal Machine Learning Applications

摘要

Over the last decade, Convolutional Neural Network (CNN) models have been highly successful in solving complex vision based problems. However, deep models are perceived as "black box" methods considering the lack of understanding of their internal functioning. There has been a significant recent interest to develop explainable deep learning models, and this paper is an effort in this direction. Building on a recently proposed method called Grad-CAM, we propose Grad-CAM++ to provide better visual explanations of CNN model predictions (when compared to Grad-CAM), in terms of better localization of objects as well as explaining occurrences of multiple objects of a class in a single image. We provide a mathematical explanation for the proposed method, Grad-CAM++, which uses a weighted combination of the positive partial derivatives of the last convolutional layer feature maps with respect to a specific class score as weights to generate a visual explanation for the class label under consideration. Our extensive experiments and evaluations, both subjective and objective, on standard datasets showed that Grad-CAM++ indeed provides better visual explanations for a given CNN architecture when compared to Grad-CAM.