Black-box Explanation of Object Detectors via Saliency Maps



  • Vitali Petsiuk
  • Rajiv Jain
  • Varun Manjunatha
  • Vlad I. Morariu
  • Ashutosh Mehra
  • Vicente Ordonez
  • Kate Saenko

Published on


We propose D-RISE, a method for generating visual explanations for the predictions of object detectors. D-RISE can be considered “black-box” in the software testing sense, it only needs access to the inputs and outputs of an object detector. Compared to gradient-based methods, D-RISE is more general and agnostic to the particular type of object detector being tested as it does not need to know about the inner workings of the model. We show that D-RISE can be easily applied to different object detectors including one-stage detectors such as YOLOv3 and two-stage detectors such as Faster-RCNN. We present a detailed analysis of the generated visual explanations to highlight the utilization of context and the possible biases learned by object detectors.

This paper has been published at CVPR 2021

Please cite our work using the BibTeX below.

    author    = {Petsiuk, Vitali and Jain, Rajiv and Manjunatha, Varun and Morariu, Vlad I. and Mehra, Ashutosh and Ordonez, Vicente and Saenko, Kate},
    title     = {Black-Box Explanation of Object Detectors via Saliency Maps},
    booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
    month     = {June},
    year      = {2021},
    pages     = {11443-11452}
Close Modal