Deep learning-based affordance research is motivated by the need to achieve higher degrees of automation and accuracy. On the contrary, the concept of affordance originated to explain the intuitive intelligent responses of humans in their interaction with the environment. With a state-of-the-art supervised deep learning model, achieving high accuracy in an object affordance recognition challenge is excellent and normal nowadays. Does it ensure that this model understands object affordance correctly and explains its decisions to users? Deep learning algorithms and architectures for affordance research must possess an understanding of their own. We present a brief study on the existing literature on explainable affordance research and offer few suggestions to improve the explainability and interpretability of current deep learning methods for affordance detection. Three pretrained vision models are considered for supervised object affordance classification without having affordance heatmaps as teaching signal. The output of these models obtained after the experimentation over modified CAD-120 dataset is fed to smooth grad-cam\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$++$$\end{document} for post hoc explainability analysis. These experiments lead to a proposal of a framework for object affordance classification.
Visual Affordance Recognition: A Study on Explainability and Interpretability for Human Robot Interaction
Discovering the Frontiers of Human-Robot Interaction ; Chapter : 12 ; 287-307
2024-07-24
21 pages
Article/Chapter (Book)
Electronic Resource
English
Affordance-based altruistic robotic architecture for human–robot collaboration
BASE | 2019
|Affordance Based Disambiguation and Validation in Human-Robot Dialogue
Springer Verlag | 2020
|Visual recognition of pointing gestures for human-robot interaction
British Library Online Contents | 2007
|Affordance-based indirect task communication for astronaut-robot cooperation
British Library Online Contents | 2012
|