Contrast and part-whole relations induced by deep neural networks like Convolutional Neural Networks (CNNs) and Capsule Networks (CapsNets) have been known as two types of semantic cues for deep salient object detection. However, few works pay attention to their complementary properties in the context of saliency prediction. In this paper, we probe into this issue and propose a Type-Correlation Guidance Network (TCGNet) for salient object detection. Specifically, a Multi-Type Cue Correlation (MTCC) covering CNNs and CapsNets is designed to extract the contrast and part-whole relational semantics, respectively. Using MTCC, two correlation matrices containing complementary information are computed with these two types of semantics. In return, these correlation matrices are used to guide the learning of the above semantics to generate better saliency cues. Besides, a Type Interaction Attention (TIA) is developed to interact semantics from CNNs and CapsNets for the aim of saliency prediction. Experiments and analysis on five benchmarks show the superiority of the proposed approach. Codes has been released on https://github.com/liuyi1989/TCGNet.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    TCGNet: Type-Correlation Guidance for Salient Object Detection


    Contributors:
    Liu, Yi (author) / Zhou, Ling (author) / Wu, Gengshen (author) / Xu, Shoukun (author) / Han, Jungong (author)


    Publication date :

    2024-07-01


    Size :

    3684746 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Salient Object Subitizing

    Zhang, J. / Ma, S. / Sameki, M. et al. | British Library Online Contents | 2017


    Salient object detection: From pixels to segments

    Yanulevskaya, V. / Uijlings, J. / Geusebroek, J. M. | British Library Online Contents | 2013


    Salient object detection: manifold-based similarity adaptation approach

    Zhou, J. / Ren, Y. / Yan, Y. et al. | British Library Online Contents | 2014


    A General Divergence Modeling Strategy for Salient Object Detection

    Tian, Xinyu / Zhang, Jing / Dai, Yuchao | British Library Conference Proceedings | 2023