Significant progress has been made on methods for generating images from structured semantic descriptions, but the generated images only retain semantic information, and the appearance of objects cannot be constrained and effectively represented. Therefore, we propose a scene graph structure image generation method assisted by object edge information. Our model uses two graph convolution neural networks(GCN) to process scene graphs and obtains object features as well as relation features which aggregate related information. The object bounding boxes are predicted by a method a decoupling the size and position. Where auxiliary models are added to coordinate with segmentation mask network training. Our experiments show that the introduction of object edges provides clearer object appearance information for image generation, which can constrain object shapes and improve image quality greatly. Finally, the cascaded refinement network is used to generate images. Additionally, compared with other appearance features, such as object slices, edge information occupies a smaller quantity of data, which greatly improves the image quality with less increase in the input information. This feature also benefits semantic communication systems. A large number of experiments show that our method is significantly superior to the latest Sg2im method when evaluated on Visual Genome datasets.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Image Generation from Scene Graph with Object Edges


    Contributors:
    Li, Chenxing (author) / Duan, Yiping (author) / Du, Qiyuan (author) / Pan, Chengkang (author) / Liu, Guangyi (author) / Tao, Xiaoming (author)


    Publication date :

    2022-09-01


    Size :

    987070 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Location of focus of expansion from edges in an epipolar image of a scene

    Bataille, Claude / Berviller, Yves / Tisserand, Etienne et al. | SPIE | 1996


    Location of focus of expansion from edges in an epipolar image of a scene [2786-15]

    Bataille, C. / Berviller, Y. / Tisserand, E. et al. | British Library Conference Proceedings | 1996


    Towards Traffic Scene Description: The Semantic Scene Graph

    Zipfl, Maximilian / Zollner, J. Marius | IEEE | 2022


    Image Understanding using vision and reasoning through Scene Description Graph

    Aditya, Somak / Yang, Yezhou / Baral, Chitta et al. | British Library Online Contents | 2018


    Image Generation Techniques for Outdoor Scene Simulation

    Ding, M. / Sang, Z. / Zhang, T. et al. | British Library Conference Proceedings | 1999