Architects usually design ideation and conception by hand-sketching. Sketching is a direct expression of the architect’s creativity. But 2D sketches are often vague, intentional and even ambiguous. In the research of sketch-based modeling, it is the most difficult part to make the computer to recognize the sketches. Because of the development of artificial intelligence, especially deep learning technology, Convolutional Neural Networks (CNNs) have shown obvious advantages in the field of extracting features and matching, and Generative Adversarial Neural Networks (GANs) have made great breakthroughs in the field of architectural generation which make the image-to-image translation become more and more popular. As the building images are gradually developed from the original sketches, in this research, we try to develop a system from the sketches to the images of buildings using CycleGAN algorithm. The experiment demonstrates that this method could achieve the mapping process from the sketches to images, and the results show that the sketches’ features could be recognised in the process. By the learning and training process of the sketches’ reconstruction, the features of the images are also mapped to the sketches, which strengthen the architectural relationship in the sketch, so that the original sketch can gradually approach the building images, and then it is possible to achieve the sketch-based modeling technology.


    Access

    Download


    Export, share and cite



    Title :

    Using CycleGAN to Achieve the Sketch Recognition Process of Sketch-Based Modeling


    Contributors:
    Yuan, Philip F. (editor) / Chai, Hua (editor) / Yan, Chao (editor) / Leach, Neil (editor) / Li, Yuqian (author) / Xu, Weiguo (author)

    Conference:

    The International Conference on Computational Design and Robotic Fabrication ; 2021 ; Shanghai, China July 03, 2021 - July 04, 2021


    Published in:

    Publication date :

    2021-09-22


    Size :

    9 pages




    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English





    Face Sketch Synthesis and Recognition

    Tang, X. / Wang, X. / IEEE | British Library Conference Proceedings | 2003


    Sketch Recognition: What Lies Ahead?

    Nagpal, S. / Vatsa, M. / Singh, R. | British Library Online Contents | 2016


    Sketch Recognition: What Lies Ahead?

    Nagpal, Shruti / Vatsa, Mayank / Singh, Richa | British Library Online Contents | 2016


    Sketch face Recognition using Deep Learning

    Rubeena / Kavitha, E. | IEEE | 2021


    Face sketch synthesis and recognition

    Xiaoou Tang, / Xiaogang Wang, | IEEE | 2003