This paper presents a semantic scene modeling technique for constructing a cloud-based aquaculture surveillance system using an autonomous drone. The emergence of low-cost drones has created opportunities to find new solutions for a number of problems of computer vision and artificial intelligence based internet-of-things (AIoT). However, vision based activity detection using a mobile RGB camera still remains as a challenging task since the activities in different regions of the scene to be monitored are quite different. Moreover, the sizes of detected objects using a drone are often very small. In this work, the 3D model of an aquaculture environment is first constructed using the calibrated intrinsic camera parameters, the depth maps and the pose parameters of frames in the captured video using a drone. Next, our semantic scene modeling algorithm represents the visual and geometrical information of the semantic objects which defines the checkpoints for routine data gathering and environmental inspection. To associate each checkpoint with the GPS signal and the altitude value of the drone, our approach combines the automatic drone navigation, computer vision and machine learning algorithms to detect the checkpoint specific activities. The scene modeling algorithm transfers the essential knowledge to the mobile drone through the aquaculture cloud for monitoring the fish, persons, nets and feeding systems in an aquaculture site on a daily basis. Thus, the drone becomes a flyable intelligent robot that helps the manager of an aquaculture site to automatically collect valuable data that are important in optimization fish production using further decision making algorithms. Experiments show that our approach attains very high performance yielding significant semantics-based activity recognition accuracy without sacrificing the operation speed.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Semantic scene modeling for aquaculture management using an autonomous drone


    Contributors:

    Conference:

    International Workshop on Advanced Imaging Technology (IWAIT) 2020 ; 2020 ; Yogyakarta,Indonesia


    Published in:

    Proc. SPIE ; 11515


    Publication date :

    2020-06-01





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Semantic scene modeling for aquaculture management using an autonomous drone

    Chen, Hung-Yuan / Cheng, Shyi-Chyi / Chang, Chin-Chun | British Library Conference Proceedings | 2020


    AUTONOMOUS DRONE BATTERY MANAGEMENT

    KIM YOUNG JOON / LEE WONJAE / SIM KYUHWAN | European Patent Office | 2025

    Free access

    AUTONOMOUS DRONE BATTERY MANAGEMENT

    KIM YOUNG / LEE WONJAE / SIM KYUHWAN | European Patent Office | 2025

    Free access

    Factory type aquaculture management system using drone and method thereof

    JUNG JAE JIN / KIM SUNG HUN | European Patent Office | 2021

    Free access

    AUTONOMOUS DRONE

    WU RUEY-BEEI / CHEN YU-ER | European Patent Office | 2023

    Free access