The present disclosure provides a UAV video aesthetic quality evaluation method based on multi-modal deep learning, which establishes a UAV video aesthetic evaluation data set, analyzes the UAV video through a multi-modal neural network, extracts high-dimensional features, and concatenates the extracted features, thereby achieving aesthetic quality evaluation of the UAV video. There are four steps, step one to: establish a UAV video aesthetic evaluation data set, which is divided into positive samples and negative samples according to the video shooting quality; step two to: use SLAM technology to restore the UAV's flight trajectory and to reconstruct a sparse 3D structure of the scene; step three to: through a multi-modal neural network, extract features of the input UAV video on the image branch, motion branch, and structure branch respectively; and step four to: concatenate the features on multiple branches to obtain the final video aesthetic label and video scene type.
UAV video aesthetic quality evaluation method based on multi-modal deep learning
2023-01-31
Patent
Electronic Resource
English
IPC: | G06V / B64C AEROPLANES , Flugzeuge / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS |
UAV Video Aesthetic Quality Evaluation Method Based On Multi-Modal Deep Learning
European Patent Office | 2021
|UNIAA: A Unified Multi-modal Image Aesthetic Assessment Baseline and Benchmark
ArXiv | 2024
|Deep reinforcement learning-based ethical-driven multi-modal decision-making method
European Patent Office | 2023
|