Primates demonstrate unparalleled ability at rapidly orienting towards important events in complex dynamic environments. During rapid guidance of attention and gaze towards potential objects of interest or threats, often there is no time for detailed visual analysis. Thus, heuristic computations are necessary to locate the most interesting events in quasi real-time. We present a new theory of sensory surprise, which provides a principled and computable shortcut to important information. We develop a model that computes instantaneous low-level surprise at every location in video streams. The algorithm significantly correlates with eye movements of two humans watching complex video clips, including television programs (17,936 frames, 2,152 saccadic gaze shifts). The system allows more sophisticated and time-consuming image analysis to be efficiently focused onto the most surprising subsets of the incoming data.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A principled approach to detecting surprising events in video


    Contributors:
    Itti, L. (author) / Baldi, P. (author)


    Publication date :

    2005-01-01


    Size :

    784740 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    SYSTEMS AND METHODS FOR DETECTING SURPRISING EVENTS IN VEHICLES

    NIX AXEL | European Patent Office | 2017

    Free access

    Systems and methods for detecting surprising events in vehicles

    NIX AXEL | European Patent Office | 2019

    Free access


    A Principled Approach to the Specification of System Architectures for Space Missions

    Mckelvin, Jr., Mark L. / Castillo, Robert / Bonanne, Kevin et al. | AIAA | 2015


    A Principled Approach to the Specification of System Architectures for Space Missions

    McKelvin, Mark L. Jr. / Castillo, Robert / Bonanne, Kevin et al. | NTRS | 2015