Abstract Neural networks have drawn much attention in modern machine learning community as they have achieved many successful applications, such as image recognition, speech recognition and system identification. According to the principle of parsimony, simpler neural models are preferable to more complex ones if they have similar generalization performance. However, when building a neural networks model, the neuron number is often determined randomly or by trial-and-error. These methods can often lead to the over-complex networks with many redundant neurons and therefore may result in over-fitting problems. In this paper, a new approach is proposed for obtaining a simplified neural networks with fewer neurons but still keeping a good performance comparing to the initial fully networks. More specifically, the initial neural model with a fixed model size is built using Matlab toolbox. Then, the orthogonal matching pursuit method is employed to select important neurons and drop out redundant neurons, leading to a more compact model with reduced size. Two simulation examples are used to demonstrate the effectiveness of the proposed method.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Orthogonal Matching Pursuit for Multilayer Perceptions Neural Networks Model Reduction


    Beteiligte:
    Tang, Xiaoquan (Autor:in) / Wang, Xiaolin (Autor:in) / Zhang, Long (Autor:in)


    Erscheinungsdatum :

    2017-01-01


    Format / Umfang :

    9 pages





    Medientyp :

    Aufsatz/Kapitel (Buch)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch





    Sparse Green’s Functions Estimation Using Orthogonal Matching Pursuit: Application to Aeroacoustic Beamforming

    Bousabaa, Sofiane / Bulté, Jean / Mincu, Daniel-Ciprian et al. | AIAA | 2018


    A List Orthogonal Matching Pursuit Detector for Generalized Space Shift Keying MIMO Systems

    Chen, Kuan-Hua / Chen, Chiao-En / Huang, Yuan-Hao | IEEE | 2016



    An Improved Orthogonal Matching Pursuit Algorithm for Signal Reconstruction in Wireless Body Sensor Network

    Jiang, R. / Ding, Y. / Hao, K. et al. | British Library Conference Proceedings | 2014