The inhomogeneous Gibbs model (IGM) (Liu et al., 2001) is an effective maximum entropy model in characterizing complex high-dimensional distributions. However, its training process is so slow that the applicability of IGM has been greatly restricted. In this paper, we propose an approach for fast parameter learning of IGM. In IGM learning, features are incrementally constructed to constrain the learnt distribution. When a new feature is added, Markov-chain Monte Carlo (MCMC) sampling is repeated to draw samples for parameter learning. In contrast, our approach constructs a closed-form reference distribution using approximate information gain criteria. Because our reference distribution is very close to the optimal one, importance sampling can be used to accelerate the parameter optimization process. For problems with high-dimensional distributions, our approach typically achieves a speedup of two orders of magnitude compared to the original IGM. We further demonstrate the efficiency of our approach by learning a high-dimensional joint distribution of face images and their corresponding caricatures.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    An efficient approach to learning inhomogeneous Gibbs model


    Contributors:


    Publication date :

    2003-01-01


    Size :

    745042 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    An Efficient Approach to Learning Inhomogeneous Gibbs Model

    Liu, Z. / Chen, H. / Shum, H.-Y. et al. | British Library Conference Proceedings | 2003


    Learning inhomogeneous Gibbs model of faces by minimax entropy

    Ce Liu, / Song Chun Zhu, / Heung-Yeung Shum, | IEEE | 2001


    Learning Inhomogeneous Gibbs Model of Faces by Minimax Entropy

    Liu, C. / Zhu, S. / Shum, H. et al. | British Library Conference Proceedings | 2001


    Image-Modeling Gibbs Priors

    Levitan, E. / Chan, M. / Herman, G. T. | British Library Online Contents | 1995


    Gibbs steel railway car

    Engineering Index Backfile | 1905