We consider a channel with discrete input ${X}$, a continuous noise that corrupts the input ${X}$ to produce the continuous-valued output ${U}$. A thresholding quantizer is then used to quantize the continuous-valued output ${U}$ to the final discrete output ${V}$. The goal is to jointly design a thresholding quantizer that maximizes the mutual information between input and quantized output ${I}$(${X}$;${V}$) while minimizing a pre-specified function of the quantized output $F(p_{V})$. A general dynamic programming algorithm is proposed having the time complexity $O(KNM^{2})$ where N, M and ${K}$ are the sizes of input ${X}$, output ${U}$ and quantized output ${V}$, respectively. Moreover, we show that if $F(p_{V})=\displaystyle \sum _{i=1}^{K}g_{i}(p_{v_{i}})$ where $g_{i}(.)$ is a convex function, $p_{v_{i}} \in p_{V}=\{p_{v}1,\cdots ~p_{v_{K}}\}$ is the probability mass function of output $v_{i}\in V$ and the channel conditional density $p(u|x)$ satisfies the dominated condition (often true in practice), then the existing SMAWK algorithm can be applied to reduce the time complexity of the dynamic programming algorithm from $O(KNM^{2}$) to ${O}$(KNM). Both theoretical and numerical results are provided to verify our contributions.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Thresholding Quantizer Design for Mutual Information Maximization Under Output Constraint


    Beteiligte:
    Nguyen, Thuan (Autor:in) / Nguyen, Thinh (Autor:in)


    Erscheinungsdatum :

    2020-05-01


    Format / Umfang :

    148867 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch





    Alignment by Maximization of Mutual Information

    Viola, P. / Wells, W. M. | British Library Online Contents | 1997


    Alignment by Maximization of Mutual Information

    Viola, P. / Wells, W. / IEEE Computer Society et al. | British Library Conference Proceedings | 1995


    Constrained Gradient Descent Algorithm for Residual Vector Quantizer Design

    Venkatraman, M. / Nasrabadi, N. M. / IEEE; Signal Processing Society | British Library Conference Proceedings | 1994