Improved method of rounding off (truncation of least-significant bits) in integer processing of data devised. Provides for reduction, to extremely low value, of numerical bias otherwise generated by accumulation of truncation errors from many arithmetic operations. Devised for use in integer signal processing, in which rescaling and truncation usually performed to reduce number of bits, which typically builds up in sequence of operations. Essence of method to alternate direction of roundoff (plus, then minus) on alternate occurrences of truncated values contributing to bias.


    Access

    Access via TIB

    Check availability in my library


    Export, share and cite



    Title :

    Reducing Truncation Error In Integer Processing


    Contributors:

    Published in:

    Publication date :

    1995-02-01



    Type of media :

    Miscellaneous


    Type of material :

    No indication


    Language :

    English





    REDUCING TRUNCATION ERROR ON UNSTRUCTURED MESHES BY VERTEX MOVEMENT

    Roy, C. / American Institute of Aeronautics and Astronautics | British Library Conference Proceedings | 2012


    Reducing Truncation Error on Unstructured Meshes by Vertex Movement

    Ollivier Gooch, Carl / Roy, Christopher | AIAA | 2012


    On Residual Estimate of Local Truncation Error

    Paudel, Abhiyan / Narayanarao, Balakrishnan | AIAA | 2023


    On Residual Estimate of Local Truncation Error

    Paudel, Abhiyan / Narayanarao, Balakrishnan | TIBKAT | 2023