Nowadays, rapid evolution of computers and mobile devices has caused the explosive increase in network traffic. So it becomes more and more necessary to archive network traffic for analyzing network events and a lot of emerging applications. Compression is fundamental for traffic archival solution to save the storage space, and indexing is effective to accelerate search queries for archive of traffic data. In this paper, we propose BreadZip (blocks row-reordering and adaptive index zip), a combination of initial traffic data and index compression. BreadZip has three main advantages. 1) to improve compressing efficiency and reduce memory footprint, traffic data is reordered in sequence and divided into fixed-size blocks; 2) to accelerate queries, an improved bitmap indexes with smaller volume than traditional will be introduced; 3) to save space, both traffic blocks and bitmap indexes are compressed in different simple run-length encoding methods respectively. Finally, our empirical results on network traffic from CAIDA (Cooperative Association for Internet Data Analysis) show that our solution can significantly reduce the volume of traffic data, while simultaneously preserving the ability to perform selectively queries with response times in seconds.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    BreadZip: a combination of network traffic data and bitmap index encoding algorithm


    Contributors:
    Ma, Ge (author) / Guo, Zhenhua (author) / Li, Xiu (author) / Chen, Zhen (author) / Cao, Junwei (author) / Jiang, Yixin (author) / Guo, Xiaobin (author)


    Publication date :

    2014-10-01


    Size :

    189438 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Bitmap Index-Based Decision Trees

    Favre, C. / Bentayeb, F. | British Library Conference Proceedings | 2005


    Optimizing Adaptive Clustered Bitmap Index Based on Medical Data Warehouse

    Liu, Yanfei | British Library Conference Proceedings | 2016


    Bitmap-Oriented Approach to Character Recognition

    Voracek, J. / Pavelek, J. | British Library Online Contents | 2003


    Bitmap-Oriented Approach to Character Recognition

    Voracek, J. / Pavelek, J. | British Library Online Contents | 2003


    Finite State DCT with Global Bitmap Image Coding

    Wu, Y. G. / Tai, S. C. / IEEE; Hong Kong Chapter of Signal Processing | British Library Conference Proceedings | 1994