A Configurable Statistical Lossless Compression Core Based on Variable Order Markov Modeling and Arithmetic Coding

Jose L Nunez-Yanez, Vassilios A. Chouliaras

Research output: Contribution to journalArticle (Academic Journal)peer-review

11 Citations (Scopus)
336 Downloads (Pure)

Abstract

This paper presents a practical realization in hardware of the concepts of variable order Markov modeling using multisymbol alphabets and arithmetic coding for lossless compression of universal data. This type of statistical coding algorithm has long been regarded as being able to deliver very high compression ratios close to the information content of the source data. However, their high computational complexity has limited their practical application in embedded environments such as in mobile computing and wireless communications. In this paper, a hardware amenable algorithm named PPMH and based on these principles has been developed and its architecture and implementation detailed. This novel lossless compression core offers innovative solutions to the computational issues in both stages of modeling and coding and delivers high compression efficiency and throughput. The configurability features of the core allow efficient use of the embedded SRAM present in modern FPGA technologies where memory resources range from a few kilobits to several megabits per device family. The core has been targeted to the Altera Stratix FPGA family and performance, coding efficiency, and complexity measured for different memory configurations.
Translated title of the contributionA configurable statistical lossless compression core based on variable order modelling and arithmetic coding
Original languageEnglish
Pages (from-to)1345 - 1359
Number of pages15
JournalIEEE Transactions on Computers
Volume54
Issue number11
DOIs
Publication statusPublished - Nov 2005

Bibliographical note

Publisher: Institute of Electrical and Electronics Engineers (IEEE)

Keywords

  • Markov modeling
  • statistical compression
  • lossless compression
  • arithmetic coding

Fingerprint

Dive into the research topics of 'A Configurable Statistical Lossless Compression Core Based on Variable Order Markov Modeling and Arithmetic Coding'. Together they form a unique fingerprint.

Cite this