Current Trends in Information Technology

A Short Survey of Data Compression Techniques for Column Oriented Databases

  1. Priyanka Raichand ✉
  2. Rinkle Rani Aggarwal

Abstract

AbstractColumn oriented data-stores has all values of a single column stored as a row followed by all values of the next column. Such way of storing records helps in data compression since values of the same column are of the similar type and may repeat. This paper surveys the various data compression techniques in column oriented databases. Data compression is efficiently used to save storage space and network bandwidth. It improves the performance of query execution. Specialized algorithms based on the type of the data stored in column results in immense improvements in compression ratios. Higher-up ratios result in more efficient bandwidth usage.Keywords: Compression, column oriented databases, decompression, NoSQL, HBase

References (22)

  1. Lars George, HBase: The Definitive Guide, 2nd Ed. O'Reilly Media, Inc., 2011.
  2. D. J. Abadi, S. R. Madden, M. Ferreira. Integrating Compression and Execution in Column-Oriented Database Systems . In SIGMOD, 2006; 671–682p.
  3. G.Graefe, L. Shapiro. Data Compression and Database Performance. In ACM/IEEE-CS Symp . on Applied computing, Kansas City, 1991; 22–27p.
  4. B. R. Iyer, D. Wilhite. Data Compression Support in Databases. In VLDB , 1994; 695–704p.
  5. J. Goldstein, R. Ramakrish nan, U. Shaft. Compressing Relations and Indexes. In ICDE 1998; 370–379p.
  6. G. Ray, J. R. Haritsa, S. Seshadri. Database Compression: A Performance Enhancement Tool. In COMAD, 1995.
  7. C. A. Lynch. E. B. Brownrigg. Application of Data Compression to a Large Bib liographic Database. In VLDB, Cannes, France, 1981; 435–447p.
  8. P. O’Neil, D. Quass. Improved Query Performance with Variant Indexes. In SIGMOD, 1997; 38–49p.
  9. P. Boncz, S. Manegold, M. Kersten. Database Architecture Optimized for the New Bottleneck: Memory A ccess. In VLDB, 1999; 54–65p.
  10. A. Moffat, J. Zobel. Compression and Fast Indexing for Multi -Gigabyte Text Databases. Australian Computer Journal , 1994; 26(1): 1–9p.
  11. K. Wu, E. Otoo, A. Shoshani. Compressed Bitmap Indices for Efficient Query Processing. Techn ical Report LBNL - 47807, 2001.
  12. K. Wu, E. Otoo, A. Shoshani, H. Nordberg. Notes on Design and Implementation of Compressed Bit Vectors. Technical Report LBNL/PUB - 3161, 2001. Data Compression for Column Oriented Databases Raichand and Aggarwal __________________________________________________________________________________________ CTIT (2013) 1-6 © STM Journals 2013. All Rights Reserved Page 6
  13. A. Zandi, B. R. Iyer, G. G. Langdon Jr. Sort Order Preserving Data Compression for E xtended Alphabets. In Data Compression Conference, 1993; 330–339p.
  14. R. MacNicol, B. French. Sybase IQ Multiplex - Designed for Analytics. In VLDB, 2004; 1227–1230p.
  15. M. Stonebraker, D. J. Abadi, A. Batkin et al. C-Store: A Column -Oriented DBMS. In VLDB, 2005; 553–564p.
  16. D. J. Abadi. Query Execution in Column - Oriented Database Systems. MIT PhD Dissertation, PhD Thesis Massachusetts Institute of Technology. Dept. of Electrical Engineering and Computer Science, 2008.
  17. M. Zukowski, S. Heman, N. Nes, P. Boncz. Super -Scalar Ram -Cpu Cache Compression. In ICDE, Data Engineering, 2006; ICDE '06. Proceedings of the 22nd International Conference, 59p.
  18. M. Zukowski, P. A. Boncz, N. Nes, S. Heman. MonetDB/X100 - A DBMS in the CPU Cache. IEEE Data Engineering Bulletin, 2005; 28(2):17–22p.
  19. J. Ziv, A. Lempel. A Universal Algorithm for Sequential Data Compression. IEEE Transactions on Information Theory, 1977; 23(3): 337–343p.
  20. J. Ziv, A. Lempel. Compression of Individual Sequences via Variable -Rate Coding. IEEE Transactions on Information Theory , 1978; 24(5):530 – 536p.
  21. Oracle 11g Data Compression Tips for the Database Administrator Oracle 11g Tips by Burleson Consulting.
  22. Chongxin Li. Transforming Rela tional Database into HBase - A Case Study. Software Engineering and Service Sciences (ICSESS), IEEE International Conference 2010; 683–687p.

Read more of it

Subscribe to one journal or build your own list of several. One invoice, one payment, access for a full year.

Subscribe to journals →

Publish your article

Peer-reviewed journals across every subject, with open access options. Send your manuscript to the right editor today.

Publish with us → Calculate your APC
Support