Current Trends in Information Technology
A Short Survey of Data Compression Techniques for Column Oriented Databases
Abstract
AbstractColumn oriented data-stores has all values of a single column stored as a row followed by all values of the next column. Such way of storing records helps in data compression since values of the same column are of the similar type and may repeat. This paper surveys the various data compression techniques in column oriented databases. Data compression is efficiently used to save storage space and network bandwidth. It improves the performance of query execution. Specialized algorithms based on the type of the data stored in column results in immense improvements in compression ratios. Higher-up ratios result in more efficient bandwidth usage.Keywords: Compression, column oriented databases, decompression, NoSQL, HBaseReferences (22)
- Lars George, HBase: The Definitive Guide, 2nd Ed. O'Reilly Media, Inc., 2011.
- D. J. Abadi, S. R. Madden, M. Ferreira. Integrating Compression and Execution in Column-Oriented Database Systems . In SIGMOD, 2006; 671–682p.
- G.Graefe, L. Shapiro. Data Compression and Database Performance. In ACM/IEEE-CS Symp . on Applied computing, Kansas City, 1991; 22–27p.
- B. R. Iyer, D. Wilhite. Data Compression Support in Databases. In VLDB , 1994; 695–704p.
- J. Goldstein, R. Ramakrish nan, U. Shaft. Compressing Relations and Indexes. In ICDE 1998; 370–379p.
- G. Ray, J. R. Haritsa, S. Seshadri. Database Compression: A Performance Enhancement Tool. In COMAD, 1995.
- C. A. Lynch. E. B. Brownrigg. Application of Data Compression to a Large Bib liographic Database. In VLDB, Cannes, France, 1981; 435–447p.
- P. O’Neil, D. Quass. Improved Query Performance with Variant Indexes. In SIGMOD, 1997; 38–49p.
- P. Boncz, S. Manegold, M. Kersten. Database Architecture Optimized for the New Bottleneck: Memory A ccess. In VLDB, 1999; 54–65p.
- A. Moffat, J. Zobel. Compression and Fast Indexing for Multi -Gigabyte Text Databases. Australian Computer Journal , 1994; 26(1): 1–9p.
- K. Wu, E. Otoo, A. Shoshani. Compressed Bitmap Indices for Efficient Query Processing. Techn ical Report LBNL - 47807, 2001.
- K. Wu, E. Otoo, A. Shoshani, H. Nordberg. Notes on Design and Implementation of Compressed Bit Vectors. Technical Report LBNL/PUB - 3161, 2001. Data Compression for Column Oriented Databases Raichand and Aggarwal __________________________________________________________________________________________ CTIT (2013) 1-6 © STM Journals 2013. All Rights Reserved Page 6
- A. Zandi, B. R. Iyer, G. G. Langdon Jr. Sort Order Preserving Data Compression for E xtended Alphabets. In Data Compression Conference, 1993; 330–339p.
- R. MacNicol, B. French. Sybase IQ Multiplex - Designed for Analytics. In VLDB, 2004; 1227–1230p.
- M. Stonebraker, D. J. Abadi, A. Batkin et al. C-Store: A Column -Oriented DBMS. In VLDB, 2005; 553–564p.
- D. J. Abadi. Query Execution in Column - Oriented Database Systems. MIT PhD Dissertation, PhD Thesis Massachusetts Institute of Technology. Dept. of Electrical Engineering and Computer Science, 2008.
- M. Zukowski, S. Heman, N. Nes, P. Boncz. Super -Scalar Ram -Cpu Cache Compression. In ICDE, Data Engineering, 2006; ICDE '06. Proceedings of the 22nd International Conference, 59p.
- M. Zukowski, P. A. Boncz, N. Nes, S. Heman. MonetDB/X100 - A DBMS in the CPU Cache. IEEE Data Engineering Bulletin, 2005; 28(2):17–22p.
- J. Ziv, A. Lempel. A Universal Algorithm for Sequential Data Compression. IEEE Transactions on Information Theory, 1977; 23(3): 337–343p.
- J. Ziv, A. Lempel. Compression of Individual Sequences via Variable -Rate Coding. IEEE Transactions on Information Theory , 1978; 24(5):530 – 536p.
- Oracle 11g Data Compression Tips for the Database Administrator Oracle 11g Tips by Burleson Consulting.
- Chongxin Li. Transforming Rela tional Database into HBase - A Case Study. Software Engineering and Service Sciences (ICSESS), IEEE International Conference 2010; 683–687p.