The examination of Data compression as a solution for data storage and capacity optimization

Amine Lasfar (University of Göttingen, Germany)

Among the objectives of The Central Data Management Project of the Biodiversity Exploratories Priority Program is the examination of multiple means for efficient storage of the data. Many practices and techniques are used to achieve storage and capacity optimization, among the used technologies includes lossless compression. Such solution can be carried out through software solutions and especially through integrated storage systems and database management systems DB2, Postgres… We will be examining the best practices for using different types of lossless data compression on different parts of the DBMS by applying it to primary user data, temporary tables, and back-up images and archived logs which results in fewer retrieval or storing I/O operations. Hence, for disk I/O-bound workloads, the query processing time can be noticeably improved and it can solve, or at least significantly reduce, I/O problems and bottlenecks. Also, as an example, we will illustrate how efficient and effective the server data deduplication feature can be done with DB2. By using these methods, many benefits can be realized such as less consumption of storage space at a slower rate, improving the database and backup performance, and reducing network traffic.

Presentation (PDF)