DB2 Data Management: The New Reality of the Digital Age

BY

DB2 Data Management: The New Reality of the Digital AgeDuring a recent proof of concept of our next generation technology utilities, something struck us as very significant: One of the test cases included a billion (with a “B”) row table. Not so long ago, million row tables were the largest we saw in tests. Given that, is it unreasonable to expect trillion row tables by the end of the decade? Continuous advancements in digital business, the Internet of Things, compliance and regulations, etc. are forcing the creation of more data in a few days than has ever been generated in history!

DB2 is prepared for this volume. Think of the new types of table spaces like UTS PBG (partition by growth). A PBG can have up to 4,096 partitions. With a scale like that, 200M rows in a partition is extremely close to the 1T row number. If that sounds ridiculous, we should point out two things: We have customers now with that many rows in a PBG partition; and there is no evidence that these objects will stop growing, especially given the estimated mobile growth over the next five years. The maximum size of a PBG partition is now 256G so in many cases they can handle far more than 200M rows.

Why should you care? You’ve been hearing this for years, right? The problem is that data volumes are increasing faster than traditional methods of data management can accommodate. Sorting a compressed single partition of 256G could require 1T of DASD. Remember that traditional methods require a PBG to be treated as a single dataset, meaning a reorg of a single partition is not extremely useful.

The old methods of reorganization (unload/sort/reload) will become increasingly insufficient. Constant performance improvements offering small percentage gains will wither under the onslaught of massive increases in numbers and sizes of DB2 objects. Over the next 5-10 years, there will be an increasing number of DBAs who have objects they will not be able to process. They will be faced with the dilemma of either radically changing the way they store the data or sacrificing application performance and customer response times. Modern complex DB2 databases require a new data management technology.

21st Century DB2 data management does exist and those who are embracing new methods of data management are also reaping the benefits of reduced costs, improved app delivery times, and increased availability. Most importantly, these forward-thinkers are prepared for the reality of massive data growth on the horizon.

Order Now! Get your free DB2 collateral from BMC!


Get your free Reference Guide and Catalog Tables Poster for z/OS from BMC.

Order Now ›

These postings are my own and do not necessarily represent BMC's position, strategies, or opinion.

Share This Post


John Barry

John Barry

John Barry has more than 15 years of DB2 experience, dating back to V5 of DB2 and every subsequent version since, including DB2 11. He began his career in DB2 at CDB Software as a technical support representative. Over the years at CDB, he served as Technical Support Manager, pre-sales specialist, and VP of Marketing. He is now Sr. Mgr, Solutions Marketing at BMC Software for the Database Solutions for DB2. John is a regular speaker at area user groups around the country and has worked with DB2 installations around the world on their automation strategies for DB2 data management.