The Three Pillars of Modern Analytics: Data, Storage, and Computing Power

DataSys+ · Database Fundamentals · Bởi Super Admin

Explore the three foundational elements enabling today's analytics revolution: exponential data growth, affordable storage, and democratized computing power.

The Convergence of Three Critical Trends

We are living in what many describe as the golden age of analytics. Businesses around the world recognize the vital nature of data to their work and are investing heavily in analytics programs designed to give them a competitive advantage. While organizations have been collecting data for years and statistical tools used in analytics work date back decades, the convergence of three major pillars has only recently created the conditions for analytics programs to truly thrive. These three pillars—data, storage, and computing power—have come together at this moment to allow analytics to flourish in ways previously impossible. Understanding each pillar and how they work together is essential for anyone preparing for the DataSys+ certification exam.

<img src="/question_assets/DataSys+/sg_c01f001.png" alt="A schematic illustration of structure of analytics which is made by modern data, storage, and computing capabilities."/>

<figcaption>Analytics is made possible by modern data, storage, and computing capabilities.</figcaption>

The image above illustrates how these three foundational elements combine to create the modern analytics ecosystem. Each pillar plays a distinct but equally important role in enabling organizations to extract value from their data assets.

The Explosion of Data Generation

The amount of data the modern world generates on a daily basis is staggering. From organized tables in spreadsheets to the storage of photos, video, and audio recordings, modern businesses create an almost overwhelming avalanche of data that is ripe for use in analytics programs. To understand the scale of this growth, consider that in 2010, Google's then-CEO Eric Schmidt estimated that the sum total of all stored knowledge created by the world at that point in time was approximately 5 exabytes. To put this in perspective, a file containing the text of a typical chapter is around 100 kilobytes, meaning Schmidt's estimate represented about 50 trillion copies of such a chapter.

The growth trajectory of data generation has accelerated dramatically since that 2010 estimate. By 2012, just two years later, researchers estimated that the total amount of stored data in the world had grown to 1,000 exabytes, also known as one zettabyte. This represents a 200-fold increase in just two years. The acceleration continued, and by 2022, IDC estimated that the world created 94 zettabytes of new information in that year alone. To contextualize this explosive growth: on any given day in the modern era, the world generates an amount of brand-new data that is approximately 32 times the sum total of all information created from the dawn of civilization until 2010. From an analytics perspective, this trove of data represents a gold mine of untapped potential.

Storage Costs and Accessibility

The second key trend driving the growth of analytics programs is the increased availability of storage at rapidly decreasing costs. Storage costs have plummeted dramatically over the past three decades, making it economically feasible for businesses to retain data for analysis in ways that were previously impossible. The cost of storing a gigabyte of data using magnetic hard drives has fallen from thousands of dollars in the early 1990s to nearly negligible amounts today.

<img src="/question_assets/DataSys+/sg_c01f002.png" alt="A graph depicts storage costs have decreased over time. The curve decreases from 100,000.0 to 0 between the year 1990 to 2020."/>

<figcaption>Storage costs have decreased over time.</figcaption>

The visualization above demonstrates that storage costs have plummeted to the point where storage is almost free. This dramatic reduction in storage costs means that businesses can afford to retain data for analysis in ways they never have before. Organizations no longer face the difficult choice of discarding data due to storage constraints; instead, they can maintain comprehensive data archives that support ongoing analytical initiatives.

Computing Power Democratization

The third pillar enabling modern analytics is the exponential growth in computing power. In 1975, Gordon Moore, one of the cofounders of Intel Corporation, made a prediction that computing technology would continue to advance so quickly that manufacturers would be able to double the number of components placed on an integrated circuit every two years. This prediction, commonly referred to as Moore's law, has generally held true and has benefited many technology-enabled fields, including analytics.

In the early days of analytics, computing power was costly and difficult to come by. Organizations with advanced analytics needs purchased massive supercomputers to analyze their data, but those supercomputers were scarce and expensive. Analysts fortunate enough to work in an organization that possessed a supercomputer had to justify their requests for small slices of time when they could use the powerful machines. Today, the effects of Moore's law have democratized computing in fundamental ways. Most employees in an organization now have enough computing power sitting on their desks to perform a wide variety of analytic tasks. If they require more powerful computing resources, cloud services allow them to rent massive banks of computers at very low cost. Even better, those resources are charged at hourly rates, and analysts pay only for the computing time they actually use. These three trends—massive data volume, inexpensive storage, and virtually infinite computing power through the cloud—create fertile ground for data analytics.

0.0 (0 đánh giá)

Thảo luận / Bình luận (0)

Chưa có thảo luận nào cho bài viết này. Hãy gửi bình luận đầu tiên nhé!

Vui lòng Đăng nhập để tham gia thảo luận.