Follow this blog:
RSS

Data explosion: enough to fill DVDs stretching to the moon and back

By | May 14, 2010, 7:27 AM PDT

IDC has just released estimates that this year, the Digital Universe — meaning every electronically stored piece of data or file out there — will reach 1.2 million petabytes, or 1.2 zettabytes, this year.

That’s up from a measly 800,000 petabytes in 2009. Despite an economic slowdown or meltdown in some quarters, the total amount of data still grew by 62%, IDC reports. To illustrate how much data this is, write John Gantz and David Reinsel, authors of the latest IDC report on the size of the Digital Universe, “picture a stack of DVDs reaching from the earth to the moon and back.” (About 240,000 miles each way.)

Still, this is only the beginning of a data explosion, Gantz and Reinsel observe — by 2020, the amount of data will have grown 44-fold from 2009, to 35 trillion gigabytes. Fueling the growth will be the evolution of all major forms of media – voice, TV, radio, print – from analog to digital.

“Our stack of DVDs would now reach halfway to Mars,” Gantz and Reinsel note. Most of this digital content is not unique — in fact, Gantz and Reinsel relate, “nearly 75% of our digital world is a copy – in other words, only 25% is unique.”

Of course, each and everyone of us contributes to the pile every day. Len Devanna, executive with EMC, sponsor of the study, puts it in perspective:

“In the past four weeks, I’ve personally generated about 5.3 GB in video, 1.6 GB in photos, 3 GB in audio  and let’s say another 1 GB for emails, documents, Tweets, etc;. That’s about 11 GB of new information that did not exist a short month ago. That’s about 500 times larger than my first hard drive. Of course, these numbers represent just the stuff I know about. There’s also the information inherently created as I simply go through life… Every time I make an online purchase, swipe my badge to enter work, get processed  going through a toll booth with my EZ Pass, etc;.  Each of these things leaves behind some digital footprint, and generates new information in the process.”

IDC also estimates that at least 15% of the Digital Universe by 2020 will be managed or stored in the cloud — that is, “created in the cloud, delivered to the cloud, stored and manipulated in the cloud.” Gantz and Reinsel add that at least a third of all this data will “pass through the cloud” at some point in the lifecycle.

With all this data comes security headaches, of course. “By 2020, almost 50% of the information in the Digital Universe will require a level of IT-based security beyond a baseline level of virus protection and physical protection. That’s up from about 30% this year,” Gantz and Reinsel caution. “And while the portion of that part of the Digital Universe that needs the highest level of security is small – in gigabytes and total files – that portion will grow by a factor of 100.”

And, they add: “Not all data needs to be protected equally. A YouTube video of a cat doing tricks would seem to need less protection against hacking or corruption than a home-banking customer’s account balances.”

One bit of good news is the staffing and investment to manage this Digital Universe will only grow by a factor of 1.4. IDC estimates that in 2009, the world spent nearly $4 trillion on hardware, software, services, networks, and IT staff to manage the Digital Universe. “That spending is expected to grow modestly between now and 2020, which means the cost of managing each byte in the Digital Universe will drop steadily – an incentive to create even more information,” Gantz and Reinsel say.

Start your week smarter with our weekly e-mail newsletter. It's your cheat sheet for good ideas. Get it.

Joe McKendrick

About Joe McKendrick

Joe McKendrick is a contributing editor for SmartPlanet.

Joe McKendrick

Joe McKendrick

Contributing Editor, Business

Joe McKendrick is an independent analyst who tracks the impact of information technology on management and markets. He is the author of the SOA Manifesto and has written for Forbes, ZDNet and Database Trends & Applications. He holds a degree from Temple University. He is based in Pennsylvania.

Follow him on Twitter.

Joe McKendrick

Joe McKendrick

Joe McKendrick is an independent consultant and editor. Joe has performed project work for the following companies in the IT marketspace: IBM, Systinet/HP, Teradata. He has performed project work for the following organizations in partnership with Unisphere Research (Unisphere Media): IBM, Oracle Corp., International Oracle Users Group, Oracle Applications Users Group, Professional Association for SQL Server, International DB2 Users Group, International Sybase Users Group.

He writes for SmartPlanet and is not an employee of CBS.

If you liked this, don't miss...
6
Comments

Join the conversation!

Follow via:
RSS
0 Votes
+ -
The Beginning
I first began with a 160 kilobyte floppy disk and DOS 2.0. That was a long time ago.
Posted by tecug@...
18th May 2010
0 Votes
+ -
RE: Data explosion: enough to fill DVDs stretching to the moon and back
Though I did have the oppertunity once to try usingDOS 1.8 and I don't recall it even having any drive saving capabilities.
Posted by tecug@...
18th May 2010
0 Votes
+ -
RE: Data explosion: enough to fill DVDs stretching to the moon and back
The quote from DeVana about all lthe data he created is sheer idiocy. I'm certain there's no way he generated 11GB of novel
new data in a month. The vast majority of it is crap he copied from friends or found on the net. As the article says 3/4 of what we generate is duplicate. So, his contribution is 2 3/4 Gig, far
less than what he claims Of course it's too much to ask an idiot like him to think things through.
Posted by ashahsa
18th May 2010
0 Votes
+ -
RE: Data explosion: enough to fill DVDs stretching to the moon and back
Be careful in professing that someone, in this case an exec with EMC can't generate 11Gb of new data in a month. As a hobbyist photographer, I recently generated almost 3GB of "new data" in just one afternoon taking photos at the zoo and botanical gardens, using a 12MP Canon DSLR. Video data size can easily grow much faster, and as an one-man IT shop covering 65 users, I probably field about 500MB of email data (with attachments/screenshots/photos/etc) per month, not to mention the various reports, memos, and spreadsheets I create in my day-to-day duties. Lastly, our field staff generates over 2.5GB of jobsite photos every business day.
Posted by handyman1972@...
18th May 2010
0 Votes
+ -
Thats an awful lot of tweet tweet tweet ;o)
NT
Posted by SiO2
24th May 2010
0 Votes
+ -
Duplicator
An awesome post with a abundant of informative stuff. The expansion of the post covers a vast area of information. Thanks for the nice sharing.
Duplicator
DVD distribution
Posted by SummitTechnology
18th May 2012
Join the conversation
Formatting +
BB Codes - Note: HTML is not supported in forums
  • [b] Bold [/b]
  • [i] Italic [/i]
  • [u] Underline [/u]
  • [s] Strikethrough [/s]
  • [q] "Quote" [/q]
  • [ol][*] 1. Ordered List [/ol]
  • [ul][*] · Unordered List [/ul]
  • [pre] Preformat [/pre]
  • [quote] "Blockquote" [/quote]

Join the SmartPlanet community and join the conversation! Signing up is fast and free. Don't wait -- we want to hear your opinion!