Blog

By Andrew Dodd, Guest Blogger, Worldwide Marketing Communications Manager
at Hewlett Packard Enterprise Storage

The presence of a ring of video surveillance cameras clinging to a vantage spot like a cluster of digital coconuts has long been a familiar sight in public spaces. And for many years, in both Hollywood and on television, countless storylines have turned on whether the detectives or investigators could access CCTV footage and solve the mystery by reviewing the tale of the tape.

But although the idea of cameras and surveillance has become an accepted feature of society (like it or not), what is less obvious perhaps is how much the market for video surveillance equipment is growing and how much the cameras themselves have changed. Both of these factors have profound implications for digital storage.

You had better be ready for your close up

First, the market. A 2020 report from IDC entitled “Worldwide Video Surveillance Camera Forecast, 2020-2025” (#US46230720) estimates that by 2025, the worldwide video surveillance camera market will grow to $44 billion, up from $23.6 billion in 2019, with a five-year compound annual growth rate (CAGR) of nearly 13%. This is largely due to the increasing adoption of smart camera systems and analytical software that enables them to be utilized in a variety of roles — beyond simple surveillance. Another report, by research firm IHS Markit, predicts that by the end of 2021 alone, there will be 1 billion surveillance cameras installed globally, with over 50% of those in a single country: China.

The growth of 4K

In the past, video surveillance cameras have sometimes been criticised both for their ubiquity and their usefulness: critics pointed out that although the cameras seemed to be proliferating in many public spaces, their benefit was undermined by poor image quality and resolution. Not any more. The next-gen cameras that are driving the growth to 2025 will increasingly deliver HD and Ultra HD (4K) images of astonishing detail and clarity. In turn, this is opening up a wealth of new applications that can be managed by artificial intelligence systems: for example, monitoring industrial equipment, providing security, and (more controversially) real-time facial recognition.

Why are cameras being deployed?

Many of today’s larger organizations such as hospitals, airports, university campuses, and casinos find themselves needing a video surveillance system as either a replacement for an aging CCTV installation or as a brand-new installation. The ability to quickly and easily provide high-resolution video evidence of a security incident can be very relevant in narrowing down suspects in case of a crime. And the same video evidence can also limit the liability of an organization in case of a lawsuit. So there are clearly business benefits in upgrading to the latest surveillance technology.

The storage challenge

But if the number of cameras is increasing rapidly, and if the quality of the images they produce is becoming more refined and detailed, then all of this can only mean one thing: we’re going to need a lot more storage. Gone are the days when weeks of footage could be kept on a handful of old videotapes that could be wiped and reused at the end of the month. In the first instance, today’s surveillance cameras record primarily record to disk. And a single hour of RAW 4K video footage produced by just one unit consumes something in the region of 110GB of disk capacity. Multiply this by millions of hours, and hundreds of millions of cameras, and it’s clear that video surveillance applications will require colossal amounts of storage, not just for the primary purpose of storing the original footage, but also for backing up and archiving that material.

Read more

By Rich Gadomski, Fujifilm, and Paul Lupino and Tom Trela, Iron Mountain

If there was ever a time for industries and governments around the world to come together and finally take steps to mitigate climate change, now would seem to be it. The return of the United States to the Paris Climate Agreement and the recent U.S. –  China talks on climate change are all positive signs when it comes to moving the needle forward on sustainability initiatives. While fighting COVID-19 took center stage in 2020 and early 2021, our future depends on what we do collectively to reduce our environmental impact now and in the immediate years ahead.

It’s Hard to Deny Global Warming and Climate Change

According to an article that appeared in the Wall Street Journal earlier this year, NASA has ranked 2020 as tied with 2016 for the warmest year since record-keeping began in 1880. In a separate assessment, NOAA  (National Oceanic and Atmospheric Administration), which relies on slightly different temperature records and methods, calculated that the global average temperature last year was the second highest to date – just 0.04 degrees Fahrenheit shy of tying the record set in 2016.

On top of the record number of hurricanes and the wildfires out west, the recent Texas deep freeze, which caused widespread power outages and other weather-related tragedies and calamities, seems to be just one more example of climate change. Weather patterns are becoming more unpredictable, which can result in extreme heat, cold and increased intensity of natural disasters.

It is widely acknowledged that global temperatures have been rising especially in the north polar region where we have seen a dramatic shrinking of the polar ice cap. When Arctic air warms, it sets off an atmospheric phenomenon that weakens the polar vortex (the normal jet stream of wind that keeps frigid air to the north) and allows cold air to fall…as far as Texas.

Data Center Energy Consumption and the Advantage of Modern Tape Technology

The key to mitigating the worst impacts of climate change is a reduction in the amount of greenhouse gases produced by humans. Producing energy is extremely resource-intensive, so reducing the amount of energy we consume in all aspects of our lives is of critical importance.

Data centers are significant consumers of energy accounting for as much as 2% of global demand and rising to 8% by some estimates. Data centers can do their part to reduce energy consumption in many ways by becoming more energy-efficient, including simply migrating the vast amounts of still valuable, but rarely accessed, “cold data”.

Read more

Recently my neighborhood had a rash of car break-ins by what turned out to be just a band of mischievous teenagers. But what struck me about this occurrence was the flood of homeowner video surveillance clips that appeared on social media and that were sent to the local police department to help identify the wrongdoers. It seems like everyone in the neighborhood has a home video surveillance system, perhaps to catch a doorstep package thief, or if nothing else, to catch the guilty dog walkers!

A Booming Market for Video Surveillance Solutions

Indeed, the video surveillance market is booming, not just in the relatively nascent consumer market, but in the commercial market and has been for a long time – in a much bigger way. The reasons for this include more affordable cameras with better resolutions soaring from 720p up to 4k and even 8k. In the meantime, video surveillance systems are finding more and more applications. Retail shopping malls, banks, hotels, city streets, transportation and highways, manufacturing and distribution operations, airport security, college dorm and campus security, corporate security, police body and dash cams, to name just a few – all need good quality video surveillance.

Video Retention Costs Soar

However, these higher resolution cameras have sent the costs of video retention soaring. So much high-resolution raw footage quickly fills up available hard disk drives commonly used to store or retain video surveillance content. According to a Seagate video surveillance calculator, an installation of 100 cameras recording eight hours a day at 30 frames per second, 1080p resolution, with a retention period of 90 days would require 2,006 terabytes of storage. That’s 2.0 petabytes of expensive, energy-intensive hardware. Those with unlimited budgets can simply add more disks. But everyone else faces tough choices: shorten retention periods? lower video resolution? reduce the number of cameras or frames per second? None of these support the goals of why the video surveillance system was installed in the first place.

Read more

By Drew Robb

I recently read an article in StorageNewsletter entitled “End of Removable Storage Media” and I agreed with many of the points including the demise of removable consumer media such as floppies, zip disks, CDs and DVDs. But I disagree about tape being on the way out like the rest of removable media from the past.

Tape was pronounced dead by Data Domain about 15 years ago when deduplication first entered the scene. Yet tape has not only survived, it thrives, particularly in an enterprise setting. Tape capacity shipments have been rising steadily for more than a decade. A record 114,079 PB of total LTO tape capacity (compressed) shipped in 2019, about four times more than shipped in 2009.

Why is this?

Tape offers removability

In an era when data breaches are escalating, and ransomware wreaks havoc, having an air gap between data and the network has become increasingly important. Whether it is a box of tapes stored by Iron Mountain, or tapes kept on site for use in an automated tape library, physical tapes are easy to isolate from the network. This feature of removability also makes tape easy to scale as you only need to add fresh media for more capacity, not more controllers, disk arrays and supporting hardware. Finally, because of its removability, tape is easily transported by truck or plane between data centers or between clouds and will often be faster and cheaper than using expensive bandwidth.

Tape offers high capacity

The latest generation of LTO tape cartridges can hold 18 TB native and 45 TB compressed per cartridge. To put that in perspective, one cartridge can hold 61.2 years of video recording running 24 hours per day, 4.78 billion human genomes worth of sequence information, or 2.88 years of data transmissions from the Hubble Space Telescope. Even larger cartridges are on the near horizon.

Tape underpins the cloud

The dirty little secret of the big cloud providers is that they rely on tape for high-volume, low-cost storage. These providers harness tape to hold multiple PBs of data, as do a great many large financial institutions. But that doesn’t mean tape is only the province of the few. Anyone with 100 TB or more of data will find value and efficiency with tape. In fact, vendors such as XenData are beginning to offer appliances that make it affordable to use tape for smaller workloads.

Read more

In mid-December 2020, Fujifilm issued a press release to announce that, together with IBM Research, they had successfully achieved a record areal density of 317 Gbpsi (billion bits per square inch) on next-generation magnetic tape coated with next-generation Strontium Ferrite (SrFe) magnetic particles. This areal density achievement would yield an amazing native storage capacity of 580TB on a standard-sized data cartridge. That’s almost 50 times more capacity than what we have now with an LTO-8 tape based on Barium Ferrite (BaFe) at 12TB native.

Shortly after the news came out, I was on a call with a member of our sales team discussing the announcement and he asked me when the 580TB cartridge would be available and if there was any pricing information available yet? He was also curious about transfer speed performance. I had to admit that those details are still TBD, so he asked me “what are the 3 big takeaways” from the release? So let’s dive into what those takeaways are.

Tape has no fundamental technology roadblocks

To understand the magnitude of tape areal density being able to reach 317 Gbpsi, we have to understand just how small that is in comparison to HDD technology. Current HDD areal density is already at or above 1,000 Gbpsi while achieving 16TB to 20TB per drive on as many as nine disk platters. This level of areal density is approaching what is known as the “superparamagnetic limitation,” where the magnetic particle is so small that it starts to flip back and forth between positive and negative charge. Not ideal for long-term data preservation.

So to address this, HDD manufacturers have employed things like helium-filled drives to allow for closer spacing between disk platters that allow for more space for more platters, and therefore more capacity.  HDD manufacturers are also increasing capacity with new techniques for recording involving heat (HAMR) or microwaves (MAMR) and other techniques. As a result HDD capacities are expected to reach up to 50TB within the next five years or so. The reason tape can potentially reach dramatically higher capacities has to do with the fact that a tape cartridge contains over 1,000 meters of half-inch-wide tape, and, therefore, has far greater surface area than a stack of even eight or nine 3.5-inch disk platters.

But let’s also look at track density in addition to areal density. Think about the diameter of a single strand of human hair which is typically 100 microns wide. If a single data track on HDD is 50 nanometers wide, you are looking at 2,000 data tracks for HDD on the equivalent width of a single strand of human hair! For tape, with a track width of approximately 1,200 nanometers, you are looking at just 84 data tracks. But this is actually a positive for tape technology because it shows that tape has a lot of headroom in both areal density and track density, and that will lead to higher capacities and help to maintain a low TCO for tape.

But let me make it clear that this is not about HDD vs. tape. We are now in the zettabyte age having shipped just over an impressive one zettabyte (1,000 exabytes) of new storage capacity into the global market in 2019 of all media types. According to IDC, that number will balloon to a staggering 7.5 ZB by 2025. We will need a lot of HDDs and a lot of tape (and flash for that matter) to store 7.5 ZB!

Read more

The past decade saw the renaissance of data tape technology with dramatic improvements to capacity, reliability, performance, and TCO giving rise to new industry adoptions and functionality. This trend will only continue in 2021 as data storage and archival needs in the post-COVID digital economy demand exactly what tape has to offer. Below are 5 key contributions tape will make to the storage industry in 2021.

Containing the Growing Cost of Storage
One lingering effect of the pandemic will be the need for more cost containment in already budget-strapped IT operations. We are well into the “zettabyte age,” and storing more data with tighter budgets will be more important than ever. Businesses will need to take an intelligent and data-centric approach to storage to make sure the right data is in the right place at the right time. This will mean storage optimization and tiering where high capacity, low-cost tape plays a critical role — especially in active archive environments.

A Best Practice in Fighting Ransomware
One of many negative side effects of COVID-19 has been the increasing activity of ransomware attacks, not only in the healthcare industry which is most vulnerable at this time, but across many industries, everywhere.  Backup and DR vendors are no doubt adding sophisticated new anti-ransomware features to their software that can help mitigate the impact and expedite recovery. But as a last line of defense, removable tape media will increasingly provide air-gap protection in 2021, just in case the bad actors are one step ahead of the good guys.

Compatibility with Object Storage
Object storage is rapidly growing thanks to its S3 compatibility, scalability, relatively low cost and ease of search and access. But even object storage content eventually goes cold, so why keep that content on more expensive, energy-intensive HDD systems? This is where tape will play an increasing role in 2021, freeing up capacity on object storage systems by moving that content to a less expensive tape tier all while maintaining the native object format on tape.

Read more

The past 10 years have been marked by explosive data growth and demand for storage. Meanwhile, the tape industry has experienced a renaissance thanks to significant advancements in capacity, reliability, performance, and functionality that have led to new applications and key industry adoption. Here’s a look at some of the key milestones.

Capacity

• In terms of capacity, the decade started for LTO with LTO-5 at 1.5 TB native capacity and culminated most recently with LTO-8 at 12.0 TB and LTO-9 soon to be delivered at 18.0 TB.
• Enterprise tape formats started the decade at 1.0 TB native and are currently at 20.0 TB native.
• Barium Ferrite magnetic particles became a key enabler for multi-terabyte tapes and were demonstrated by IBM and Fujifilm in 2015 to have the potential to achieve 220 TB on a single tape cartridge. This signaled that tape technology had no fundamental areal density limitations for the foreseeable future.
• By the end of the decade, IBM and Fujifilm demonstrated the ability to achieve a record areal density of 317 GBPSI using the next generation of magnetic particles, Strontium Ferrite, with a potential cartridge capacity of 580 TB.

Reliability and Performance

• During the decade, tape achieved the highest reliability rating as measured by Bit Error Rate at 1 x 10¹⁹, even better than enterprise HDD at 1 x 10¹⁶.
• Data transfer rates for tape also improved from 140 MB/sec. in 2010 to an impressive 400 MB/sec.
• LTFS provided an open tape file system with media partitions for faster “disk-like” access and ease of interchangeability, making LTO a de facto standard in the Media & Entertainment industry.

New Applications and Key Industry Adoption

• Storing objects on tape became a reality with object archive software solutions offering S3 compatibility, objects can now move to and from tape libraries in their native object format.
• The concept of active archiving grew in popularity with tape as a key component complementing flash, HDD and cloud for cost-effectively maintaining online archives.
• Tape was recognized for its ease of removability and portability, providing air gap protection in the escalating war against cybercrime.
• Major U.S. hyperscalers began to rely on tape during the decade for both back-up and deep archive applications. In one well-publicized example, Google restored a February 2011 Gmail outage from its tape backups. Microsoft adopted tape for Azure later in the decade. Tape became firmly established as a competitive advantage for these and other hyper scalers based on its scalability, long archival life, lowest TCO, low energy consumption, and air gap security.

With this steady technological advancement over the last decade, tape has been recognized for its complementary value to flash, HDD and cloud in tiered storage strategies for managing data in the zettabyte age.

In this Executive Q&A, Rich Gadomski, Fujifilm’s Head of Tape Evangelism, discusses the evolution of tape storage and how recent innovations and advancements in tape technology are putting it at center stage.

Explain your role as Tape Evangelist for FUJIFILM Recording Media, U.S.A.

I believe tape technology has a compelling value proposition and a great story to tell. I want to be focused on telling that story and that is my primary role. Of course, it takes a team and we all do our part, but this is what I’m passionate about and want to focus on.

How has the tape storage industry changed over the years?

Tape technology has come a long way since its introduction in the 1950s where we had reel-to-reel tape that could hold just a few megabytes of data. Today we have LTO tape in the market at 12 TB native and enterprise tape at 20TB. Just looking at LTO which came out 20 years ago, it was LTO Gen 1 in 2000 with 100GB of capacity. We expect LTO-9 soon at 18TB so a 180x increase. And just recently we announced a joint demonstration with IBM showing that we can reach up to 580 TB on a single cartridge with our next generation of magnetic particle called Strontium Ferrite. But it’s not just about capacity increases, tape has also made advancements in transfer rate, now faster than HDD, reliability rating, now three or four magnitudes better than HDD and it’s the greenest form of storage consuming far less energy than constantly spinning HDD and this contributes to its lowest total cost of ownership. But today it’s not about tape vs. HDD, in fact, the two technologies complement each other to help customers optimize their data storage.

Why is tape storage still relevant today? What is driving demand for this technology?

I would say first and foremost the incredible amount of data that’s being created in this digital economy. Add to the fact that the value of data is increasing so we want to store more of it for longer periods of time. Yet, IT budgets are flat or barely increasing, so you need a high capacity, highly reliable storage media that is cost-effective for long-term storage and that’s what tape gives you. So tape plays a role in cold archiving, active archiving and yes, backup as well. In fact, tape has renewed interest from customers in the fight against cybercrime and ransomware since customers can easily backup to tape and remove those backups from the network to an isolated and secure location that hackers can’t get to. That’s what we refer to as the tape air gap. Last but not least is energy consumption. Society is rightfully concerned about climate change. Tape consumes 87% less energy than disk and that leads to 87% less CO2 emissions.

Read more

Modern tape storage has long been recognized for its low cost. Several analyst white papers have been published that demonstrate the low cost of storing data on tape. For example, “Quantifying the Economic Benefits of LTO-8 Technology” is a white paper that can be found on the LTO.org website. However, occasionally a storage solution provider publishes a white paper that claims to show that their solution is less expensive than tape storage for a particular use case. A good example is a recent white paper published by a disk-based backup-as-a-service provider who will remain unidentified out of respect for what they do. For the purpose of this blog, let’s call them “BaaS.” So let’s dig into their analysis which makes several assumptions that result in higher costs for tape storage than most users would experience.

Total Cost of Ownership (TCO) Process

The first step in developing a Total Cost of Ownership (TCO) estimate is the determination of the amount of data to be stored. The BaaS whitepaper separates the amount of primary data, which we wish to protect, from backup data, which is the data physically stored on the backup media. They estimate the amount of backup data residing in the tape library to be two to four times the primary data. This is due to their use of the old daily/ weekly/monthly/ full backup methodology for estimating the amount of backup data. The result is that two to four times the amount of primary data ends up being stored on tape, raising the tape hardware and media costs by two to four times.

Read more

Modern tape storage has become the leading strategic and lowest-cost storage solution for massive amounts of archival and unstructured data. This bodes well for future tape growth as archival data is piling up much faster than it is being analyzed. Over the past decade, the magnetic tape industry has successfully re-architected itself delivering compelling technologies and functionality including cartridge capacity increases, vastly improved bit error rates yielding the highest reliability of any storage device, a media life of 30 years or more, and faster data transfer rates than any previous tape or HDD (Hard Disk Drive).

Many of these innovations have resulted from technologies borrowed from the HDD industry and have been used in the development of both LTO (Linear Tape Open) and enterprise tape products. Additional tape functionality including LTFS, RAIT, RAO, TAOS, smart libraries and the Active Archive adds further value to the tape lineup. HDD technology advancement has slowed while progress for tape, SSD (Solid State Disk) and other semiconductor memories is steadily increasing. Fortunately, today’s tape technology is nothing like the tape of the past.

For more information, check out this Horison Information Strategies White Paper “Tape Storage: It’s a New Game With New Rules.”