Blog

The newly released whitepaper from IT analyst firm ESG (Enterprise Strategy Group), sponsored by IBM and Fujifilm, entitled, “How Tape Technology Delivers Value in Modern Data-driven Businesses,” focuses on exciting, new advances in tape technology that are now positioning tape for a critical role in effective data protection and retention in the age of zettabyte (ZB) storage. That’s right “zettabyte storage!”

The whitepaper cites the need to store 17 ZB of persistent data by 2025. This includes “cold data” stored long-term and rarely accessed that is estimated to account for 80% of all data stored today. Just one ZB is a tremendous amount of data equal to one million petabytes that would need 55 million 18 TB hard drives or 55 million 18 TB LTO-9 tapes to store. Just like the crew in the movie Jaws needed a bigger boat, the IT industry is going to need higher capacity SSDs, HDDs, and higher density tape cartridges! On the tape front, help is on the way as demonstrated by IBM and Fujifilm in the form of a potential 580 TB capacity tape cartridge. Additional highlights from ESG’s whitepaper are below.

New Tape Technology
IBM and Fujifilm set a new areal density record of 317 Gb/sq. inch on linear magnetic tape translating to a potential cartridge capacity of 580 TB native featuring a new magnetic particle called Strontium Ferrite (SrFe) with the ability to deliver capacities that extend well beyond disk, LTO, and enterprise tape roadmaps. SrFe magnetic particles are 60% smaller than the current defacto standard Barium Ferrite magnetic particles yet exhibit even better magnetic signal strength and archival life. On the hardware front, the IBM team has developed tape head enhancements and servo technologies to leverage even narrower data tracks to contribute to the increase in capacity.

The Case for Tape at Hyperscalers and Others
Hyperscale data centers are major new consumers of tape technologies due to their need to manage massive data volumes while controlling costs. Tape is allowing hyperscalers including cloud service providers to achieve business objectives by providing data protection for critical assets, archival capabilities, easy capacity scaling, the lowest TCO, high reliability, fast throughput, low power consumption, and air gap protection. But tape also makes sense for small to large enterprise data centers facing the same data growth challenges including the need to scale their environments while keeping their costs down.

Data Protection, Archive, Resiliency, Intelligent Data Management
According to an ESG survey revealed in the whitepaper, tape users identified reliability, cybersecurity, long archival life, low cost, efficiency, flexibility, and capacity as top attributes in tape usage today and favor tape for its long-term value. Data is growing relentlessly with longer retention periods as the value of data is increasing thanks to the ability to apply advanced analytics to derive a competitive advantage. Data is often kept for longer periods to meet compliance, regulatory, and for corporate governance reasons. Tape is also playing a role in cybercrime prevention with WORM, encryption, and air gap capabilities. Intelligent data management software, typical in today’s active archive environments, automatically moves data from expensive, energy-intensive tiers of storage to more economical and energy-efficient tiers based on user-defined policies.

ESG concludes that tape is the strategic answer to the many challenges facing data storage managers including the growing amount of data as well as TCO, cybersecurity, scalability, reliability, energy efficiency, and more. IBM and Fujifilm’s technology demonstration ensures the continuing role of tape as data requirements grow in the future and higher capacity media is required for cost control with the benefit of CO2 reductions among others. Tape is a powerful solution for organizations that adopt it now!

To read the full ESG whitepaper, click here.

I recently attended a webinar about why IT folks have a love/hate relationship with the cloud. They love the cloud because of its on-demand flexibility, unlimited compute and storage capacity, elimination of CAPEX costs, etc. They hate it, according to the webinar presenter, because of the cost that often produces “sticker shock.” Other irritants might include regulatory compliance issues and cyber security concerns.

To be completely fair to the cloud, the presenter explained that discipline and accountability could be brought to bear to help control costs and that organizations need to establish “a cloud center of excellence.” But at the same time, the presenter showed data from a study that suggested that 58% of respondents were moving some cloud-based workloads back to on-premises, private cloud environments. Finally, the presenter advised the audience to “understand your true cost of IT, TCO tools are out there!”

Getting Back to Hybrid Storage Strategies

I think the overall message of the webinar was that the cloud is great when used for the right applications and that a hybrid approach including a healthy mix of public cloud plus private cloud makes a lot of sense. In fact, the trend prior to COVID-19 appeared to be clearly hybrid. Cloud repatriation was happening as IT managers realized that the cloud is not a panacea for everything. During the COVID period, private cloud data centers were understaffed and under-supported by vendors, so the path of least resistance was to over-leverage the public cloud once again. As we begin to emerge from COVID lockdowns and IT staff returns to the data center, attention is being paid once again to finding a healthy mix of public cloud and on-premises private cloud.

This approach only makes sense and clearly reinforces that it is not an either-or scenario. In the case of storage, the cloud complements on-premises storage including today’s highly advanced and automated tape systems. Cloud comes in handy for example when on-demand access is frequently needed by multiple clients while tape systems can manage less frequently accessed and large data sets needing long-term retention including sensitive data and mission-critical data that can be air-gapped as a cyber security best practice. Tape is particularly well suited for these applications thanks to tape’s:

• High capacity
• Ease of scalability
• Ease of removability
• Long archival life and reliability
• Low TCO
• Low energy consumption and low carbon footprint

TCO Tools are Out There

Getting back to the webinar story and the advice to “understand your true cost of IT,” indeed TCO tools are out there and Fujifilm is pleased to offer a free, web-based interactive TCO tool developed by IT economics expert Brad Johns Consulting, LLC. This tool compares 5 year and 10 year TCO of automated tape systems to economy disk systems and cloud-based cold storage. The tool allows users to input the volume of data to be stored, the annual growth rate, the percent of cloud data retrieval as well as other variables such as the local cost per Kwh, the expense of full time storage management staff, number of copies of data, etc. The tool has been available for many years now and has evolved overtime to be as comprehensive as possible and includes the following CAPEX and OPEX cost variables:

• Media and hardware for disk and tape
• Maintenance for disk and tape
• Energy for disk and tape
• Offsite vaulting for tape
• Storage management for disk, tape, and cloud
• Storage and retrieval fees for cloud
• Data transfer fees for cloud
• Business level support for cloud

Reducing Energy Consumption and CO2 with Tape

Regarding the cost of energy for disk and tape, this expense can be significant over time especially for disk systems that are constantly spinning 24/7 generating heat and therefore require cooling. Given the heightened awareness of global warming and climate change, organizations are looking for ways to reduce energy consumption and their carbon footprint. Data center operations are no exception and have been spotlighted for their energy-intensive applications. Making greater use of renewable energy is part of the answer, but renewable energy can’t come online fast enough, or cheaply enough, to keep up with exponential data growth. Conservation has an even bigger potential to make a difference and that is where tape systems really shine.

Studies show that under certain scenarios inclusive of data management servers and network infrastructure, tape consumes 87% less energy than equivalent amounts of disk storage and therefore produces 87% less CO2 all while reducing TCO by 86% at the same time. Given that data quickly becomes static and frequency of access goes down dramatically after just 30 to 90 days, it makes sense to move that data from energy-intensive and higher cost tiers of storage like flash, performance disk, or even economy disk to lower-cost, energy-efficient tape systems. A good active archive architecture with intelligent data management software is a great way to achieve such storage optimization (getting the right data, in the right place, at the right time, and at the right cost).

To help highlight the energy advantage of tape and its reduction in CO2, the Fujifilm TCO tool now includes a calculation purely focused on the storage hardware layer that shows the reduction in CO2 compared to disk systems, with an example shown below based on storing 5.0 PB for 10 years with 30% annual growth and 12% data retrieval from the cloud.

So not only is TCO reduced with automated tape systems compared to disk and cloud storage, but a meaningful reduction in CO2 can be achieved and that is exactly what we all need to be doing to help slow down the negative impacts of global warming and climate change.

Recently my neighborhood had a rash of car break-ins by what turned out to be just a band of mischievous teenagers. But what struck me about this occurrence was the flood of homeowner video surveillance clips that appeared on social media and that were sent to the local police department to help identify the wrongdoers. It seems like everyone in the neighborhood has a home video surveillance system, perhaps to catch a doorstep package thief, or if nothing else, to catch the guilty dog walkers!

A Booming Market for Video Surveillance Solutions

Indeed, the video surveillance market is booming, not just in the relatively nascent consumer market, but in the commercial market and has been for a long time – in a much bigger way. The reasons for this include more affordable cameras with better resolutions soaring from 720p up to 4k and even 8k. In the meantime, video surveillance systems are finding more and more applications. Retail shopping malls, banks, hotels, city streets, transportation and highways, manufacturing and distribution operations, airport security, college dorm and campus security, corporate security, police body and dash cams, to name just a few – all need good quality video surveillance.

Video Retention Costs Soar

However, these higher resolution cameras have sent the costs of video retention soaring. So much high-resolution raw footage quickly fills up available hard disk drives commonly used to store or retain video surveillance content. According to a Seagate video surveillance calculator, an installation of 100 cameras recording eight hours a day at 30 frames per second, 1080p resolution, with a retention period of 90 days would require 2,006 terabytes of storage. That’s 2.0 petabytes of expensive, energy-intensive hardware. Those with unlimited budgets can simply add more disks. But everyone else faces tough choices: shorten retention periods? lower video resolution? reduce the number of cameras or frames per second? None of these support the goals of why the video surveillance system was installed in the first place.

Read more

The changing landscape of the data protection industry has evolved from primarily backing up data in order to recover from hardware, software, network failures and human errors, to fighting a mounting wave of cybercrime. Over the years, hardware and software have significantly improved their reliability and resiliency levels but security is a people problem, and people are committing the cybercrimes.

Cybercrime has now become the biggest threat to data protection and the stakes are getting higher as anonymous individuals seek to profit from other’s valuable digital data. With a cease-fire in the cybercrime war highly unlikely, we are witnessing a rapid convergence of data protection and cybersecurity to counter rapidly growing and costly cybercrime threats, including ransomware. The growing cybercrime wave has positioned air-gapped storage solutions as a key component of digital data protection – they simply can’t be hacked.

Traditional backup and archival data can be stored locally or in cloud environments. In contrast, a cyber-resilient copy of data must meet additional more stringent requirements. This is where “air gapping” and tape technology are gaining momentum. The rise of cybercrime officially makes the offline copy of data stored on tape more valuable and takes advantage of what is referred to as the tape air gap. The tape air gap is an electronically disconnected or isolated copy of data in a robotic library or tape rack that prevents cybercriminals from attacking a backup, archive or any other data.

Tape cartridges in a robotic tape library or manually accessed tape cartridges in tape racks, are currently the only data center class air-gapped storage solution available.

For more information, check out this Horison Information Strategies White Paper “The Tape Air Gap: Protecting Your Data From Cybercrime.”

By Drew Robb

I recently read an article in StorageNewsletter entitled “End of Removable Storage Media” and I agreed with many of the points including the demise of removable consumer media such as floppies, zip disks, CDs and DVDs. But I disagree about tape being on the way out like the rest of removable media from the past.

Tape was pronounced dead by Data Domain about 15 years ago when deduplication first entered the scene. Yet tape has not only survived, it thrives, particularly in an enterprise setting. Tape capacity shipments have been rising steadily for more than a decade. A record 114,079 PB of total LTO tape capacity (compressed) shipped in 2019, about four times more than shipped in 2009.

Why is this?

Tape offers removability

In an era when data breaches are escalating, and ransomware wreaks havoc, having an air gap between data and the network has become increasingly important. Whether it is a box of tapes stored by Iron Mountain, or tapes kept on site for use in an automated tape library, physical tapes are easy to isolate from the network. This feature of removability also makes tape easy to scale as you only need to add fresh media for more capacity, not more controllers, disk arrays and supporting hardware. Finally, because of its removability, tape is easily transported by truck or plane between data centers or between clouds and will often be faster and cheaper than using expensive bandwidth.

Tape offers high capacity

The latest generation of LTO tape cartridges can hold 18 TB native and 45 TB compressed per cartridge. To put that in perspective, one cartridge can hold 61.2 years of video recording running 24 hours per day, 4.78 billion human genomes worth of sequence information, or 2.88 years of data transmissions from the Hubble Space Telescope. Even larger cartridges are on the near horizon.

Tape underpins the cloud

The dirty little secret of the big cloud providers is that they rely on tape for high-volume, low-cost storage. These providers harness tape to hold multiple PBs of data, as do a great many large financial institutions. But that doesn’t mean tape is only the province of the few. Anyone with 100 TB or more of data will find value and efficiency with tape. In fact, vendors such as XenData are beginning to offer appliances that make it affordable to use tape for smaller workloads.

Read more

The past 10 years have been marked by explosive data growth and demand for storage. Meanwhile, the tape industry has experienced a renaissance thanks to significant advancements in capacity, reliability, performance, and functionality that have led to new applications and key industry adoption. Here’s a look at some of the key milestones.

Capacity

• In terms of capacity, the decade started for LTO with LTO-5 at 1.5 TB native capacity and culminated most recently with LTO-8 at 12.0 TB and LTO-9 soon to be delivered at 18.0 TB.
• Enterprise tape formats started the decade at 1.0 TB native and are currently at 20.0 TB native.
• Barium Ferrite magnetic particles became a key enabler for multi-terabyte tapes and were demonstrated by IBM and Fujifilm in 2015 to have the potential to achieve 220 TB on a single tape cartridge. This signaled that tape technology had no fundamental areal density limitations for the foreseeable future.
• By the end of the decade, IBM and Fujifilm demonstrated the ability to achieve a record areal density of 317 GBPSI using the next generation of magnetic particles, Strontium Ferrite, with a potential cartridge capacity of 580 TB.

Reliability and Performance

• During the decade, tape achieved the highest reliability rating as measured by Bit Error Rate at 1 x 10¹⁹, even better than enterprise HDD at 1 x 10¹⁶.
• Data transfer rates for tape also improved from 140 MB/sec. in 2010 to an impressive 400 MB/sec.
• LTFS provided an open tape file system with media partitions for faster “disk-like” access and ease of interchangeability, making LTO a de facto standard in the Media & Entertainment industry.

New Applications and Key Industry Adoption

• Storing objects on tape became a reality with object archive software solutions offering S3 compatibility, objects can now move to and from tape libraries in their native object format.
• The concept of active archiving grew in popularity with tape as a key component complementing flash, HDD and cloud for cost-effectively maintaining online archives.
• Tape was recognized for its ease of removability and portability, providing air gap protection in the escalating war against cybercrime.
• Major U.S. hyperscalers began to rely on tape during the decade for both back-up and deep archive applications. In one well-publicized example, Google restored a February 2011 Gmail outage from its tape backups. Microsoft adopted tape for Azure later in the decade. Tape became firmly established as a competitive advantage for these and other hyper scalers based on its scalability, long archival life, lowest TCO, low energy consumption, and air gap security.

With this steady technological advancement over the last decade, tape has been recognized for its complementary value to flash, HDD and cloud in tiered storage strategies for managing data in the zettabyte age.

Ransomware statistics can be frightening! Research studies suggest that over two million ransomware incidents occurred in 2019 with 60% of organizations surveyed experiencing a ransomware attack in the past year. To make matters worse, the cybercriminals have moved up the food chain. Two thirds of those attacked said the incident cost them $100,000 to $500,000. Another 20% said the price tag exceeded half a million. Overall, the losses are measured in billions of dollars per year. And it’s getting worse. Enterprise Strategy Group (ESG) reports that about half of all organizations have seen a rise in cyber attacks since the recent upsurge in people working from home.

Understandably, this is a big concern to the FBI. It has issued alerts about the dangers of ransomware. One of its primary recommendations to CEOs is the importance of backup with the following key questions:

“Do you backup all critical information? Are backups stored offline? Have you tested your ability to revert to backups during an incident?”

The key word in that line of questioning is “offline.” Hackers have gotten good at staging their attacks slowly over time. They infiltrate a system, quietly ensuring that backups are infected as well as operational systems. When ready, they encrypt the files and announce to the company that they are locked out of their files until the ransom is paid. Any attempt to recover data from disk or the cloud fails as the backup files are infected, too.

The answer is to make tape part of the 3-2-1 system: Three separate copies of data, stored on at least two different storage media with one copy off-site. This might mean, for example, one copy retained on onsite disk, another in the cloud, and one on tape; or one on onsite disk, one on onsite tape as well as tape copies stored offsite.

Read more

By Kevin Benitez

Data is quickly becoming a critical asset to more and more companies, and now those companies are looking for ways to store massive amounts of data for long periods of time at a low cost for digital preservation or archiving.

Today, large amounts of archived data are being stored in object storage at an ever-increasing rate, both on-premise and in remote data centers such as the cloud.  Object storage has been particularly attractive for storing large amounts of digital information because of its flat architecture and easy access to metadata that allows for easy indexing, finding, and using of digital content. Additionally, object stores can scale to hundreds of petabytes in a single namespace without any performance degradation.

With those needs in mind, Fujifilm has developed the FUJIFILM Object Archive, which allows object storage to be written and read to and from data tape instead of mainstream HDDs, thereby significantly reducing costs. FUJIFILM Object Archive uses OTFormat to leverage object storage and modern tape. The software uses an industry-standard S3-compatible API so that on-premises object storage can be used at a lower cost while maintaining the same operability as cloud storage.

Read more