A 'cloudy' future for post production.(Storage Solutions)

Why cloud storage?

Using remote resources through the Internet is often referred to as utilizing assets in the clouds. These resources can be under the control of an enterprise with limited access and are then referred to as a private cloud or available to a broader public, in which case these assets are in a public cloud.

Many cloud implementations are a form of outsourcing, where the hardware and most of the asset management software are located in an aggregated datacenter. These shared resources can also be in an enterprise's own datacenter and under their direct control and management. Hardware resources that can be shared in a cloud include computer processors and digital storage.

Hardware virtualization has driven the modern growth in the use of hardware clouds. Hardware virtualization allows more efficient use of hardware assets. In the case of digital storage in the cloud this virtualization as well as additional features, such as de-duplication allow better storage system use. These factors reduce the bandwidth demand for operations such as backup and can also reduce the recovery time for back-up data. These concepts, developed originally for IT applications, may be ideal for some functions in modern digital workflows. Taken together, remote datacenters with well-managed storage systems can achieve cost efficiencies that are difficult to achieve with locally-managed assets.

PRODUCTION & DISTRIBUTION

Cloud storage is getting traction as a cost-effective approach to modern post production workflows. While the latency of remote access through the Internet may limit the use of cloud storage for direct creative editing, cloud storage can be used for compute intensive operations, such as rendering, transcoding, content distribution and archiving. Using out-sourced cloud storage, organizations can keep their media assets in a centralized managed repository and pay for storage capacity and management as the asset library grows.

Assuming that the cloud storage provider does a good job of data protection and management--a critical feature for long-term media assets--cloud storage may be a cost-effective solution for smaller production facilities that cannot or do not want to invest in the complexity of local archive storage infrastructure. Assets stored in cloud storage also offer advantages for workflows conducted across multiple time zones and locations since the content can be accessed anytime and anywhere.

Companies offering either storage systems and/or services for cloud-based content access for digital workflows and content distribution include Nirvanix, DataDirect Networks, EMC, Oracle and NetApp (to name only a few). Figure 1 shows an example of a distributed region-based content delivery network for either collaborative workflows or for content distribution can be built in the cloud.

In addition to consolidated storage assets, cloud providers also offer remote compute services. This combination is very useful for cloud-based rendering as well as conforming and assembling content. Modern rendering requires the latest server and storage devices, and these expensive services are generally only needed for a short time during most video production projects. Thus leasing time on a cloud service makes a lot more sense than, for instance, buying and maintaining a high-end rendering facility.

Encoding content and delivering that content is the path to monetization of the content. Storing and delivering content across the Internet is one of the biggest uses of cloud-based storage. Companies such as www.encoding.com and Content Bridge offer transcoding services for the 300 or more distribution formats now in use. Figure 2 shows that additional revenues may be expected due to a longer asset life cycle for online content.

KEEPING CONTENT FOR THE LONG TERM

There are efforts underway to enable very long-term data retention in cloud storage. Efforts by the Active Archive Alliance (www.activearchive.com), 5NIA (www.snia.org /forums/dmf/programs/ltacsi/100_year) and organizations directly associated with the media and entertainment industry, such as The Academy of Motion Pictures Arts and Sciences and SMPTE are working on methods and standards for long-term archiving of digital media assets. Many of these efforts could be or are directly targeted for long-term retention of media assets stored and accessible through the Internet. Recently the SNIA Long Term Retention Working Group teamed up with the SNIA Cloud Storage Initiative to come up with protocols and standards for archiving content in clouds.

Cloud data management using object storage allows a richer and more extensible environment for metadata associated with the content, making the content easier to organize and use. Using a standard interface for object storage in the cloud such as SNIA's CDMI provides a more scalable way to handle large libraries of content in an archive.

The apparent latency of Internet access can be hidden by using local cloud storage gateways, which offers a NAS-like front end access to the cloud storage for uploading and downloading content as needed. Increasing access to fast WAN and MAN networks has also improved online content access. Ingest and data delivery of TBs per day are possible on modern Internet networks. For really large content files, physical shipping of storage devices may be much faster than uploading the content. Such cloud storage gateways make implementation of cloud storage as a secondary and tertiary data silo possible and efficient.

Companies providing cloud-based archives include Content Bridge, which does encoding, provides a content library for content distribution and also provides an optional online archiving service for the master distribution content, and Canto (using the Archiware PreStore service). Nirvanix, one of the most out-spoken champions for video content in the clouds, is used by NBC Universal for their digital master content storage.

Figure 3 shows the relationship of local storage and the digital content masters in the cloud. Lossless compressed content of over 1.7 petabytes is currently in this system, up from 40TB a year ago. New content is being added at the rate of about 7TB/day.

LIFE IN THE CLOUDS

While hardware clouds are not the cure to all ills of video production, it may be a cost effective path for access to professional services, long-term managed archives as well as content distribution. This is a fast developing area and it remains to be seen how far cloud-based services can extend into the video production workflow.

Coughlin Associates provides digital storage and applications consulting, storage industry market and technology analysis, and conducts conferences focused on digital storage and applications.

Tom Coughlin

President Coughlin Associates

www.tomcoughlin.com