That Red Hat cloud -- along with the latest 3-D authoring tools -- helped create Monsters vs. Aliens, an animated 3-D film and enhance scenes such as the collapse of San Francisco's Golden Gate Bridge, said Derek Chen, DreamWorks' head of Digital Operations, at the Red Hat Summit which took place Sept. 1-4.
Cloud computing was key in faster and more cost-effective production, enabling DreamWorks to build capacity for sustained demand vs. peak capacity, reducing compute requirements from 21,000 cores to 16,000 cores, he said. And cloud computing provided greater service elasticity than a server farm, subdividing a film sequence and sending it to 40 cores simultaneously, automating previously manual processes and cutting turnaround time from four hours to just minutes, he said.
"Server farms didn't fit," Chen said. "We needed to change the model and make compute services expand and contract automatically so we didn't waste resources."
Virtualization also helps, enabling DreamWorks to process and isolate each job, measure its consumption of computing resources and check its status, all of which helped to reduce deployment time, he said.
"Red Hat gets it. In kernel virtualization, virtualization management, the application orchestration and cloud abstraction layers, Red Hat get it," Chen said. "Red Hat is giving customers the opportunity to innovate [in different ways] and leverage them where it makes sense."
Moving between private and public clouds
The DreamWorks scenario may be more glitzy than most, but at least some Red Hat Summit attendees could see practical applications beyond Hollywood.
Mike Roberts, a Red Hat Certified Engineer and technical trainer at Rackspace, an IT Web hosting company, said the operational and engineering capabilities Chen described were impressive. Even though all the effort was for movie special effects, DreamWorks' innovations represent big business in entertainment and will certainly trickle down to other applications, he said. The company also seems to have organized its servers tightly to the point of dialing up the compute power they need, he said.
"We don't have any cute movies, but our uptime beats anyone in our industry," Roberts added.
Michael Coté, an analyst with Seattle, Wash.-based Redmonk, said DreamWorks may be in a specialized industry but its challenges -- moving huge sets of data quickly -- are relevant to a large audience. Cloud computing helped DreamWorks repurpose compute nodes more quickly for specific jobs than grids [and, therefore, increased speed], but DreamWorks still had security issues and network bottlenecks over large distances, he said.
Where open source in general and Red Hat in particular are different from proprietary vendors is that they are "brave enough" to talk about their cloud initiatives while they are still in development, involving their customers and the open source community up front, in contrast to proprietary companies that can postpone announcements until products are ready to ship, he said.
Red Hat believes that open source application programming interfaces like the those it is developing will help make public and private clouds more interoperable, but "we'll have to wait and see if Red Hat delivers on its projects," Coté said. "If they can create a quality product for moving between public and private clouds, it would be a lot more affordable [than proprietary software] and would be an interesting business model. Red Hat is pointed in the right direction."
Pam Derringer is a contributor to SearchEnterpriseLinux.com.