SGI Solutions Help Power The Lord Of The Rings

January 10, 2003

NEWS BRIEFS

While the Ring may have the power to move heaven and hell and corrupt even the purest hobbit’s heart, Weta Digital summoned up a different kind of power — the visual supercomputing and asset management power of SGI — to deliver the much-anticipated second film in The Lord of the Rings trilogy, The Two Towers. This film adaptation of the epic fantasy-adventure classic written by J.R.R. Tolkien has even more special effects, CGI-created creatures and horrific battle scenes with hundreds of thousands of animated characters than The Fellowship of the Ring, its blockbuster predecessor.

Weta Digital continues to rely on the same full complement of SGI IRIX OS- based Silicon Graphics Octane visual workstations, Silicon Graphics Onyx2 visualization systems, SGI Origin family servers, and SGI Linux OS-based visual workstations and servers as on the first film. For The Two Towers, Weta Digital, the digital effects arm of Weta Ltd., the Wellington, New Zealand, production company that shot all three films back-to-back, upgraded its SGI Origin 2000 server to handle twice the data load of the first film. Released by New Line Cinema last December, The Fellowship of the Ring has grossed over $860 million worldwide, earned 13 Academy Award nominations and won four Oscar statuettes. New Line released The Two Towers in the United States on Dec. 18, 2002 (which has earned over $261 million to date), and has slated the third film, The Return of the King, for a December 2003 release.

Key to producing the entire The Lord of the Rings film trilogy, directed by Peter Jackson, is the premier SGI solution for hierarchical storage management, the SGI Data Migration Facility (DMF), which allows high- performance, reliable and efficient data management with virtually unlimited storage capability while also dramatically lowering total cost of ownership by moving data seamlessly between high-performance storage arrays and lower-cost- per-megabyte tape libraries. On The Fellowship of the Ring, Weta Digital first used SGI DMF to manage 100TB of data from approximately 10 million files, which range from small to extremely large. A file can consist of an element, a texture, one version of a shot or a completely rendered image sequence. Adding the data from The Two Towers doubles Weta’s information storage to 20 million files. Approximately 230TB, representing the first two films’ worth of data, is now managed by SGI DMF.

“We rely heavily on DMF,” said Scott Houston, chief technical officer, Weta Digital. “DMF is running on one Origin 2000 system and we recently upgraded it to 12 400 MHz processors. The key objective is to free up as much disk space for the artists as possible. We use SGI DMF to offline the data from the online disk storage to tape storage. The StorageTek L700E robotic library now has six LTO (Linear Tape Open) drives and four DLT drives. In June, we migrated from DLT to LTO, which gave us greater capacity on the tape cartridges and faster tape cartridges. That gave us more capacity on near- line; we went from about 25TB available to about 75TB potentially available. We’re able to move data from very valuable online disk storage to near-line disk storage and still be able to retrieve it relatively quickly and seamlessly, from the artists’ point of view.”

One of the many challenges Weta Digital faced at the start of The Two Towers was that it needed to bring back 100,000 files from the first film from offline storage to online storage in order to make those elements, textures and shots available for the artists. Again, the totally automated DMF made that relatively painless for the artists, according to Houston. “The 300 artists working on the second film were moving 1TB of data in and out of DMF every day. Being able to migrate the data seamlessly between online and near- line and then back again has been absolutely critical. We couldn’t do that without SGI DMF,” said Houston. “We need to have access to all the files, including files that are two, three, four or almost five years old, and we need to be able to have access to these as well. We keep everything, and keeping and managing that is going to be a challenge. There are also opportunities for repurposing some of those assets, and that will be essential for Weta in the future.”

Weta Ltd. has already begun repurposing its assets stored by SGI: The Two Towers video game was released a month before the film, and Weta is currently working with Electronic Arts on an action game based on the next film, The Return of the King.

“Weta Digital’s workflow for The Two Towers exemplifies the explosion of data management necessary in the creative side of the film industry. Increasingly complex data management issues in the digital content creation and cinema mastering aspects of the business expand the need for more powerful tools to manage that data,” said Louise Ledeen, director of production, Media Industries, SGI. “The choice of SGI DMF on the highly scalable SGI Origin server family has allowed Weta Digital to meet the challenges of the trilogy’s movie release schedule and deliver what is sure to be another Academy Award- nominated blockbuster film with groundbreaking visual effects also created, in part, on Silicon Graphics equipment.”

About SGI

SGI, also known as Silicon Graphics, Inc., is the world’s leader in high- performance computing, visualization and the management of complex data. SGI products, services and solutions enable its technical and creative customers to gain strategic and competitive advantages in their core businesses. Whether being used to design and build safer cars and airplanes, discover new medications and oil reserves, predict the weather, entertain us with thrilling movie special effects or provide mission-critical support for government and defense, SGI systems and expertise are empowering a world of innovation and discovery. The company, located on the Web at http://www.sgi.com, is headquartered in Mountain View, Calif., and has offices worldwide.

About Weta Digital

Weta Digital Ltd. is Australasia’s premier digital visual effects studio, with established pipelines encompassing all aspects of modern digital effects production. Core competencies include CG creature design, animation, environments, crowd generation and control, digital compositing, and film scanning and recording. The facility is based in Wellington, New Zealand. Contact Jamie Selkirk at +64.4.380.9080. The company’s Web site is http://www.wetadigital.com

============================================================

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

MLPerf Inference 4.0 Results Showcase GenAI; Nvidia Still Dominates

March 28, 2024

There were no startling surprises in the latest MLPerf Inference benchmark (4.0) results released yesterday. Two new workloads — Llama 2 and Stable Diffusion XL — were added to the benchmark suite as MLPerf continues Read more…

Q&A with Nvidia’s Chief of DGX Systems on the DGX-GB200 Rack-scale System

March 27, 2024

Pictures of Nvidia's new flagship mega-server, the DGX GB200, on the GTC show floor got favorable reactions on social media for the sheer amount of computing power it brings to artificial intelligence.  Nvidia's DGX Read more…

Call for Participation in Workshop on Potential NSF CISE Quantum Initiative

March 26, 2024

Editor’s Note: Next month there will be a workshop to discuss what a quantum initiative led by NSF’s Computer, Information Science and Engineering (CISE) directorate could entail. The details are posted below in a Ca Read more…

Waseda U. Researchers Reports New Quantum Algorithm for Speeding Optimization

March 25, 2024

Optimization problems cover a wide range of applications and are often cited as good candidates for quantum computing. However, the execution time for constrained combinatorial optimization applications on quantum device Read more…

NVLink: Faster Interconnects and Switches to Help Relieve Data Bottlenecks

March 25, 2024

Nvidia’s new Blackwell architecture may have stolen the show this week at the GPU Technology Conference in San Jose, California. But an emerging bottleneck at the network layer threatens to make bigger and brawnier pro Read more…

Who is David Blackwell?

March 22, 2024

During GTC24, co-founder and president of NVIDIA Jensen Huang unveiled the Blackwell GPU. This GPU itself is heavily optimized for AI work, boasting 192GB of HBM3E memory as well as the the ability to train 1 trillion pa Read more…

MLPerf Inference 4.0 Results Showcase GenAI; Nvidia Still Dominates

March 28, 2024

There were no startling surprises in the latest MLPerf Inference benchmark (4.0) results released yesterday. Two new workloads — Llama 2 and Stable Diffusion Read more…

Q&A with Nvidia’s Chief of DGX Systems on the DGX-GB200 Rack-scale System

March 27, 2024

Pictures of Nvidia's new flagship mega-server, the DGX GB200, on the GTC show floor got favorable reactions on social media for the sheer amount of computing po Read more…

NVLink: Faster Interconnects and Switches to Help Relieve Data Bottlenecks

March 25, 2024

Nvidia’s new Blackwell architecture may have stolen the show this week at the GPU Technology Conference in San Jose, California. But an emerging bottleneck at Read more…

Who is David Blackwell?

March 22, 2024

During GTC24, co-founder and president of NVIDIA Jensen Huang unveiled the Blackwell GPU. This GPU itself is heavily optimized for AI work, boasting 192GB of HB Read more…

Nvidia Looks to Accelerate GenAI Adoption with NIM

March 19, 2024

Today at the GPU Technology Conference, Nvidia launched a new offering aimed at helping customers quickly deploy their generative AI applications in a secure, s Read more…

The Generative AI Future Is Now, Nvidia’s Huang Says

March 19, 2024

We are in the early days of a transformative shift in how business gets done thanks to the advent of generative AI, according to Nvidia CEO and cofounder Jensen Read more…

Nvidia’s New Blackwell GPU Can Train AI Models with Trillions of Parameters

March 18, 2024

Nvidia's latest and fastest GPU, codenamed Blackwell, is here and will underpin the company's AI plans this year. The chip offers performance improvements from Read more…

Nvidia Showcases Quantum Cloud, Expanding Quantum Portfolio at GTC24

March 18, 2024

Nvidia’s barrage of quantum news at GTC24 this week includes new products, signature collaborations, and a new Nvidia Quantum Cloud for quantum developers. Wh Read more…

Alibaba Shuts Down its Quantum Computing Effort

November 30, 2023

In case you missed it, China’s e-commerce giant Alibaba has shut down its quantum computing research effort. It’s not entirely clear what drove the change. Read more…

Nvidia H100: Are 550,000 GPUs Enough for This Year?

August 17, 2023

The GPU Squeeze continues to place a premium on Nvidia H100 GPUs. In a recent Financial Times article, Nvidia reports that it expects to ship 550,000 of its lat Read more…

Shutterstock 1285747942

AMD’s Horsepower-packed MI300X GPU Beats Nvidia’s Upcoming H200

December 7, 2023

AMD and Nvidia are locked in an AI performance battle – much like the gaming GPU performance clash the companies have waged for decades. AMD has claimed it Read more…

DoD Takes a Long View of Quantum Computing

December 19, 2023

Given the large sums tied to expensive weapon systems – think $100-million-plus per F-35 fighter – it’s easy to forget the U.S. Department of Defense is a Read more…

Synopsys Eats Ansys: Does HPC Get Indigestion?

February 8, 2024

Recently, it was announced that Synopsys is buying HPC tool developer Ansys. Started in Pittsburgh, Pa., in 1970 as Swanson Analysis Systems, Inc. (SASI) by John Swanson (and eventually renamed), Ansys serves the CAE (Computer Aided Engineering)/multiphysics engineering simulation market. Read more…

Choosing the Right GPU for LLM Inference and Training

December 11, 2023

Accelerating the training and inference processes of deep learning models is crucial for unleashing their true potential and NVIDIA GPUs have emerged as a game- Read more…

Intel’s Server and PC Chip Development Will Blur After 2025

January 15, 2024

Intel's dealing with much more than chip rivals breathing down its neck; it is simultaneously integrating a bevy of new technologies such as chiplets, artificia Read more…

Baidu Exits Quantum, Closely Following Alibaba’s Earlier Move

January 5, 2024

Reuters reported this week that Baidu, China’s giant e-commerce and services provider, is exiting the quantum computing development arena. Reuters reported � Read more…

Leading Solution Providers

Contributors

Comparing NVIDIA A100 and NVIDIA L40S: Which GPU is Ideal for AI and Graphics-Intensive Workloads?

October 30, 2023

With long lead times for the NVIDIA H100 and A100 GPUs, many organizations are looking at the new NVIDIA L40S GPU, which it’s a new GPU optimized for AI and g Read more…

Shutterstock 1179408610

Google Addresses the Mysteries of Its Hypercomputer 

December 28, 2023

When Google launched its Hypercomputer earlier this month (December 2023), the first reaction was, "Say what?" It turns out that the Hypercomputer is Google's t Read more…

AMD MI3000A

How AMD May Get Across the CUDA Moat

October 5, 2023

When discussing GenAI, the term "GPU" almost always enters the conversation and the topic often moves toward performance and access. Interestingly, the word "GPU" is assumed to mean "Nvidia" products. (As an aside, the popular Nvidia hardware used in GenAI are not technically... Read more…

Shutterstock 1606064203

Meta’s Zuckerberg Puts Its AI Future in the Hands of 600,000 GPUs

January 25, 2024

In under two minutes, Meta's CEO, Mark Zuckerberg, laid out the company's AI plans, which included a plan to build an artificial intelligence system with the eq Read more…

Google Introduces ‘Hypercomputer’ to Its AI Infrastructure

December 11, 2023

Google ran out of monikers to describe its new AI system released on December 7. Supercomputer perhaps wasn't an apt description, so it settled on Hypercomputer Read more…

China Is All In on a RISC-V Future

January 8, 2024

The state of RISC-V in China was discussed in a recent report released by the Jamestown Foundation, a Washington, D.C.-based think tank. The report, entitled "E Read more…

Intel Won’t Have a Xeon Max Chip with New Emerald Rapids CPU

December 14, 2023

As expected, Intel officially announced its 5th generation Xeon server chips codenamed Emerald Rapids at an event in New York City, where the focus was really o Read more…

IBM Quantum Summit: Two New QPUs, Upgraded Qiskit, 10-year Roadmap and More

December 4, 2023

IBM kicks off its annual Quantum Summit today and will announce a broad range of advances including its much-anticipated 1121-qubit Condor QPU, a smaller 133-qu Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire