Microsoft Bing Maps takes the fast route to image processing efficiency with Dell solutions

By Nicole Hemsoth

December 12, 2011

Bing ImageAt Microsoft® Bing™ Maps, technology imitates art. The Bing Imagery Technologies team takes diverse satellite, aerial, bird’s eye, and street-side imagery and stitch them together to form visual mosaics for Bing Maps.

Given its compute- and data-intensive mission, and the huge scale of its operations, the team requires enormous amounts of processing power, data storage capacity, and memory. It measures its storage needs in petabytes, its memory needs in terabytes, and its processing needs in tens of thousands of cores. At the same time, the team must work continuously to drive down the cost of processing this data.

When it came time to launch a new imagery-processing site at the edge of the Colorado Rockies, the Bing Imagery Technologies team (BITs) studied its options carefully. It wanted to find a no-frills data center infrastructure that was highly efficient, highly reliable, extremely scalable, and quick to deploy. It found its answer in Dell™ Modular Data Centers, which are helping the team build a highly efficient, state of the art imagery processing microsite.

The route to the Modular Data Center

The team’s road to a more efficient microsite began when the organization was making plans to move its legacy containerized data-processing infrastructure to a new site that could accommodate additional capacity and ongoing growth.

The team found a workable, eight-acre patch of ground in Longmont, Colorado, northwest of Denver. The requirements for the microsite were aggressive. Bing Maps needed an extremely cost-effective, highly efficient solution to power high-performance compute-and storage-intensive geospatial applications running a customized parallel processing system built on Windows Server 2008 and SQL Server 2008. The solution needed to be up to the challenges that come with processing and storing terabytes of data on an hourly basis.

“We produce hundreds of terabytes each day,” notes Ryan Tracy, IT operations lead for Bing Imagery Technologies. “We generate about ten terabytes per hour. Our record is three petabytes in four days. So we have a significant amount of processing going on.”

The requirements didn’t stop there. The team needed a modular solution that could be quickly deployed to add capacity to support growth and new partner needs. In addition to creating imagery for Bing Maps, the organization produces geospatial imagery for various strategic partners.

On the power and cooling front, the team wanted a modular solution that could make maximum use of free air cooling to capitalize on Colorado’s climate. What’s more, it wanted to achieve an extremely low power usage effectiveness (PUE) ratio—a key measure of data center energy efficiency.

Technology at Work

  • Dell Modular Data Centers
  • AMD®-based Dell Nucleon servers
  • InfiBand networking from Mellanox®
  • Infrastructure Consulting Services
  • Custom Services and Integration
  • Deployment

Choosing the Dell solution

Bing Maps personnel talked to multiple vendors before settling on Dell. At a product level, they liked the modularity, superior PUE, low overall power utilization, and high density of the Dell Modular Data Center, according to Clark. At an engineering level, they were impressed with the expertise of the Dell Data Center Solutions team who designed the Modular Data Center and customized the solution, tailoring it to the needs of Bing Maps.

“Dell had a solution that was designed for high efficiency, density, and low cost,” Clark says. “Their container allowed us to have a flexible IT unit, which gave us room to customize or modify to meet our needs. It was a clean and simple solution, and it was obvious that we were not going to be paying for items within the solution that we didn’t need.”

The Dell DCS engineers on the project went to great lengths to accommodate the specific needs of Bing Maps and the custom geospatial applications it runs, Clark says. For example, they changed the server design to meet the unique storage and I/O needs of the BITs processing environment and they integrated InfiniBand networking infrastructure into the solution.

“Dell closely partnered with us for the duration of the project on all aspects,” he says. “We really challenged everything to keep costs low. The Dell guys were cut from the same cloth. We just made sure that everything that was needed was really needed. Dell realized that we were unorthodox, and they were willing to jump in with us.”

Fast deployment speed

Rapid deployment was another over-arching need for the team. The organization wanted the ability to bring on new IT capacity quickly to support new products, new partnerships, and ongoing growth.

In its Longmont experience, the team learned that it can now have a microsite up and running within 60 days, assuming all government permits are in place, according to Clark.

“We have the design now, and it can be put anywhere, as long as you can find land that is relatively flat and has power and networking,” he says. “We now have a reference site, we have the design, and we have a great partner in Dell that can produce the IT gear and the containers in the time-frame that we put in place. And we’ve proven that we can turn those containers on in three weeks, from dropping them from a truck to turning them live. So everything’s up and running within 60 days. That’s a pretty amazing feat.”

“In working with Dell, we were able to build a microsite that’s cost-effective, reliable, agile, and rugged, that could be located in extreme environments within various countries around the globe,” he notes.

‘Better all the way around’

“When I first looked at the design of the Dell Modular Data Center, I saw that it’s very clean and it’s very elegant,” Clark says. “It’s very well thought-out. And when you get inside the container, it’s very quiet.”

The quiet environment is made possible by the Dell Modular Data Center’s use of a central fan system that cools the environment, rather than fans in each of the servers.

“I thought that was a smart and clever approach,” Clark says of the central fan. “And having the evaporative cooling system in a dry climate like the Colorado Front Range is perfect. It makes sense. It drives lower operating costs. It’s just better all the way around.”

Ultimately, “better all the way around” describes the feeling of the Bing Maps’ team when it comes to working with the Dell Data Center Solutions team to design and deploy Modular Data Centers at the Bing Maps Imagery microsite in Colorado.

“They had the best solution and the best team, which was well aligned with our site philosophy,” Clark says. “The whole Dell team was just fantastic on all fronts.”

 

Watch the time-lapse video of the site being built!

Read more in the case study.

Watch a quick walkthrough video on a Dell Modular Data Center.

See what it’s like to work with the Dell Data Center Solutions team.
 

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

MLPerf Inference 4.0 Results Showcase GenAI; Nvidia Still Dominates

March 28, 2024

There were no startling surprises in the latest MLPerf Inference benchmark (4.0) results released yesterday. Two new workloads — Llama 2 and Stable Diffusion XL — were added to the benchmark suite as MLPerf continues Read more…

Q&A with Nvidia’s Chief of DGX Systems on the DGX-GB200 Rack-scale System

March 27, 2024

Pictures of Nvidia's new flagship mega-server, the DGX GB200, on the GTC show floor got favorable reactions on social media for the sheer amount of computing power it brings to artificial intelligence.  Nvidia's DGX Read more…

Call for Participation in Workshop on Potential NSF CISE Quantum Initiative

March 26, 2024

Editor’s Note: Next month there will be a workshop to discuss what a quantum initiative led by NSF’s Computer, Information Science and Engineering (CISE) directorate could entail. The details are posted below in a Ca Read more…

Waseda U. Researchers Reports New Quantum Algorithm for Speeding Optimization

March 25, 2024

Optimization problems cover a wide range of applications and are often cited as good candidates for quantum computing. However, the execution time for constrained combinatorial optimization applications on quantum device Read more…

NVLink: Faster Interconnects and Switches to Help Relieve Data Bottlenecks

March 25, 2024

Nvidia’s new Blackwell architecture may have stolen the show this week at the GPU Technology Conference in San Jose, California. But an emerging bottleneck at the network layer threatens to make bigger and brawnier pro Read more…

Who is David Blackwell?

March 22, 2024

During GTC24, co-founder and president of NVIDIA Jensen Huang unveiled the Blackwell GPU. This GPU itself is heavily optimized for AI work, boasting 192GB of HBM3E memory as well as the the ability to train 1 trillion pa Read more…

MLPerf Inference 4.0 Results Showcase GenAI; Nvidia Still Dominates

March 28, 2024

There were no startling surprises in the latest MLPerf Inference benchmark (4.0) results released yesterday. Two new workloads — Llama 2 and Stable Diffusion Read more…

Q&A with Nvidia’s Chief of DGX Systems on the DGX-GB200 Rack-scale System

March 27, 2024

Pictures of Nvidia's new flagship mega-server, the DGX GB200, on the GTC show floor got favorable reactions on social media for the sheer amount of computing po Read more…

NVLink: Faster Interconnects and Switches to Help Relieve Data Bottlenecks

March 25, 2024

Nvidia’s new Blackwell architecture may have stolen the show this week at the GPU Technology Conference in San Jose, California. But an emerging bottleneck at Read more…

Who is David Blackwell?

March 22, 2024

During GTC24, co-founder and president of NVIDIA Jensen Huang unveiled the Blackwell GPU. This GPU itself is heavily optimized for AI work, boasting 192GB of HB Read more…

Nvidia Looks to Accelerate GenAI Adoption with NIM

March 19, 2024

Today at the GPU Technology Conference, Nvidia launched a new offering aimed at helping customers quickly deploy their generative AI applications in a secure, s Read more…

The Generative AI Future Is Now, Nvidia’s Huang Says

March 19, 2024

We are in the early days of a transformative shift in how business gets done thanks to the advent of generative AI, according to Nvidia CEO and cofounder Jensen Read more…

Nvidia’s New Blackwell GPU Can Train AI Models with Trillions of Parameters

March 18, 2024

Nvidia's latest and fastest GPU, codenamed Blackwell, is here and will underpin the company's AI plans this year. The chip offers performance improvements from Read more…

Nvidia Showcases Quantum Cloud, Expanding Quantum Portfolio at GTC24

March 18, 2024

Nvidia’s barrage of quantum news at GTC24 this week includes new products, signature collaborations, and a new Nvidia Quantum Cloud for quantum developers. Wh Read more…

Alibaba Shuts Down its Quantum Computing Effort

November 30, 2023

In case you missed it, China’s e-commerce giant Alibaba has shut down its quantum computing research effort. It’s not entirely clear what drove the change. Read more…

Nvidia H100: Are 550,000 GPUs Enough for This Year?

August 17, 2023

The GPU Squeeze continues to place a premium on Nvidia H100 GPUs. In a recent Financial Times article, Nvidia reports that it expects to ship 550,000 of its lat Read more…

Shutterstock 1285747942

AMD’s Horsepower-packed MI300X GPU Beats Nvidia’s Upcoming H200

December 7, 2023

AMD and Nvidia are locked in an AI performance battle – much like the gaming GPU performance clash the companies have waged for decades. AMD has claimed it Read more…

DoD Takes a Long View of Quantum Computing

December 19, 2023

Given the large sums tied to expensive weapon systems – think $100-million-plus per F-35 fighter – it’s easy to forget the U.S. Department of Defense is a Read more…

Synopsys Eats Ansys: Does HPC Get Indigestion?

February 8, 2024

Recently, it was announced that Synopsys is buying HPC tool developer Ansys. Started in Pittsburgh, Pa., in 1970 as Swanson Analysis Systems, Inc. (SASI) by John Swanson (and eventually renamed), Ansys serves the CAE (Computer Aided Engineering)/multiphysics engineering simulation market. Read more…

Choosing the Right GPU for LLM Inference and Training

December 11, 2023

Accelerating the training and inference processes of deep learning models is crucial for unleashing their true potential and NVIDIA GPUs have emerged as a game- Read more…

Intel’s Server and PC Chip Development Will Blur After 2025

January 15, 2024

Intel's dealing with much more than chip rivals breathing down its neck; it is simultaneously integrating a bevy of new technologies such as chiplets, artificia Read more…

Baidu Exits Quantum, Closely Following Alibaba’s Earlier Move

January 5, 2024

Reuters reported this week that Baidu, China’s giant e-commerce and services provider, is exiting the quantum computing development arena. Reuters reported � Read more…

Leading Solution Providers

Contributors

Comparing NVIDIA A100 and NVIDIA L40S: Which GPU is Ideal for AI and Graphics-Intensive Workloads?

October 30, 2023

With long lead times for the NVIDIA H100 and A100 GPUs, many organizations are looking at the new NVIDIA L40S GPU, which it’s a new GPU optimized for AI and g Read more…

Shutterstock 1179408610

Google Addresses the Mysteries of Its Hypercomputer 

December 28, 2023

When Google launched its Hypercomputer earlier this month (December 2023), the first reaction was, "Say what?" It turns out that the Hypercomputer is Google's t Read more…

AMD MI3000A

How AMD May Get Across the CUDA Moat

October 5, 2023

When discussing GenAI, the term "GPU" almost always enters the conversation and the topic often moves toward performance and access. Interestingly, the word "GPU" is assumed to mean "Nvidia" products. (As an aside, the popular Nvidia hardware used in GenAI are not technically... Read more…

Shutterstock 1606064203

Meta’s Zuckerberg Puts Its AI Future in the Hands of 600,000 GPUs

January 25, 2024

In under two minutes, Meta's CEO, Mark Zuckerberg, laid out the company's AI plans, which included a plan to build an artificial intelligence system with the eq Read more…

Google Introduces ‘Hypercomputer’ to Its AI Infrastructure

December 11, 2023

Google ran out of monikers to describe its new AI system released on December 7. Supercomputer perhaps wasn't an apt description, so it settled on Hypercomputer Read more…

China Is All In on a RISC-V Future

January 8, 2024

The state of RISC-V in China was discussed in a recent report released by the Jamestown Foundation, a Washington, D.C.-based think tank. The report, entitled "E Read more…

Intel Won’t Have a Xeon Max Chip with New Emerald Rapids CPU

December 14, 2023

As expected, Intel officially announced its 5th generation Xeon server chips codenamed Emerald Rapids at an event in New York City, where the focus was really o Read more…

IBM Quantum Summit: Two New QPUs, Upgraded Qiskit, 10-year Roadmap and More

December 4, 2023

IBM kicks off its annual Quantum Summit today and will announce a broad range of advances including its much-anticipated 1121-qubit Condor QPU, a smaller 133-qu Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire