Perspectives on HPC and the SC Series of Conferences

By Tiffany Trader (HPC)

November 12, 2008

Once a year, the leading experts from the world of high performance computing gather at SC to assess the current state of HPC and to look ahead to what the future holds. These are the people creating the technologies that will shape our lives. This year, as the conference celebrates an amazing 20 years, several industry thought leaders and long-time attendees reflect on what is most important to them.

Dan Reed, Director of Scalable and Multicore Computing Strategy at Microsoft

The SC conference continues to grow in scale, scope and variety, with a diverse set of workshops, plenary speakers, technical program sessions and, of course, the massive exhibit floor. In addition to the public program, there are a seemingly endless series of sidebar meetings and lots of technical socializing. Take advantage of the fact that you can talk to almost anyone connected to highperformance computing during the conference, but remember that you can overdo it and never be seen at any of the official venues!

Undoubtedly, one of the great hallway discussion topics will be the effect of the economic downturn on HPC research, infrastructure acquisitions and vendor finances. It is quite possible that some startups and smaller companies may not survive. For those in the U.S., the Presidential transition and the implications for research funding will also be hot topics.

Finally, I suspect two other discussions will center on the relationship between academic Grids and commercial clouds and the relationship between trans-petascale (exascale) options and the design of extremely large data centers. The latter is deeply connected to ecofriendly computing system design and energy efficiency. Answers these questions will affect the future of large-scale computing, our research investments, user communities and the types of applications we can support efficiently.

Remember — bring your running shoes. Your feet will thank you later.

Pete Ungaro, President and CEO of Cray Inc.

Without a doubt, SC is the most important conference of the year for our community. This year marks the 20th anniversary of the conference but even more interesting is that this year’s event will officially kick off the start of a new era in HPC — the petascale era.

There will be a lot going on at the conference around petascale computing — vendors and customers highlighting their capabilities as well as end-users contemplating what will now be possible with this new-found power. A related and important theme will be green computing, especially how can petascale systems be built in a way that minimizes their impact on the environment. Cray, of course, is no exception — we are very excited about bringing petascale computing to our customers through our scalable system designs and innovative power and cooling technologies. We believe that the petascale era promises to enable significant technological breakthroughs as scientists and engineers are able to tackle larger problems with higher fidelity.

Be sure to take a few minutes to stop by our booth to see how we’re tackling the petascale challenge as well as bringing Cray supercomputing technology to individual users. Have a great conference!

Debra Goldfarb, President and CEO of Tabor Communications

Being an industry observer, I have seen a lot of change. Undoubtedly, we are entering an exciting innovation cycle in terms of technology, usage models and access. This year I have a few “rules of the road” which will guide my week in Austin:

Spend time on the periphery. there is a lot of interesting stuff to see which is not in the main hall, but rather in the small booths which sit out on the edges. This is where you can often get a window into “what’s next.” I will be looking for technology which enables productivity such as: appliances (application as well as infrastructure); development tools; application frameworks; energy efficiency concepts; and more adaptive access models (such as cloud or other webservice models).

Explore “Edge” HPC. Tabor Research is researching the use of HPC technologies and concepts outside of science and engineering. These include virtual worlds, ultra-scale infrastructure (such as search), complex event processing, and business optimization (such as real-time data mining). My goal is to better understand requirements, application evolution, and most importantly, what is in the “envelope” and what falls out.

The politics of science. Timing is everything and given the recent (and quite extraordinary) change in administration, it will be fascinating to get a read on what this means to this community. And, by the way, it should mean a lot in terms of priorities — in science, technology, industry and education.

Jack Dongarra, Distinguished Professor of EECS at the University of Tennessee

I have attended all of the SC meetings, and won’t miss it for the world; it represents “Homecoming Week” for High Performance Computing.

This is truly an awesome time for high performance computing and computational science research, with a number of systems achieved performance exceeding the PFlop/s mark. There are a number of interesting problems that will need to be overcome as we are faced with systems with greater than a million threads of execution. Advancing to the next stage of growth for computational simulation and modeling will require us to solve basic research problems in Computer Science and Applied Mathematics at the same time as we create and promulgate a new paradigm for the development of scientific software.

To make progress on both fronts simultaneously will require a level of sustained, interdisciplinary collaboration among the core research communities that, in the past, has only been achieved by forming and supporting research centers dedicated to such a common purpose.

I see five important areas that will need attention; effective use of manycore and hybrid architectures, exploiting mixed precision in the algorithms, self adapting and auto tuning of software, fault tolerant algorithms, and communication avoiding algorithms.

William Feiereisen, Director DoD High Performance Computing, Lockheed Martin

I have attended most of the Supercomputing conferences since the 1980s. They always been one of the central opportunities to gather with virtually the entire scientific computing community and to see the latest developments in the spectrum of technologies that interact to make the field of supercomputing.

All of this is available in one place each year, everything from the applications and the important problems that they solve to the latest hardware upon which they run. There is a flavor of computational sciences which has always been my motivation and excitement about the field, but I also confess to not being immune to the latest raw hardware speed breakthroughs presented by each of the manufacturers.

I always plan my week around three things: the technical sessions and tutorials; the exhibits on the show floor; and increasingly in recent years, everyone else who attends and the possibility of much personal interaction. When I started my career, the technical sessions and tutorials dominated my time at SC, however I find much rewarding time is now spent in conversation over convention center coffee. Over the years I believe that many connections and ideas have been hatched at SC in just this way. There is a critical mass that gathers here each year and supports this atmosphere.

It’s for these reasons that I keep coming back each year and I look forward again this year to spending the week in Austin.

Marc Snir, Co-director, Universal Parallel Computing Research Center, University of Illinois

Moore’s law does not mean, anymore, ever increasing processor performance; instead, it now means an ever increasing number of processors on a chip. Just waiting for processor performance to catch up to your needs is not an option, anymore; the only way to increase application performance, is to parallelize the application and scale it to an increasing number of processors.

This is a major new challenge. On the positive side, parallel programming is moving from being an esoteric art practiced by few experts into a a mainstream occupation. It becomes a major concern of large companies, such as Microsoft and Intel (see, for example, their investment in the Universal Parallel Computing Research Centers at Illinois and Berkeley).

This is an opportunity for the HPC community: Rather than building support for parallelism on top of sequential languages and programming environments, it becomes now possible to scaleup languages and environments that are build up-front to support parallelism and that are supported by massive investments.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

Quantum Software Specialist Q-CTRL Inks Deals with IBM, Rigetti, Oxford, and Diraq

September 10, 2024

Q-CTRL, the Australia-based start-up focusing on quantum infrastructure software, today announced that its performance-management software, Fire Opal, will be natively integrated into four of the world's most advanced qu Read more…

Computing-Driven Medicine: Sleeping Better with HPC

September 10, 2024

As a senior undergraduate student at Fisk University in Nashville, Tenn., Ifrah Khurram's calculus professor, Dr. Sanjukta Hota, encouraged her to apply for the Sustainable Research Pathways Program (SRP). SRP was create Read more…

LLNL Engineers Harness Machine Learning to Unlock New Possibilities in Lattice Structures

September 9, 2024

Lattice structures, characterized by their complex patterns and hierarchical designs, offer immense potential across various industries, including automotive, aerospace, and biomedical engineering. With their outstand Read more…

NSF-Funded Data Fabric Takes Flight

September 5, 2024

The data fabric has emerged as an enterprise data management pattern for companies that struggle to provide large teams of users with access to well-managed, integrated, and secured data. Now scientists working at univer Read more…

xAI Colossus: The Elon Project

September 5, 2024

Elon Musk's xAI cluster, named Colossus (possibly after the 1970 movie about a massive computer that does not end well), has been brought online. Musk recently posted the following on X/Twitter: "This weekend, the @xA Read more…

Researchers Benchmark Nvidia’s GH200 Supercomputing Chips

September 4, 2024

Nvidia is putting its GH200 chips in European supercomputers, and researchers are getting their hands on those systems and releasing research papers with performance benchmarks. In the first paper, Understanding Data Mov Read more…

Quantum Software Specialist Q-CTRL Inks Deals with IBM, Rigetti, Oxford, and Diraq

September 10, 2024

Q-CTRL, the Australia-based start-up focusing on quantum infrastructure software, today announced that its performance-management software, Fire Opal, will be n Read more…

NSF-Funded Data Fabric Takes Flight

September 5, 2024

The data fabric has emerged as an enterprise data management pattern for companies that struggle to provide large teams of users with access to well-managed, in Read more…

Shutterstock 1024337068

Researchers Benchmark Nvidia’s GH200 Supercomputing Chips

September 4, 2024

Nvidia is putting its GH200 chips in European supercomputers, and researchers are getting their hands on those systems and releasing research papers with perfor Read more…

Shutterstock 1897494979

What’s New with Chapel? Nine Questions for the Development Team

September 4, 2024

HPC news headlines often highlight the latest hardware speeds and feeds. While advances on the hardware front are important, improving the ability to write soft Read more…

Critics Slam Government on Compute Speeds in Regulations

September 3, 2024

Critics are accusing the U.S. and state governments of overreaching by including limits on compute speeds in regulations and laws, which they claim will limit i Read more…

Shutterstock 1622080153

AWS Perfects Cloud Service for Supercomputing Customers

August 29, 2024

Amazon's AWS believes it has finally created a cloud service that will break through with HPC and supercomputing customers. The cloud provider a Read more…

HPC Debrief: James Walker CEO of NANO Nuclear Energy on Powering Datacenters

August 27, 2024

Welcome to The HPC Debrief where we interview industry leaders that are shaping the future of HPC. As the growth of AI continues, finding power for data centers Read more…

CEO Q&A: Acceleration is Quantinuum’s New Mantra for Success

August 27, 2024

At the Quantum World Congress (QWC) in mid-September, trapped ion quantum computing pioneer Quantinuum will unveil more about its expanding roadmap. Its current Read more…

Everyone Except Nvidia Forms Ultra Accelerator Link (UALink) Consortium

May 30, 2024

Consider the GPU. An island of SIMD greatness that makes light work of matrix math. Originally designed to rapidly paint dots on a computer monitor, it was then Read more…

Atos Outlines Plans to Get Acquired, and a Path Forward

May 21, 2024

Atos – via its subsidiary Eviden – is the second major supercomputer maker outside of HPE, while others have largely dropped out. The lack of integrators and Atos' financial turmoil have the HPC market worried. If Atos goes under, HPE will be the only major option for building large-scale systems. Read more…

AMD Clears Up Messy GPU Roadmap, Upgrades Chips Annually

June 3, 2024

In the world of AI, there's a desperate search for an alternative to Nvidia's GPUs, and AMD is stepping up to the plate. AMD detailed its updated GPU roadmap, w Read more…

Nvidia Shipped 3.76 Million Data-center GPUs in 2023, According to Study

June 10, 2024

Nvidia had an explosive 2023 in data-center GPU shipments, which totaled roughly 3.76 million units, according to a study conducted by semiconductor analyst fir Read more…

Shutterstock_1687123447

Nvidia Economics: Make $5-$7 for Every $1 Spent on GPUs

June 30, 2024

Nvidia is saying that companies could make $5 to $7 for every $1 invested in GPUs over a four-year period. Customers are investing billions in new Nvidia hardwa Read more…

Comparing NVIDIA A100 and NVIDIA L40S: Which GPU is Ideal for AI and Graphics-Intensive Workloads?

October 30, 2023

With long lead times for the NVIDIA H100 and A100 GPUs, many organizations are looking at the new NVIDIA L40S GPU, which it’s a new GPU optimized for AI and g Read more…

Google Announces Sixth-generation AI Chip, a TPU Called Trillium

May 17, 2024

On Tuesday May 14th, Google announced its sixth-generation TPU (tensor processing unit) called Trillium.  The chip, essentially a TPU v6, is the company's l Read more…

Shutterstock 1024337068

Researchers Benchmark Nvidia’s GH200 Supercomputing Chips

September 4, 2024

Nvidia is putting its GH200 chips in European supercomputers, and researchers are getting their hands on those systems and releasing research papers with perfor Read more…

Leading Solution Providers

Contributors

IonQ Plots Path to Commercial (Quantum) Advantage

July 2, 2024

IonQ, the trapped ion quantum computing specialist, delivered a progress report last week firming up 2024/25 product goals and reviewing its technology roadmap. Read more…

Intel’s Next-gen Falcon Shores Coming Out in Late 2025 

April 30, 2024

It's a long wait for customers hanging on for Intel's next-generation GPU, Falcon Shores, which will be released in late 2025.  "Then we have a rich, a very Read more…

Some Reasons Why Aurora Didn’t Take First Place in the Top500 List

May 15, 2024

The makers of the Aurora supercomputer, which is housed at the Argonne National Laboratory, gave some reasons why the system didn't make the top spot on the Top Read more…

Department of Justice Begins Antitrust Probe into Nvidia

August 9, 2024

After months of skyrocketing stock prices and unhinged optimism, Nvidia has run into a few snags – a  design flaw in one of its new chips and an antitrust pr Read more…

Nvidia H100: Are 550,000 GPUs Enough for This Year?

August 17, 2023

The GPU Squeeze continues to place a premium on Nvidia H100 GPUs. In a recent Financial Times article, Nvidia reports that it expects to ship 550,000 of its lat Read more…

MLPerf Training 4.0 – Nvidia Still King; Power and LLM Fine Tuning Added

June 12, 2024

There are really two stories packaged in the most recent MLPerf  Training 4.0 results, released today. The first, of course, is the results. Nvidia (currently Read more…

Spelunking the HPC and AI GPU Software Stacks

June 21, 2024

As AI continues to reach into every domain of life, the question remains as to what kind of software these tools will run on. The choice in software stacks – Read more…

Quantum Watchers – Terrific Interview with Caltech’s John Preskill by CERN

July 17, 2024

In case you missed it, there's a fascinating interview with John Preskill, the prominent Caltech physicist and pioneering quantum computing researcher that was Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire