Zapata’s Orquestra Targets the Hybrid Quantum-Classical Challenge

By John Russell

July 28, 2022

As it’s become clearer that hybrid quantum-classical computing solutions will likely be necessary to achieve practical quantum computing, there’s been an increasing emphasis on developing software platforms to build hybrid applications and workflows. Nvidia’s recently-announced QODA (quantum optimized device architecture) is among the notable new arrivals. Zapata Computing is one of the early QC software pioneers that has bet on leveraging quantum-enabled hybrid applications using its Orquestra platform to deliver quantum advantage.

Timothy Hirzel, chief evangelist for Orquestra, recently provided HPCwire with a progress update on the heels of Nvidia’s QODA announcement, which named Zapata as an earlier collaborator. (See HPCwire coverage, Nvidia Dives Deeper into Quantum, Announces QODA Programming Platform.)

Nvidia’s intent, of course, is to integrate its GPU accelerator technology with quantum systems for use leveraging hybrid classical-quantum resources. Zapata has a broader aim. Its Orquestra product integrates with tools, such as QODA (when it becomes available), for building and deploying applications that run on a wider variety of hybrid quantum-classical resources. This isn’t a new idea. Agnostiq’s Covalent platform, for example, is similar but aimed at the R&D environment for prototyping and testing. Orquestra, says Hirzel, is aimed squarely at enterprise deployment and production environments.

Don’t get the wrong idea. No one is using Orquestra as a production deployment tool yet, but one collaborator – Andretti Autosport – is in the process of an infrastructure buildout that includes plans for using Orquestra in production. The auto racing powerhouse intends to use Orquestra and blended quantum-classical resources for a variety of applications such as tire degradation models and race simulations to understand the probability of a yellow flag or a caution coming up.

“Some of these models have to be run at the track side and in real-time,” said Hirzel. “Andretti has been a fantastic forcing function on the software, because things that weren’t as critical for an R&D user are now very important.”

Most of Zapata’s early customers are still working in R&D, building out quantum roadmaps and figuring out what high value problems can benefit from quantum resources. That said, the appearance of platforms, such as Orquestra and Covalent and QODA, for developing hybrid-applications and managing hybrid quantum-classical resources is an important trend. The market is still unfolding and will be worth watching. Increasingly it looks like quantum computing will require a blended classical-quantum environment.

Hirzel said, “We see quantum and classical growing together. In no way do we see quantum actually replacing HPC, or classical. As quantum devices grow, as qubit counts grow, and the gate-depth grows, the challenge of compiling circuits is going to grow along with it. In a simple experiment, you could be running millions of shots on a quantum device. You’re going to have to be wielding a substantial amount of classical processing alongside quantum, not just for circuit compilation, but any of the data pre-processing and post-processing.”

Besides these necessary processing tasks, there’s a lot of work underway to understand which portions of applications (optimization, simulations, etc.) are best handled by classical resources and which by quantum. Zapata has long been a champion of this line of thinking. For example, Zapata has worked heavily with quantum-enhanced solvers using machine learning and quantum-generated random numbers to improve performance.

CEO Christopher Savoie told HPCwire a year ago:

  • “Any machine learning basically starts with a generative model, at least in modeling things, a probability distribution that’s made up of a random bit string. You start with a tunable, random bit string to get closer and closer – like a Born machine (quantum circuit born machine, QCBM) – to model the distribution that will give you a certain result. That’s your prior. [Next], you feed a distribution in and hopefully get a better handwriting sample, a better portfolio, a better optimization of something, chemistry, whatever, at the end. That’s the outcome. [To do that] you need a random bit string that has a tunable parameterized connection to it. The distribution of those bit strings is the source of richness in your model. That’s the premise.
  • “What we showed in our papers is if you have a quantum source of bit strings you get a better distribution and a better handwriting sample and a better portfolio optimization than you can with classical machine work. We can do that today. What we’ve done is we’ve taken a quantum-enhanced neural network approach to basically put our quantum spy on that solver. We’re feeding into a classical neural network workflow that already exists and is already in production in a lot of places. The great thing is their cost function, their model, already exists too; we just put a little quantum spy on it. We think it’s pretty clever, and it’s patented, and very disruptive. We’re able to basically model the distribution of the good answers for any software.”

Using quantum-generated random numbers as input to improve classical solvers is just one example and probably represents low-hanging fruit in developing hybrid classical-quantum solutions. But the point is there are going to be more complicated problems, a portion of which is better suited to classical or quantum computation. Nvidia already argues the matrix multiplies, for example, are better handled on GPUs than on QPUs.

Platforms to develop these quantum-enhanced applications and workflows will be required. Enter Orquestra, QODA, Covalent. There will be more such offerings, covering various portions of the required hybrid stack, if you will. Zapata believes it has an advantage because its focus has always been on hybrid approaches.

Looking at the figure above, the areas in solid green represent Zapata proprietary technology, the light green combine Zapata and user-supplied technology, and the gray areas are non-Zapata resources, hardware and software, that Orquestra interacts with. The Orquestra stack works with a variety of popular quantum languages and libraries as well as classical simulators and quantum hardware. The idea is to provide a broadly usable platform leveraging existing and new tools.

Hirzel notes the number of available qubit types (e.g. ion trap, superconducting, etc.) is a moving target and each requires its own lower level protocols and tools. While the number of qubit technologies is currently limited to a handful, that may change. Zapata supports the major qubit technologies now in use and expects to expand support as required.

A core question that platforms for hybrid-dev should help answer, said Hirzel, is which compute engine (classical or particular qubit technology) is better, and why, for a given application including which portion of the application. That’s in addition to developing and executing the workflow.

“The decision of where you want to send your compute job becomes its own challenge. In a smaller way, we see this even today with how organizations are learning to leverage GPUs. This is really where we want Orquestra to live,” said Hirzel. “Stepping back a bit, it’s not just where things are computed. You also need to think about where data is stored; what type of orchestration layer you have sitting on top of that? Are you sending jobs via Slurm to HPC? Is this running on cloud? And the ability to visualize the data that’s coming out of it.”

These are still fairly early days for the platform and users tend to bring a fair amount of expertise. The Quantum-Ready Application functionality, as described by Hirzel, is currently more about taking an existing application and using Orquestra tools to prepare it to run on various resources, including quantum or classical (e.g. GPU) and then running comparison simulations.

Hirzel said, “It’s about building useful tools and this is something that we potentially see our own internal service teams doing. But ultimately, partners can take on writing applications themselves and using Orquestra to deliver applications. It’s not a toolkit for building GUIs and the like, but instead it’s for building the services that support existing end user applications. An end user may have an existing tool –  a tool for computational fluid dynamics used for airplane wing design – and is really looking to accelerate a piece of that tool.”

He says the user can use Orquestra tools to break up the application and simulate various approaches to determine effectiveness among diverse device types. The quantum-enabled version(s) could then be deployed from Orquestra.

Zapata is also working on assembling algorithm suites for various functions and devices. For example, “Our hardware team is working on algorithms to help users select the device that’s most appropriate for that circuit. Ultimately, we’d look to put that into something like a quantum hardware broker.” Users could then provide selection criteria to the broker – availability, cost, fidelity, speed, etc. – and it would provide options.

Don’t underestimate the value of being able to estimating the costs of running a quantum workflow, said Hirzel, “We’ve noticed in our time running these quantum simulations or running on real quantum devices, that it is very easy to run up a big bill quickly. It’s a pain point that a lot of folks either in cloud or HPC experience.” Providing cost comparison for various compute methods during simulation or just before “we see as actually quite integral and can be an exciting feature in Orquestra.”

Orquestra is an early entry to the market for hybrid classical-quantum software development platforms. It is still evolving as is the market segment. Zapata, spun out of Harvard in 2017, has grown rapidly. Headcount is already 100-plus. It’s hoping early mover status and deep technical expertise translates into success. Then again, that sounds like many young companies on the quantum computing landscape. Stay tuned.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

Empowering High-Performance Computing for Artificial Intelligence

April 19, 2024

Artificial intelligence (AI) presents some of the most challenging demands in information technology, especially concerning computing power and data movement. As a result of these challenges, high-performance computing Read more…

Kathy Yelick on Post-Exascale Challenges

April 18, 2024

With the exascale era underway, the HPC community is already turning its attention to zettascale computing, the next of the 1,000-fold performance leaps that have occurred about once a decade. With this in mind, the ISC Read more…

2024 Winter Classic: Texas Two Step

April 18, 2024

Texas Tech University. Their middle name is ‘tech’, so it’s no surprise that they’ve been fielding not one, but two teams in the last three Winter Classic cluster competitions. Their teams, dubbed Matador and Red Read more…

2024 Winter Classic: The Return of Team Fayetteville

April 18, 2024

Hailing from Fayetteville, NC, Fayetteville State University stayed under the radar in their first Winter Classic competition in 2022. Solid students for sure, but not a lot of HPC experience. All good. They didn’t Read more…

Software Specialist Horizon Quantum to Build First-of-a-Kind Hardware Testbed

April 18, 2024

Horizon Quantum Computing, a Singapore-based quantum software start-up, announced today it would build its own testbed of quantum computers, starting with use of Rigetti’s Novera 9-qubit QPU. The approach by a quantum Read more…

2024 Winter Classic: Meet Team Morehouse

April 17, 2024

Morehouse College? The university is well-known for their long list of illustrious graduates, the rigor of their academics, and the quality of the instruction. They were one of the first schools to sign up for the Winter Read more…

Kathy Yelick on Post-Exascale Challenges

April 18, 2024

With the exascale era underway, the HPC community is already turning its attention to zettascale computing, the next of the 1,000-fold performance leaps that ha Read more…

Software Specialist Horizon Quantum to Build First-of-a-Kind Hardware Testbed

April 18, 2024

Horizon Quantum Computing, a Singapore-based quantum software start-up, announced today it would build its own testbed of quantum computers, starting with use o Read more…

MLCommons Launches New AI Safety Benchmark Initiative

April 16, 2024

MLCommons, organizer of the popular MLPerf benchmarking exercises (training and inference), is starting a new effort to benchmark AI Safety, one of the most pre Read more…

Exciting Updates From Stanford HAI’s Seventh Annual AI Index Report

April 15, 2024

As the AI revolution marches on, it is vital to continually reassess how this technology is reshaping our world. To that end, researchers at Stanford’s Instit Read more…

Intel’s Vision Advantage: Chips Are Available Off-the-Shelf

April 11, 2024

The chip market is facing a crisis: chip development is now concentrated in the hands of the few. A confluence of events this week reminded us how few chips Read more…

The VC View: Quantonation’s Deep Dive into Funding Quantum Start-ups

April 11, 2024

Yesterday Quantonation — which promotes itself as a one-of-a-kind venture capital (VC) company specializing in quantum science and deep physics  — announce Read more…

Nvidia’s GTC Is the New Intel IDF

April 9, 2024

After many years, Nvidia's GPU Technology Conference (GTC) was back in person and has become the conference for those who care about semiconductors and AI. I Read more…

Google Announces Homegrown ARM-based CPUs 

April 9, 2024

Google sprang a surprise at the ongoing Google Next Cloud conference by introducing its own ARM-based CPU called Axion, which will be offered to customers in it Read more…

Nvidia H100: Are 550,000 GPUs Enough for This Year?

August 17, 2023

The GPU Squeeze continues to place a premium on Nvidia H100 GPUs. In a recent Financial Times article, Nvidia reports that it expects to ship 550,000 of its lat Read more…

Synopsys Eats Ansys: Does HPC Get Indigestion?

February 8, 2024

Recently, it was announced that Synopsys is buying HPC tool developer Ansys. Started in Pittsburgh, Pa., in 1970 as Swanson Analysis Systems, Inc. (SASI) by John Swanson (and eventually renamed), Ansys serves the CAE (Computer Aided Engineering)/multiphysics engineering simulation market. Read more…

Intel’s Server and PC Chip Development Will Blur After 2025

January 15, 2024

Intel's dealing with much more than chip rivals breathing down its neck; it is simultaneously integrating a bevy of new technologies such as chiplets, artificia Read more…

Choosing the Right GPU for LLM Inference and Training

December 11, 2023

Accelerating the training and inference processes of deep learning models is crucial for unleashing their true potential and NVIDIA GPUs have emerged as a game- Read more…

Baidu Exits Quantum, Closely Following Alibaba’s Earlier Move

January 5, 2024

Reuters reported this week that Baidu, China’s giant e-commerce and services provider, is exiting the quantum computing development arena. Reuters reported � Read more…

Comparing NVIDIA A100 and NVIDIA L40S: Which GPU is Ideal for AI and Graphics-Intensive Workloads?

October 30, 2023

With long lead times for the NVIDIA H100 and A100 GPUs, many organizations are looking at the new NVIDIA L40S GPU, which it’s a new GPU optimized for AI and g Read more…

Shutterstock 1179408610

Google Addresses the Mysteries of Its Hypercomputer 

December 28, 2023

When Google launched its Hypercomputer earlier this month (December 2023), the first reaction was, "Say what?" It turns out that the Hypercomputer is Google's t Read more…

AMD MI3000A

How AMD May Get Across the CUDA Moat

October 5, 2023

When discussing GenAI, the term "GPU" almost always enters the conversation and the topic often moves toward performance and access. Interestingly, the word "GPU" is assumed to mean "Nvidia" products. (As an aside, the popular Nvidia hardware used in GenAI are not technically... Read more…

Leading Solution Providers

Contributors

Shutterstock 1606064203

Meta’s Zuckerberg Puts Its AI Future in the Hands of 600,000 GPUs

January 25, 2024

In under two minutes, Meta's CEO, Mark Zuckerberg, laid out the company's AI plans, which included a plan to build an artificial intelligence system with the eq Read more…

China Is All In on a RISC-V Future

January 8, 2024

The state of RISC-V in China was discussed in a recent report released by the Jamestown Foundation, a Washington, D.C.-based think tank. The report, entitled "E Read more…

Shutterstock 1285747942

AMD’s Horsepower-packed MI300X GPU Beats Nvidia’s Upcoming H200

December 7, 2023

AMD and Nvidia are locked in an AI performance battle – much like the gaming GPU performance clash the companies have waged for decades. AMD has claimed it Read more…

Nvidia’s New Blackwell GPU Can Train AI Models with Trillions of Parameters

March 18, 2024

Nvidia's latest and fastest GPU, codenamed Blackwell, is here and will underpin the company's AI plans this year. The chip offers performance improvements from Read more…

DoD Takes a Long View of Quantum Computing

December 19, 2023

Given the large sums tied to expensive weapon systems – think $100-million-plus per F-35 fighter – it’s easy to forget the U.S. Department of Defense is a Read more…

Eyes on the Quantum Prize – D-Wave Says its Time is Now

January 30, 2024

Early quantum computing pioneer D-Wave again asserted – that at least for D-Wave – the commercial quantum era has begun. Speaking at its first in-person Ana Read more…

GenAI Having Major Impact on Data Culture, Survey Says

February 21, 2024

While 2023 was the year of GenAI, the adoption rates for GenAI did not match expectations. Most organizations are continuing to invest in GenAI but are yet to Read more…

The GenAI Datacenter Squeeze Is Here

February 1, 2024

The immediate effect of the GenAI GPU Squeeze was to reduce availability, either direct purchase or cloud access, increase cost, and push demand through the roof. A secondary issue has been developing over the last several years. Even though your organization secured several racks... Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire