Red Hat Bolsters Partner Ecosystem to Accelerate Data Science Pipelines Across the Open Hybrid Cloud

November 22, 2021

RALEIGH, N.C., Nov. 22, 2021 — Red Hat, Inc., a leading provider of open source solutions, today announced the availability of Red Hat OpenShift Data Science as a field trial, as well as an expanded partner ecosystem focused on this new cloud service offering. As leading artificial intelligence and machine-learning (AI/ML) partners support the service, Red Hat customers are provided with a range of solutions optimized for Red Hat OpenShift, letting them select the technologies to best meet their specific machine learning needs across the open hybrid cloud and edge computing environments.

Red Hat OpenShift Data Science is a cloud service offering tailored for machine learning (ML) on Red Hat OpenShift, the industry’s leading enterprise Kubernetes platform. Enabled by Kubernetes operators, Red Hat OpenShift Data Science gives enterprises greater flexibility in selecting the technologies to develop, test and deploy ML models, while removing the overhead associated with running and maintaining a production platform. As a fully-managed cloud service, Red Hat OpenShift Data Science moves operational responsibility and support to Red Hat. This gives organizations the freedom to use their chosen AI/ML tools in developing the next-generation of intelligent applications to drive valuable business insights.

Several key members of Red Hat’s AI/ML partner ecosystem are now pre-integrated into the user interface dashboard, providing access to the latest in hardware and software acceleration solutions as well as tools to support the model operationalization lifecycle. This includes Intel toolkits and, planned in the near future, NVIDIA-accelerated computing support, which will enable customers to benefit from:

  • Access to a fully-integrated model development environment, with the ability to optimize and tailor model behavior on Intel hardware, using Intel OpenVINO Pro for Enterprise; and accelerated speed to insights with the Intel oneAPI AI Analytics Toolkit, which provides data scientists with a series of tools and frameworks optimized for maximum performance on Intel-based CPUs. With these offerings from Intel, data scientists not only have integrated access to the tools and frameworks needed to build and deploy their model, but also help deliver high performance on Intel hardware.
  • Accelerated computing support through the use of NVIDIA GPU technology, which can enable data scientists to scale their computationally expensive neural networks to large, complex architectures without sacrificing productivity. This allows data scientists to cut down the time spent on training models with minimal code changes.

In addition to Intel and NVIDIA, Red Hat OpenShift Data Science includes support from several other leading AI/ML partners, including:

  • Anaconda Commercial Edition for more secure, consistent and repeatable data science package distribution and management;
  • IBM Watson Studio with AutoAI to build, run, and manage AI models at scale;
  • Seldon Deploy to simplify and accelerate deploying, managing and monitoring machine learning models, and
  • Starburst Galaxy to unlock the value of your data by making it faster and easier to access data across the hybrid cloud.

As enterprises invest in AI/ML to drive business decisions and gain actionable insights from data, we have seen a highly-competitive marketplace for MLOps solutions that strive to operationalize the ML lifecycle. Red Hat OpenShift Data Science offers enterprise customers a customizable alternative to prescriptive AI/ML solutions, through its open workflow platform including Jupyter notebooks and common frameworks including Pytorch and Tensorflow, and complemented by access to certified partner technology from Red Hat Marketplace.

Red Hat OpenShift Data Science is available via field trial today as an add-on to Red Hat OpenShift Dedicated and on Red Hat OpenShift Service on AWS. The field trial release of Red Hat OpenShift Data Science offers general availability-level quality and support, allowing customers to try out the service, while only paying for the underlying Red Hat OpenShift Dedicated or Red Hat OpenShift Service on AWS and AWS infrastructure.

Supporting Quotes

“Data science and machine learning are helping drive innovation and business value in nearly every industry. For many companies the biggest barrier to adoption is the complexity of wiring together the necessary data sources with diverse model training and model deployment technologies. With Red Hat OpenShift Data Science, Red Hat’s contributions to Open Data Hub, and our extensive partner ecosystem, we’re helping organizations overcome such complexity to begin harnessing the full potential of machine learning from the leader in trusted open source technology,” said Mike Piech, vice president and general manager, Cloud Data Services, Red Hat.

“When developing Red Hat OpenShift Data Science, Red Hat recognized the importance of making it easier for organizations to use tools they know and trust. Anaconda is excited to offer Anaconda Commercial Edition as part of the platform so that customers can leverage the innovation of open source packages from a trustworthy, premium repository,” said Stephen Nolan, head of product, Anaconda.

“Leveraging AI to guide business decision-making is more relevant than ever, especially in the scale of enterprise readiness. Red Hat OpenShift Data Science enables data scientists and developers to work in an open and flexible environment and is complemented by Watson Studio from IBM Cloud Pak for Data – an industry-leading offering that accelerates the data science lifecycle at scale. With time and reliability being a valuable resource, IBM Watson Studio infuses AutoAI, which accelerates AI model development through automation, and Trusted AI – offering enterprises trust and transparency so that their models can be governed, accurate, and free of bias. We’re excited to complement IBM’s enterprise-readiness with the open-source capabilities of Red Hat to provide customers a convenient and trusted pathway to their adoption of AI,” said Hemanth Manda, director, Cloud Pak for Data, IBM.

“Red Hat OpenShift Data Science provides a solution to data scientists and developers who want flexibility and control of their resources and data, but no longer want to deal with the complexities of managing infrastructure. That is why Intel is very proud to partner with Red Hat to offer the Intel oneAPI AI Analytics Toolkit and OpenVINO Toolkit as part of this platform,” said Wei Li, vice president and general manager of Artificial Intelligence and Analytics, Intel.

“Data scientists and AI developers require well-integrated tools and powerful computing capabilities to do their best work. NVIDIA and Red Hat’s collaboration to bring accelerated data science to Red Hat OpenShift platforms can enable enterprises to rapidly develop, deploy and scale advanced AI across a broad variety of workloads and industries,” said Scott McClellan, head of data science products, NVIDIA.

“When it comes to enterprise-wide adoption of AI and ML, organisations want the freedom and flexibility to leverage the best tools available – regardless of vendor. Red Hat’s strategy in developing Red Hat OpenShift Data Science reflects this modern approach, and we’re excited to offer Seldon Deploy as a complementary solution to this cloud service. By offering customers the ability to easily deploy, manage, and monitor their ML models, Seldon empowers data scientists and DevOps teams by eliminating the typical bottlenecks and delays associated with moving models into production. Our solution is specifically designed for rapid model deployment in an enterprise environment such as Red Hat OpenShift Data Science, with advanced tools and capabilities surrounding testing, explainability, and lifecycle management,” said Keith Bush, vice president, Alliances, Seldon.

“We’re excited to be one of the key partners featured in Red Hat OpenShift Data Science. Starburst provides a new way to conduct analytics via a single point of data access built to offer greater security, minimizing the requirement to move or copy data in order to analyze it. Together, our technologies provide data scientists with a fully managed, enterprise-grade platform to more seamlessly and quickly build, train, test, and deploy new machine learning models that can enable organizations to make faster and better decisions based on more complete and accurate data,” said Justin Borgman, CEO, co-founder and chairman, Starburst.

“As per the IDC’s AI StrategiesView 2021 study — a global survey of 2,000 organizations, with IT and line-of-business decision makers and influencers as respondents — AI adoption has grown 3X since 2019. Early adopters report 39% improvement in customer experience (CX) and 33% improvement in employee efficiency and accelerated innovation with roll-out of AI solutions in 2020, which is a double-digit surge in improvement of business outcomes compared to 2019. Open source helps companies become co-inventors of software, not just buyers of it. Open source AI has been one of the most important developments within the technology industry, and it is continuing to grow. The Red Hat OpenShift Data Science offering – combined with Red Hat’s open source expertise – will offer customers the tools they need to be successful,” Ritu Jyoti, group vice president, Artificial Intelligence and Automation Research, Software Market Research and Advisory, IDC.

About Red Hat, Inc.

Red Hat is the world’s leading provider of enterprise open source software solutions, using a community-powered approach to deliver reliable and high-performing Linux, hybrid cloud, container, and Kubernetes technologies. Red Hat helps customers integrate new and existing IT applications, develop cloud-native applications, standardize on our industry-leading operating system, and automate, secure, and manage complex environments. Award-winning support, training, and consulting services make Red Hat a trusted adviser to the Fortune 500. As a strategic partner to cloud providers, system integrators, application vendors, customers, and open source communities, Red Hat can help organizations prepare for the digital future.


Source: Red Hat

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

SC21 Was Unlike Any Other — Was That a Good Thing?

December 3, 2021

For a long time, the promised in-person SC21 seemed like an impossible fever dream, the assurances of a prominent physical component persisting across years of canceled conferences, including two virtual ISCs and the virtual SC20. With the advent of the Delta variant, Covid surges in St. Louis and contention over vaccine requirements... Read more…

The Green500’s Crystal Anniversary Sees MN-3 Crystallize Its Winning Streak

December 2, 2021

“This is the 30th Green500,” said Wu Feng, custodian of the Green500 list, at the list’s SC21 birds-of-a-feather session. “You could say 15 years of Green500, which makes it, I guess, the crystal anniversary.” Indeed, HPCwire marked the 15th anniversary of the Green500 – which ranks supercomputers by flops-per-watt, rather than just by flops – earlier this year with... Read more…

AWS Arm-based Graviton3 Instances Now in Preview

December 1, 2021

Three years after unveiling the first generation of its AWS Graviton chip-powered instances in 2018, Amazon Web Services announced that the third generation of the processors – the AWS Graviton3 – will power all-new Amazon Elastic Compute 2 (EC2) C7g instances that are now available in preview. Debuting at the AWS re:Invent 2021... Read more…

Nvidia Dominates Latest MLPerf Results but Competitors Start Speaking Up

December 1, 2021

MLCommons today released its fifth round of MLPerf training benchmark results with Nvidia GPUs again dominating. That said, a few other AI accelerator companies participated and, one of them, Graphcore, even held a separ Read more…

HPC Career Notes: December 2021 Edition

December 1, 2021

In this monthly feature, we’ll keep you up-to-date on the latest career developments for individuals in the high-performance computing community. Whether it’s a promotion, new company hire, or even an accolade, we’ Read more…

AWS Solution Channel

Running a 3.2M vCPU HPC Workload on AWS with YellowDog

Historically, advances in fields such as meteorology, healthcare, and engineering, were achieved through large investments in on-premises computing infrastructure. Upfront capital investment and operational complexity have been the accepted norm of large-scale HPC research. Read more…

At SC21, Experts Ask: Can Fast HPC Be Green?

November 30, 2021

HPC is entering a new era: exascale is (somewhat) officially here, but Moore’s law is ending. Power consumption and other sustainability concerns loom over the enormous systems and chips of this new epoch, for both cost and compliance reasons. Reconciling the need to continue the supercomputer scale-up while reducing HPC’s environmental impacts... Read more…

SC21 Was Unlike Any Other — Was That a Good Thing?

December 3, 2021

For a long time, the promised in-person SC21 seemed like an impossible fever dream, the assurances of a prominent physical component persisting across years of canceled conferences, including two virtual ISCs and the virtual SC20. With the advent of the Delta variant, Covid surges in St. Louis and contention over vaccine requirements... Read more…

The Green500’s Crystal Anniversary Sees MN-3 Crystallize Its Winning Streak

December 2, 2021

“This is the 30th Green500,” said Wu Feng, custodian of the Green500 list, at the list’s SC21 birds-of-a-feather session. “You could say 15 years of Green500, which makes it, I guess, the crystal anniversary.” Indeed, HPCwire marked the 15th anniversary of the Green500 – which ranks supercomputers by flops-per-watt, rather than just by flops – earlier this year with... Read more…

Nvidia Dominates Latest MLPerf Results but Competitors Start Speaking Up

December 1, 2021

MLCommons today released its fifth round of MLPerf training benchmark results with Nvidia GPUs again dominating. That said, a few other AI accelerator companies Read more…

At SC21, Experts Ask: Can Fast HPC Be Green?

November 30, 2021

HPC is entering a new era: exascale is (somewhat) officially here, but Moore’s law is ending. Power consumption and other sustainability concerns loom over the enormous systems and chips of this new epoch, for both cost and compliance reasons. Reconciling the need to continue the supercomputer scale-up while reducing HPC’s environmental impacts... Read more…

Raja Koduri and Satoshi Matsuoka Discuss the Future of HPC at SC21

November 29, 2021

HPCwire's Managing Editor sits down with Intel's Raja Koduri and Riken's Satoshi Matsuoka in St. Louis for an off-the-cuff conversation about their SC21 experience, what comes after exascale and why they are collaborating. Koduri, senior vice president and general manager of Intel's accelerated computing systems and graphics (AXG) group, leads the team... Read more…

Jack Dongarra on SC21, the Top500 and His Retirement Plans

November 29, 2021

HPCwire's Managing Editor sits down with Jack Dongarra, Top500 co-founder and Distinguished Professor at the University of Tennessee, during SC21 in St. Louis to discuss the 2021 Top500 list, the outlook for global exascale computing, and what exactly is going on in that Viking helmet photo. Read more…

SC21: Larry Smarr on The Rise of Supernetwork Data Intensive Computing

November 26, 2021

Larry Smarr, founding director of Calit2 (now Distinguished Professor Emeritus at the University of California San Diego) and the first director of NCSA, is one of the seminal figures in the U.S. supercomputing community. What began as a personal drive, shared by others, to spur the creation of supercomputers in the U.S. for scientific use, later expanded into a... Read more…

Three Chinese Exascale Systems Detailed at SC21: Two Operational and One Delayed

November 24, 2021

Details about two previously rumored Chinese exascale systems came to light during last week’s SC21 proceedings. Asked about these systems during the Top500 media briefing on Monday, Nov. 15, list author and co-founder Jack Dongarra indicated he was aware of some very impressive results, but withheld comment when asked directly if he had... Read more…

IonQ Is First Quantum Startup to Go Public; Will It be First to Deliver Profits?

November 3, 2021

On October 1 of this year, IonQ became the first pure-play quantum computing start-up to go public. At this writing, the stock (NYSE: IONQ) was around $15 and its market capitalization was roughly $2.89 billion. Co-founder and chief scientist Chris Monroe says it was fun to have a few of the company’s roughly 100 employees travel to New York to ring the opening bell of the New York Stock... Read more…

Enter Dojo: Tesla Reveals Design for Modular Supercomputer & D1 Chip

August 20, 2021

Two months ago, Tesla revealed a massive GPU cluster that it said was “roughly the number five supercomputer in the world,” and which was just a precursor to Tesla’s real supercomputing moonshot: the long-rumored, little-detailed Dojo system. Read more…

Esperanto, Silicon in Hand, Champions the Efficiency of Its 1,092-Core RISC-V Chip

August 27, 2021

Esperanto Technologies made waves last December when it announced ET-SoC-1, a new RISC-V-based chip aimed at machine learning that packed nearly 1,100 cores onto a package small enough to fit six times over on a single PCIe card. Now, Esperanto is back, silicon in-hand and taking aim... Read more…

US Closes in on Exascale: Frontier Installation Is Underway

September 29, 2021

At the Advanced Scientific Computing Advisory Committee (ASCAC) meeting, held by Zoom this week (Sept. 29-30), it was revealed that the Frontier supercomputer is currently being installed at Oak Ridge National Laboratory in Oak Ridge, Tenn. The staff at the Oak Ridge Leadership... Read more…

AMD Launches Milan-X CPU with 3D V-Cache and Multichip Instinct MI200 GPU

November 8, 2021

At a virtual event this morning, AMD CEO Lisa Su unveiled the company’s latest and much-anticipated server products: the new Milan-X CPU, which leverages AMD’s new 3D V-Cache technology; and its new Instinct MI200 GPU, which provides up to 220 compute units across two Infinity Fabric-connected dies, delivering an astounding 47.9 peak double-precision teraflops. “We're in a high-performance computing megacycle, driven by the growing need to deploy additional compute performance... Read more…

Intel Reorgs HPC Group, Creates Two ‘Super Compute’ Groups

October 15, 2021

Following on changes made in June that moved Intel’s HPC unit out of the Data Platform Group and into the newly created Accelerated Computing Systems and Graphics (AXG) business unit, led by Raja Koduri, Intel is making further updates to the HPC group and announcing... Read more…

Intel Completes LLVM Adoption; Will End Updates to Classic C/C++ Compilers in Future

August 10, 2021

Intel reported in a blog this week that its adoption of the open source LLVM architecture for Intel’s C/C++ compiler is complete. The transition is part of In Read more…

Killer Instinct: AMD’s Multi-Chip MI200 GPU Readies for a Major Global Debut

October 21, 2021

AMD’s next-generation supercomputer GPU is on its way – and by all appearances, it’s about to make a name for itself. The AMD Radeon Instinct MI200 GPU (a successor to the MI100) will, over the next year, begin to power three massive systems on three continents: the United States’ exascale Frontier system; the European Union’s pre-exascale LUMI system; and Australia’s petascale Setonix system. Read more…

Leading Solution Providers

Contributors

Hot Chips: Here Come the DPUs and IPUs from Arm, Nvidia and Intel

August 25, 2021

The emergence of data processing units (DPU) and infrastructure processing units (IPU) as potentially important pieces in cloud and datacenter architectures was Read more…

D-Wave Embraces Gate-Based Quantum Computing; Charts Path Forward

October 21, 2021

Earlier this month D-Wave Systems, the quantum computing pioneer that has long championed quantum annealing-based quantum computing (and sometimes taken heat fo Read more…

The Latest MLPerf Inference Results: Nvidia GPUs Hold Sway but Here Come CPUs and Intel

September 22, 2021

The latest round of MLPerf inference benchmark (v 1.1) results was released today and Nvidia again dominated, sweeping the top spots in the closed (apples-to-ap Read more…

HPE Wins $2B GreenLake HPC-as-a-Service Deal with NSA

September 1, 2021

In the heated, oft-contentious, government IT space, HPE has won a massive $2 billion contract to provide HPC and AI services to the United States’ National Security Agency (NSA). Following on the heels of the now-canceled $10 billion JEDI contract (reissued as JWCC) and a $10 billion... Read more…

Ahead of ‘Dojo,’ Tesla Reveals Its Massive Precursor Supercomputer

June 22, 2021

In spring 2019, Tesla made cryptic reference to a project called Dojo, a “super-powerful training computer” for video data processing. Then, in summer 2020, Tesla CEO Elon Musk tweeted: “Tesla is developing a [neural network] training computer... Read more…

Three Chinese Exascale Systems Detailed at SC21: Two Operational and One Delayed

November 24, 2021

Details about two previously rumored Chinese exascale systems came to light during last week’s SC21 proceedings. Asked about these systems during the Top500 media briefing on Monday, Nov. 15, list author and co-founder Jack Dongarra indicated he was aware of some very impressive results, but withheld comment when asked directly if he had... Read more…

2021 Gordon Bell Prize Goes to Exascale-Powered Quantum Supremacy Challenge

November 18, 2021

Today at the hybrid virtual/in-person SC21 conference, the organizers announced the winners of the 2021 ACM Gordon Bell Prize: a team of Chinese researchers leveraging the new exascale Sunway system to simulate quantum circuits. The Gordon Bell Prize, which comes with an award of $10,000 courtesy of HPC pioneer Gordon Bell, is awarded annually... Read more…

Quantum Computer Market Headed to $830M in 2024

September 13, 2021

What is one to make of the quantum computing market? Energized (lots of funding) but still chaotic and advancing in unpredictable ways (e.g. competing qubit tec Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire