Sylabs Unveils SingularityCE 4.0, Bridging HPC Performance with Enterprise Flexibility via OCI Interoperable Containers

September 19, 2023

RENO, Nev., Sept. 19, 2023 — Sylabs, a global leader in providing tools and services for performance-intensive container technology, today announced the release of SingularityCE 4.0. This milestone version establishes a seamless bridge for traditional enterprise container packages adhering to OCI-compliant standards (such as Docker and Podman) to be efficiently integrated and used by Singularity, consolidating the container runtime for diverse use cases in performance-intensive computing environments.

The update also initiates a Container Device Interface enhancement to enable ease of use between containers and GPUs. SingularityCE 4.0 empowers organizations with unparalleled flexibility, native performance, and security for their diverse workloads, whether in the realms of High Performance Computing (HPC), AI, data analytics, or large language models (LLMs).

SingularityCE 4.0 caters to the growing demands of modern enterprise organizations by seamlessly integrating SIF and OCI capabilities, a pivotal advancement that ensures streamlined container workflows across heterogeneous environments. This increased functionality fosters enhanced portability for enterprises requiring the use of advanced containers that can effortlessly traverse diverse computing landscapes while ensuring optimal performance and security.

The SIF Encapsulated OCI Images Support feature introduces a new era of interoperability between OCI containers and the performance advantages of the SIF single-file format. This innovation empowers users with the seamless ease of integrating OCI data and configurations into SIF containers, thereby minimizing the need for complex tooling and bridging the gap between standard OCI runtimes and the stringent security requirements of shared HPC environments. SingularityCE 4.0 bridges advanced container utility for both enterprise settings and the unique demands of performance-intensive ecosystems.

Complementing this horizon-opening integration is the introduction of Container Device Interface (CDI) Support, solidifying Singularity 4.0’s commitment to staying at the forefront of container technology. Collaborating with NVIDIA, CDI Support optimizes GPU integration, a vital aspect of performance-intensive environments such as AI and data analytics. This enhancement further solidifies Singularity as the ultimate solution for enterprises and organizations seeking unmatched performance and flexibility in their container workflows.

Singularity, renowned for its design and features tailored to HPC and scientific workloads, offers a multitude of benefits over traditional OCI container platforms, especially in performance-intensive environments where security and mobility of compute are paramount. Its emphasis on security, resource efficiency, and native performance has made Singularity the top choice for industries such as scientific research, high-performance computing, and AI. This focus on holistic solutions stands in stark contrast to the trend of fragmentary, point-based approaches that merely address isolated needs, ensuring Singularity’s versatility across complex computing ecosystems.

By allowing non-privileged execution, employing a specialized security model, and granting direct access to hardware resources, Singularity elevates the integrity and performance of applications in performance-intensive environments. Its compatibility with parallel file systems, simplified software dependencies, and verified reproducibility further streamline workflows. The transportability of Singularity’s single-file format, SIF, coupled with encryption and decryption features, ensures secure deployment across diverse environments, including edge computing scenarios.

This single file container format not only encapsulates the entire application environment but also preserves its security attributes, eliminating the need for complex, layered architectures and facilitating seamless movement across distributed systems. This architectural simplicity significantly reduces potential vulnerabilities and points of entry, making Singularity an ideal solution for ensuring secure, streamlined, and efficient deployment across diverse computing landscapes.

Organizations that have commenced projects with OCI-compatible containers can find compelling reasons to integrate Singularity. While traditional OCI containers excel in general-purpose settings, Singularity’s tailored features align seamlessly with the unique demands of performance-intensive domains, including serverless computing, containers, AI, ML, and batch pipelines. Features like non-privileged execution, native performance optimization, and compatibility with complex dependencies provide a substantial advantage.

The capability to seamlessly leverage OCI resources via Singularity containers through the OCI-to-SIF conversion process facilitates a fluid integration, allowing customers to consistently integrate these technologies and preserve their investments. This approach minimizes complexities in tooling while harnessing Singularity’s robust security, verified reproducibility, and widespread HPC adoption reinforcing its position as the preferred container solution.

“Singularity 4.0 takes a giant leap by seamlessly integrating SIF Encapsulated OCI Image support, ensuring HPC users benefit from a seamless transition between Singularity’s native runtime and the OCI runtime,” said Adam Hughes, CTO of Sylabs. “Singularity users will immediately notice the smoother experience with OCI images, without sacrificing any of the familiar functionality or performance they are used to. Singularity 4.0 has been meticulously engineered to provide more seamless integration with OCI, ensuring that compatibility doesn’t compromise on the unique features that our users have come to value. This improvement underscores our commitment to user-centric development, always aiming to offer the best experience possible without disrupting existing workflows.”

“Singularity 4.0 embodies our community’s commitment to innovation, catering to the dynamic needs of the HPC and enterprise sectors,” said David Trudgian, Software Engineer at Sylabs and the lead developer within the Singularity ecosystem. “This release shows how we can balance maintaining what users love about Singularity with new features that satisfy the evolving requirements of today’s scientific and machine learning workflows.”

Beyond technical enhancements, Singularity 4.0 also contributes to the FAIR (Findable, Accessible, Interoperable, and Reusable) computational practices, aligning with the principles that facilitate knowledge sharing and discovery. Given Singularity’s origins in scientific computing and performance reproducibility, this alignment promotes innovation in research and enterprise computing landscapes where reproducibility is paramount.

Incorporating community to drive refinements, Singularity 4.0 offers amplified compatibility, adaptive infrastructure, and future-proofing. As a result, Sylabs ensures a robust and refined user experience, reflecting their commitment to continuous improvement. For an in-depth look into Singularity 4.0 and its innovative features, visit https://github.com/sylabs/singularity/releases.

About Sylabs

Sylabs is the global leader in providing professional tools and services for high performance container runtime technology. Sylabs makes high performance computing more accessible to researchers, scientists, and engineers using Singularity, the most advanced open source container runtime technology for performance-intensive applications and environments. As the most active contributor to the Singularity ecosystem, through both the community edition and Sylabs’ enterprise-supported and professional implementations, Sylabs is dedicated to enabling cutting-edge research and facilitating rapid scientific discovery to solve some of humanity’s greatest challenges. For more information about Singularity runtime technology, including SingularityCE (Community Edition), Singularity Container Services, SingularityPRO, and Singularity Enterprise, visit https://www.sylabs.io.


Source: Sylabs

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

HPC User Forum: Sustainability at TACC Points to Software

October 3, 2023

Recently, Dan Stanzione, Executive Director, TACC and Associate Vice President for Research, UT-Austin, gave a presentation on HPC sustainability at the Fall 2023 HPC Users Forum. The complete set of slides is available Read more…

Google’s Controversial AI Chip Paper Under Scrutiny Again 

October 3, 2023

A controversial research paper by Google that claimed the superiority of AI techniques in creating chips is under the microscope for the authenticity of its claims. Science publication Nature is investigating Google's c Read more…

Rust Busting: IBM and Boeing Battle Corrosion with Simulations on Quantum Computer

October 3, 2023

The steady research into developing real-world applications for quantum computing is piling up interesting use cases. Today, IBM reported on work with Boeing to simulate corrosion processes to improve composites used in Read more…

Nvidia Delivering New Options for MLPerf and HPC Performance

September 28, 2023

As HPCwire reported recently, the latest MLperf benchmarks are out. Not unsurprisingly, Nvidia was the leader across many categories. The HGX H100 GPU systems, which contain eight H100 GPUs, delivered the highest throughput on every MLPerf inference test in this round. Read more…

Hakeem Oluseyi Explores His Unlikely Journey from the Street to the Stars in SC23 Keynote

September 28, 2023

Defying the odds In the heart of one of the toughest neighborhoods in the country, young Hakeem Oluseyi’s world was a confined space, but his imagination soared to the stars. While other kids roamed the streets, he Read more…

AWS Solution Channel

Shutterstock 2338659951

VorTech Derisks Innovative Technology to Aid Global Water Sustainability Challenges Using Cloud-Native Simulations on AWS

Overview

No more than 1 percent of the world’s water is readily available fresh water, according to the US Geological Survey. Read more…

QCT Solution Channel

QCT and Intel Codeveloped QCT DevCloud Program to Jumpstart HPC and AI Development

Organizations and developers face a variety of issues in developing and testing HPC and AI applications. Challenges they face can range from simply having access to a wide variety of hardware, frameworks, and toolkits to time spent on installation, development, testing, and troubleshooting which can lead to increases in cost. Read more…

Nvidia Takes Another Shot at Trying to Get AI to Mobile Devices

September 28, 2023

Nvidia takes another shot at trying to get to mobile devices Long before the current situation of Nvidia's GPUs holding AI hostage, the company tried to put its chips in mobile devices but failed. The Tegra mobile chi Read more…

Shutterstock 1927423355

Google’s Controversial AI Chip Paper Under Scrutiny Again 

October 3, 2023

A controversial research paper by Google that claimed the superiority of AI techniques in creating chips is under the microscope for the authenticity of its cla Read more…

Rust Busting: IBM and Boeing Battle Corrosion with Simulations on Quantum Computer

October 3, 2023

The steady research into developing real-world applications for quantum computing is piling up interesting use cases. Today, IBM reported on work with Boeing to Read more…

Nvidia Delivering New Options for MLPerf and HPC Performance

September 28, 2023

As HPCwire reported recently, the latest MLperf benchmarks are out. Not unsurprisingly, Nvidia was the leader across many categories. The HGX H100 GPU systems, which contain eight H100 GPUs, delivered the highest throughput on every MLPerf inference test in this round. Read more…

IonQ Announces 2 New Quantum Systems; Suggests Quantum Advantage is Nearing

September 27, 2023

It’s been a busy week for IonQ, the quantum computing start-up focused on developing trapped-ion-based systems. At the Quantum World Congress today, the compa Read more…

Rethinking ‘Open’ for AI

September 27, 2023

What does “open” mean in the context of AI? Must we accept hidden layers? Do copyrights and patents still hold sway? And do consumers have the right to opt Read more…

Aurora Image

Leveraging Machine Learning in Dark Matter Research for the Aurora Exascale System 

September 25, 2023

Scientists have unlocked many secrets about particle interactions at atomic and subatomic levels. However, one mystery that has eluded researchers is dark matte Read more…

Watsonx Brings AI Visibility to Banking Systems

September 21, 2023

A new set of AI-based code conversion tools is available with IBM watsonx. Before introducing the new "watsonx," let's talk about the previous generation Watson Read more…

Intel’s Gelsinger Lays Out Vision and Map at Innovation 2023 Conference

September 20, 2023

Intel’s sprawling, optimistic vision for the future was on full display yesterday in CEO Pat Gelsinger’s opening keynote at the Intel Innovation 2023 confer Read more…

CORNELL I-WAY DEMONSTRATION PITS PARASITE AGAINST VICTIM

October 6, 1995

Ithaca, NY --Visitors to this year's Supercomputing '95 (SC'95) conference will witness a life-and-death struggle between parasite and victim, using virtual Read more…

SGI POWERS VIRTUAL OPERATING ROOM USED IN SURGEON TRAINING

October 6, 1995

Surgery simulations to date have largely been created through the development of dedicated applications requiring considerable programming and computer graphi Read more…

U.S. Will Relax Export Restrictions on Supercomputers

October 6, 1995

New York, NY -- U.S. President Bill Clinton has announced that he will definitely relax restrictions on exports of high-performance computers, giving a boost Read more…

Dutch HPC Center Will Have 20 GFlop, 76-Node SP2 Online by 1996

October 6, 1995

Amsterdam, the Netherlands -- SARA, (Stichting Academisch Rekencentrum Amsterdam), Academic Computing Services of Amsterdam recently announced that it has pur Read more…

Cray Delivers J916 Compact Supercomputer to Solvay Chemical

October 6, 1995

Eagan, Minn. -- Cray Research Inc. has delivered a Cray J916 low-cost compact supercomputer and Cray's UniChem client/server computational chemistry software Read more…

NEC Laboratory Reviews First Year of Cooperative Projects

October 6, 1995

Sankt Augustin, Germany -- NEC C&C (Computers and Communication) Research Laboratory at the GMD Technopark has wrapped up its first year of operation. Read more…

Sun and Sybase Say SQL Server 11 Benchmarks at 4544.60 tpmC

October 6, 1995

Mountain View, Calif. -- Sun Microsystems, Inc. and Sybase, Inc. recently announced the first benchmark results for SQL Server 11. The result represents a n Read more…

New Study Says Parallel Processing Market Will Reach $14B in 1999

October 6, 1995

Mountain View, Calif. -- A study by the Palo Alto Management Group (PAMG) indicates the market for parallel processing systems will increase at more than 4 Read more…

Leading Solution Providers

Contributors

CORNELL I-WAY DEMONSTRATION PITS PARASITE AGAINST VICTIM

October 6, 1995

Ithaca, NY --Visitors to this year's Supercomputing '95 (SC'95) conference will witness a life-and-death struggle between parasite and victim, using virtual Read more…

SGI POWERS VIRTUAL OPERATING ROOM USED IN SURGEON TRAINING

October 6, 1995

Surgery simulations to date have largely been created through the development of dedicated applications requiring considerable programming and computer graphi Read more…

U.S. Will Relax Export Restrictions on Supercomputers

October 6, 1995

New York, NY -- U.S. President Bill Clinton has announced that he will definitely relax restrictions on exports of high-performance computers, giving a boost Read more…

Dutch HPC Center Will Have 20 GFlop, 76-Node SP2 Online by 1996

October 6, 1995

Amsterdam, the Netherlands -- SARA, (Stichting Academisch Rekencentrum Amsterdam), Academic Computing Services of Amsterdam recently announced that it has pur Read more…

Cray Delivers J916 Compact Supercomputer to Solvay Chemical

October 6, 1995

Eagan, Minn. -- Cray Research Inc. has delivered a Cray J916 low-cost compact supercomputer and Cray's UniChem client/server computational chemistry software Read more…

NEC Laboratory Reviews First Year of Cooperative Projects

October 6, 1995

Sankt Augustin, Germany -- NEC C&C (Computers and Communication) Research Laboratory at the GMD Technopark has wrapped up its first year of operation. Read more…

Sun and Sybase Say SQL Server 11 Benchmarks at 4544.60 tpmC

October 6, 1995

Mountain View, Calif. -- Sun Microsystems, Inc. and Sybase, Inc. recently announced the first benchmark results for SQL Server 11. The result represents a n Read more…

New Study Says Parallel Processing Market Will Reach $14B in 1999

October 6, 1995

Mountain View, Calif. -- A study by the Palo Alto Management Group (PAMG) indicates the market for parallel processing systems will increase at more than 4 Read more…

ISC 2023 Booth Videos

Cornelis Networks @ ISC23
Dell Technologies @ ISC23
Intel @ ISC23
Lenovo @ ISC23
Microsoft @ ISC23
ISC23 Playlist
  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire