InfiniteIO Platform Reduces Latency and Accelerates Performance for Machine Learning, AI and Analytics

November 19, 2019

AUSTIN, Nov. 19, 2019 — InfiniteIO, the world’s fastest metadata platform to reduce application latency, today announced the new Application Accelerator, which delivers dramatic performance improvements for critical applications by processing file metadata independently from on-premises storage or cloud systems. The new platform provides organizations across industries the lowest possible latency for their mission-critical applications, such as AI/machine learning, HPC and genomics, while minimizing disruption to IT teams.

“Bandwidth and I/O challenges have been largely overcome, yet reducing latency remains a significant barrier to improving application performance,” said Henry Baltazar, vice president of research at 451 Research. “Metadata requests are a large part of file system latency, making up the vast majority of requests to a storage system or cloud. InfiniteIO’s approach to abstracting metadata from file data offers IT managers a nondisruptive way to immediately accelerate application performance.”

As unstructured data has grown exponentially, requests for file metadata—information such as file attributes and access privileges—have also skyrocketed to become a major bottleneck for application performance. InfiniteIO’s latest release, built on the InfiniteIO Metadata Engine (IME) architecture, responds to file metadata requests directly from the network instead of the network-attached storage (NAS) or cloud storage system. InfiniteIO’s metadata abstraction can reduce latency from seconds to microseconds for all files in a hybrid cloud environment. This results in faster access to data and speeds up application performance.

“Reducing latency is the last frontier in improving application performance. The tech industry has been focused on making incremental performance improvements with faster storage and file systems, when the biggest opportunity is in removing the file system latency created by processing metadata requests,” said Mark Cree, CEO of InfiniteIO. “Separating metadata processing from file I/O significantly decreases application latency, which translates into reduced product development cycles and greater worker productivity.”

Turbocharging Data-intensive Applications

The Application Accelerator allows organizations to go faster and easily implement innovation, with minimal to no disruption to existing IT operations:

  • Completely offloads and responds to metadata requests at the speed of DRAM, which improves performance up to 50% for workloads such as machine learning training models
  • Delivers more than 3 million metadata operations per second, doubling the performance of the previous-generation product
  • Deploys without requiring changes to existing applications or storage systems
  • Supports enterprise growth by scaling to 1 billion files in a single node or 2 billion files in a clustered configuration
  • Enhances the performance of all NAS systems, even all-flash and NVMe arrays
  • Can be upgraded with high-performance data tiering capabilities

InfiniteIO today also released new software features that continue to simplify and accelerate tiering of cold data from primary NAS systems to lower-cost cloud storage, such as the ability to scan 1 billion files in a day and a new API for cloud usage charge-back. The IME architecture never recalls metadata back from the cloud, increasing performance and avoiding cloud egress charges. Robust policies automatically tier files so that even rarely accessed information is available on-demand, without disruption or performance compromises.

Exhibiting at SC19

Attendees of the Supercomputing 19 show in Denver can meet InfiniteIO application acceleration experts in the Startup Café inside the exhibit hall from Nov. 18 to 21, 2019. Find more information and book a meeting at https://infinite.io/supercomputing.

Availability

  • The InfiniteIO Application Accelerator is available immediately from InfiniteIO’s growing network of international resellers and solution providers.
  • Existing customers with current maintenance agreements can add the new high-performance data tiering features with non-disruptive online upgrades.

About InfiniteIO

InfiniteIO provides the lowest possible latency for file metadata, enabling applications to run faster, reduce development cycles, and increase data productivity. Based in Austin, Texas, InfiniteIO independently processes file metadata to simultaneously accelerate application performance and hybrid-cloud data tiering for global enterprises, research organizations and media companies. Learn more at www.infinite.io.


Source: InfiniteIO

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

HPC Career Notes: April 2023 Edition

April 1, 2023

In this monthly feature, we’ll keep you up-to-date on the latest career developments for individuals in the high-performance computing community. Whether it’s a promotion, new company hire, or even an accolade, we’ Read more…

Q&A with Dorian C. Arnold, SC23 General Chair, and an HPCwire Person to Watch in 2023

March 31, 2023

SC23 General Chair Dorian C. Arnold is enthusiastic about this year's conference, which will take place Nov. 12-17 in Denver, Colo. Our exclusive interview with Arnold covers his history with the annual event, what's in store for attendees, and his insights into the HPC landscape writ large. In addition to his work with SC, Arnold is also... Read more…

Intel Issues Roadmap Update, Aims for ‘Scheduled Predictability’

March 30, 2023

Intel held an investor webinar yesterday, with the chip giant working to project consistency and confidence amid slipping roadmaps and market share. At the event, Intel primarily focused on where it stands with four (!) Read more…

Intel’s Server Chips Are ‘Lead Vehicles’ for Manufacturing Strategy

March 30, 2023

…But chipmaker still does not have an integrated product strategy, which puts the company behind AMD and Nvidia. Intel finally has a full complement of server and PC chips it will release in the coming years, which will determine whether it has regained its leadership in chip manufacturing. The chipmaker this week... Read more…

JPMorgan Chase, QC Ware Report Progress in Quantum DL for Deep Hedging

March 30, 2023

Hedging is, of course, a ubiquitous practice in FS and there are well-developed classical computational approaches for implementing this risk mitigation strategy. The challenge has been the computational cost and time-to Read more…

AWS Solution Channel

Shutterstock 531739477

Checkpointing HPC applications using the Spot Instance two-minute notification from Amazon EC2

Amazon Elastic Compute Cloud (Amazon EC2) offers a wide-range of compute instances at different price points, all designed to match different customer’s needs. You can further optimize cost by choosing Reserved Instances (RIs) and even Spot Instances. Read more…

 

Get the latest on AI innovation at NVIDIA GTC

Join Microsoft at NVIDIA GTC, a free online global technology conference, March 20 – 23 to learn how organizations of any size can power AI innovation with purpose-built cloud infrastructure from Microsoft. Read more…

Destination Earth Takes Form as EuroHPC’s Flagship Workload

March 30, 2023

When the EuroHPC Summit was held last week in Gothenburg, there was a distinct shift in tone for the maturing supercomputing play. With LUMI and Leonardo – plus four other petascale systems – already operational, the Read more…

Intel Issues Roadmap Update, Aims for ‘Scheduled Predictability’

March 30, 2023

Intel held an investor webinar yesterday, with the chip giant working to project consistency and confidence amid slipping roadmaps and market share. At the even Read more…

Intel’s Server Chips Are ‘Lead Vehicles’ for Manufacturing Strategy

March 30, 2023

…But chipmaker still does not have an integrated product strategy, which puts the company behind AMD and Nvidia. Intel finally has a full complement of server and PC chips it will release in the coming years, which will determine whether it has regained its leadership in chip manufacturing. The chipmaker this week... Read more…

Destination Earth Takes Form as EuroHPC’s Flagship Workload

March 30, 2023

When the EuroHPC Summit was held last week in Gothenburg, there was a distinct shift in tone for the maturing supercomputing play. With LUMI and Leonardo – pl Read more…

What’s Stirring in Nvidia’s R&D Lab? Chief Scientist Bill Dally Provides a Peek

March 28, 2023

In what’s become a regular GPU Technology Conference feature, Bill Dally, Nvidia chief scientist and SVP of research, provides a glimpse into how Nvidia organ Read more…

Cost-effective Fork of GPT-3 Released to Scientists

March 28, 2023

Researchers looking to create a foundation for a ChatGPT-style application now have an affordable way to do so. Cerebras is releasing open-source learning models for researchers with the ingredients necessary to cook up their own ChatGPT-AI applications. The open-source tools include seven models that form a learning... Read more…

Pegasus ‘Big Memory’ Supercomputer Now Deployed at the University of Tsukuba

March 25, 2023

In the bevy of news from Nvidia's GPU Technology Conference this week, another new system has come to light: Pegasus, which entered operations at the University Read more…

EuroHPC Summit: Tackling Exascale, Energy, Industry & Sovereignty

March 24, 2023

As the 2023 EuroHPC Summit opened in Gothenburg on Monday, Herbert Zeisel – chair of EuroHPC’s Governing Board – commented that the undertaking had “lef Read more…

Nvidia Doubling Down on China Market in the Face of Tightened US Export Controls

March 23, 2023

Chipmakers are tightlipped on China activities following a U.S. crackdown on hardware exports to the country. But Nvidia remains unfazed, and is doubling down o Read more…

CORNELL I-WAY DEMONSTRATION PITS PARASITE AGAINST VICTIM

October 6, 1995

Ithaca, NY --Visitors to this year's Supercomputing '95 (SC'95) conference will witness a life-and-death struggle between parasite and victim, using virtual Read more…

SGI POWERS VIRTUAL OPERATING ROOM USED IN SURGEON TRAINING

October 6, 1995

Surgery simulations to date have largely been created through the development of dedicated applications requiring considerable programming and computer graphi Read more…

U.S. Will Relax Export Restrictions on Supercomputers

October 6, 1995

New York, NY -- U.S. President Bill Clinton has announced that he will definitely relax restrictions on exports of high-performance computers, giving a boost Read more…

Dutch HPC Center Will Have 20 GFlop, 76-Node SP2 Online by 1996

October 6, 1995

Amsterdam, the Netherlands -- SARA, (Stichting Academisch Rekencentrum Amsterdam), Academic Computing Services of Amsterdam recently announced that it has pur Read more…

Cray Delivers J916 Compact Supercomputer to Solvay Chemical

October 6, 1995

Eagan, Minn. -- Cray Research Inc. has delivered a Cray J916 low-cost compact supercomputer and Cray's UniChem client/server computational chemistry software Read more…

NEC Laboratory Reviews First Year of Cooperative Projects

October 6, 1995

Sankt Augustin, Germany -- NEC C&C (Computers and Communication) Research Laboratory at the GMD Technopark has wrapped up its first year of operation. Read more…

Sun and Sybase Say SQL Server 11 Benchmarks at 4544.60 tpmC

October 6, 1995

Mountain View, Calif. -- Sun Microsystems, Inc. and Sybase, Inc. recently announced the first benchmark results for SQL Server 11. The result represents a n Read more…

New Study Says Parallel Processing Market Will Reach $14B in 1999

October 6, 1995

Mountain View, Calif. -- A study by the Palo Alto Management Group (PAMG) indicates the market for parallel processing systems will increase at more than 4 Read more…

Leading Solution Providers

Contributors

CORNELL I-WAY DEMONSTRATION PITS PARASITE AGAINST VICTIM

October 6, 1995

Ithaca, NY --Visitors to this year's Supercomputing '95 (SC'95) conference will witness a life-and-death struggle between parasite and victim, using virtual Read more…

SGI POWERS VIRTUAL OPERATING ROOM USED IN SURGEON TRAINING

October 6, 1995

Surgery simulations to date have largely been created through the development of dedicated applications requiring considerable programming and computer graphi Read more…

U.S. Will Relax Export Restrictions on Supercomputers

October 6, 1995

New York, NY -- U.S. President Bill Clinton has announced that he will definitely relax restrictions on exports of high-performance computers, giving a boost Read more…

Dutch HPC Center Will Have 20 GFlop, 76-Node SP2 Online by 1996

October 6, 1995

Amsterdam, the Netherlands -- SARA, (Stichting Academisch Rekencentrum Amsterdam), Academic Computing Services of Amsterdam recently announced that it has pur Read more…

Cray Delivers J916 Compact Supercomputer to Solvay Chemical

October 6, 1995

Eagan, Minn. -- Cray Research Inc. has delivered a Cray J916 low-cost compact supercomputer and Cray's UniChem client/server computational chemistry software Read more…

NEC Laboratory Reviews First Year of Cooperative Projects

October 6, 1995

Sankt Augustin, Germany -- NEC C&C (Computers and Communication) Research Laboratory at the GMD Technopark has wrapped up its first year of operation. Read more…

Sun and Sybase Say SQL Server 11 Benchmarks at 4544.60 tpmC

October 6, 1995

Mountain View, Calif. -- Sun Microsystems, Inc. and Sybase, Inc. recently announced the first benchmark results for SQL Server 11. The result represents a n Read more…

New Study Says Parallel Processing Market Will Reach $14B in 1999

October 6, 1995

Mountain View, Calif. -- A study by the Palo Alto Management Group (PAMG) indicates the market for parallel processing systems will increase at more than 4 Read more…

SC22 Booth Videos

AMD @ SC22
Altair @ SC22
AWS @ SC22
Ayar Labs @ SC22
CoolIT @ SC22
Cornelis Networks @ SC22
DDN @ SC22
Dell Technologies @ SC22
HPE @ SC22
Intel @ SC22
Intelligent Light @ SC22
Lancium @ SC22
Lenovo @ SC22
Microsoft and NVIDIA @ SC22
One Stop Systems @ SC22
Penguin Solutions @ SC22
QCT @ SC22
Supermicro @ SC22
Tuxera @ SC22
Tyan Computer @ SC22
  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire