SAN JOSE, Calif., Oct. 4, 2019 – Excelero, a disruptor in software-defined block storage, today announced that was assigned US patent #10,372,374 – its fourth US patent – governing an approach that better addresses the “tail latency” experienced by large-scale private cloud operators with demanding application workloads. Excelero’s intellectual property (IP) for tail latency reduction can enable developers building solutions for AI, ML, analytics and database applications to achieve better storage efficiency and performance from shared NVMe Flash resources across an enterprise.
AI, ML, analytics and database applications often experience tail latency, where the slowest overall I/O transaction determines completion time and can cause unacceptably slow response times and stall the completion of vital tasks if left unmitigated. With projections that AI applications alone will grow 20× by 2025, tail latency will become increasingly problematic and potentially drag down performance across the enterprise. Recent SNIA and the NVMe Express standards define approaches to I/O determinism that are suitable for most application workloads, including predictable latency mode, NVM sets and local modes, but today’s new scale-out architectures demand faster options.
Excelero’s patent governs a mechanism to set a timeout for an I/O operation when invoking it. It allows product engineers to determine that a specific read transaction on an NVMe drive that will have a hard time finishing quickly, and mark it to “fail fast.” Once tagged, if the drive determines that it cannot fulfill the request in the required time, the drive can notify the requestor and enable it to choose to take a different action, such as reading the data from an alternative location, or storing it elsewhere without delay.
A concept that evolved from Excelero’s extensive experience in web-scale shared NVMe deployments, Excelero’s “fail fast” tag option can help enable large private cloud operators to build scale-out networks that even out latency enterprise wide, even as highly demanding, ultra-low latency workloads proliferate.
“The industry needs a better answer to the tail latency issue, where entire workflows can get hung up by the slowest element’s completion time,” said Yaniv Romem, CTO and co-founder of Excelero. “With this and the 11 other patents we have pending, Excelero is advancing our ability to keep latency low across the board, and help customers squeeze more from their storage architectures – and budgets.”
Excelero delivers low-latency distributed block storage for hyperscale applications such as AI, machine learning and GPU computing, in the Cloud and on the Edge. Founded in 2014 by a team of storage veterans and inspired by the Tech Giants’ shared-nothing architectures for web-scale applications, the company has designed a software-defined block storage solution that meets the low-latency performance and scalability requirements of the largest web-scale and enterprise applications.