Aspera to Showcase Data Transfer Innovations for HPC at SC15

ARMONK, N.Y., Nov. 17 — Aspera, an IBM company and creator of technologies that move the world’s data at maximum speed, will showcase several innovations to allow massive data movement between high-performance computing applications at SC15 (booth #286). These include record-breaking global WAN file transfer speeds of up to 100Gbps, auto scaling for clustered transfers for cloud and HPC, ultra-high-speed global file sharing, and data ingest for HPC analytics. SC15, the International Conference for High Performance Computing, Networking, Storage and Analysis, takes place on November 16-19 in Austin, Texas.

The ability to connect high-performance computing locations with extreme high-speed data transfer capabilities on commodity hardware demonstrates the potential for any organization working with large data sets to accelerate big data research and collaboration while also reducing data center costs.

Aspera will be demonstrating a next generation FASP prototype capable of up to 100Gbps file transfers developed through research collaboration with Intel leveraging Data Direct I/O Technology (Intel DDIO) and Single-Root I/O Virtualization (SR-IOV) and Intel Data Plane Development Kit. Aspera FASP has no theoretical throughput limit and is only constrained by the available network bandwidth and the hardware resources at both ends of the transfers.

Aspera will also demonstrate new cluster transfer capabilities designed for public cloud and high-performance computing applications: large files and directories are transferred by a single transfer session divided over multiple virtual hosts to move data between remote compute clusters and cloud storage at 10 Gigabits per second and higher. The capability includes Aspera’s new Auto-scale technology allowing for dynamic, real-time scaling of transfer capacity with automatic start/stop of transfer server instances, automatic balancing of client requests across available instances, and configurable service levels to manage maximum transfer load per instance, available idle instances for “burst”, and automatic decommissioning of unused instances.

Global ultra-high-speed file sharing is made possible by the new Aspera Files software-as-a-service solution. Aspera Files enables fast, secure, distance-neutral exchange of extremely large files over the Internet, combining cloud and on-premises storage platforms.

The Aspera FASPStream API enables real time data streaming such as ingest over wide area networks for HPC analytics. The Aspera FASPStream API supports transfers to or from a custom process running in memory with another custom process running on a separate machine (Stream-to-Stream), or with a standard Aspera transfer server (Stream-to-File). It enables the transfer of any stream of bytes as they are being created or captured, over commodity IP networks, and can allow access to portions of a file in memory during the transfer process rather than waiting for the entire file to be written to disk.

The high-speed transfer demonstration at SC15 also highlights Oclaro’s new QSFP28-LR4 transceiver, which can transmit 100G data (100GbE or OTU4) over up to 10km of single mode fiber with very low power consumption. Such and similar transceivers optically multiplex the signal from four high speed indium phosphide lasers and are being adopted in next generation data center switches and router interfaces as they upgrade to 100G to meet the exploding bandwidth demands.

About Aspera

Aspera, an IBM company, is the creator of next-generation transport technologies that move the world’s data at maximum speed regardless of file size, transfer distance and network conditions. Part of IBM Cloud, Aspera software is powered by the Emmy award-winning FASP protocol to deliver the fastest, most predictable file-transfer, share and sync experience across on-premises, cloud, and hybrid infrastructure. Aspera’s core technology delivers unprecedented control over bandwidth, complete security and uncompromising reliability. Organizations across a variety of industries on six continents rely on Aspera software for the business-critical transport of their digital assets. Please visit http://www.asperasoft.com and follow us on Twitter @asperasoft for more information.

—

Source: Aspera