Lustre Founder Spots Haskell on HPC Horizon

By Nicole Hemsoth

June 24, 2013

As a small 20-person company, Boulder-based Parallel Scientific flies just under the mainstream radar, but for those who have been in the HPC community for a number of years, its CEO and Chief Architect Peter Braam is a recognizable name.

Braam’s major contribution to high performance computing geared up in 1999 at Carnegie Mellon, where he worked on the file system architecture that spun into Lustre. Inspired by that progress, Braam kicked that project out as a business, beginning Cluster File Systems, which was acquired by Sun in 2007. A year later, Braam let the Sun set and embarked on a new adventure with Parallel Scientific.

The company has a rather interesting business model–instead of focusing on particular problem area (outside of the general purview of tailoring environments for large-scale HPC deployments) they are letting the breeze carry them. For instance, they have found themselves focusing on parallel Haskell in the last few years, even though Braam says that such development might just be the shell for something much larger or entirely different as they continue. 

The saying goes that in Haskell, the function is a first-class citizen–and this status might make it a solid fit for a range of high performance computing environments. Despite what Braam admits is a daunting learning curve, there is an open field of possibilities for Haskell to infiltrate HPC. As it stands, there is an active community around it and around 5000 open source and tools available. But the real value for high performance computing, he argues, lies in Haskell’s productivity and correctness–a worth that’s been validated in select industrial use cases.

Arguably, Google and Facebook have brought more attention to Haskell in recent years, but there are a number of other notable uses that highlight Braam’s confidence in the functional language. For instance, Chicago-based Allston Trading, a high frequency trading company, uses Haskell in their trading infrastructure. AT&T is using it in their Network Security group to automate internet abuse complaint processing. Bank of American is using it in their backend data transformation and loading system and Credit Suisse’s Global Modeling and Analytics Group has been using it since 2006 to improve modeler productivity and open access to those models across the organization.

Biotech giant Amgen also uses Haskell for math-heavy models and to “break developers out of their development rut by giving them a new way to think about software. According to the company’s David Balaban, “Our experience is that using functional programming reduces the critical conceptual distance between thought/algorithms design and code.” But the real value says Balaban is the level of correctness they’ve been able to achieve.

As Amgen’s Balaban says “we have been able to develop code quickly and verify–to an applied mathematician’s satisfaction–the correctness of Haskell code straightforwardly; we have yet to achieve this with more traditional mainstream languages.” 

And indeed, there are plenty of mainstream languages that would seem to fit the bill for mathematical models that don’t come with the hike. Braam says that while R might seem like the most practical language for users like Amgen and others noted above, there are opportunities for error in R that Haskell won’t allow. When correctness is key–as it is with all of the above use cases–the learning curve of Haskell is worth the price if total accuracy is inherent. In fact, he laughingly admits that their business could eventually turn to just building a language that is “safer” than R on the correctness front. 

When it comes to the uptake of a language like Haskell with its learning curve and relatively isolated set of non end user-based functionality, Braam says it’s a matter of time. He points to languages like Python, which took a decade or more to wind a path through large-scale environments, HPC and commercial alike. Still, he notes, “you’d be surprised how many companies have a ‘secret’ Haskell department–a group of people that are highly productive dedicated to solving a serious problem. This is especially true in the financial world–mostly because of the correctness element.”

And true to that point, in grazing the user community for Haskell, the trend seems to be that few are using Haskell as an end user tool. However, users want to be able to construct robust software infrastructure that lets users maintain creativity and take advantage of domain-specific languages, which he says are not as difficult as one might think to implement in Haskell. He points to the example of a Square Kilometer Array (SKA) research group, which wants to the right set of primitives built that will allow the hardware to change and run on different hybrid platforms–an area that his company can help with. 

The idea for finding a wider market for parallel Haskell spun from work Braam and colleagues did around an XSTACK proposal which sought programming environments for exascale computers. The team put an emphasis on automatic parallelization via compilers–a trick that Braam said plenty outside of the HPC community (Facebook, for example) has perfected. It just hasn’t caught on in HPC–although said the same Erlang and Haskell tricks that have worked at that scale can automate parallelism across a multitude of HPC systems. 

His team is also hard at work perfecting their “Awesome Haskell FPGA Compiler” whihc lets developers express hardware solutions in a high-level domain specific language in much the same way their work with SKA is allowing. The environment would allow software simulation and testing in an interactive environment to wick away the long development time that are the bane of FPGA design. The solution that can be kicked to the overall environment and ready to run in some unique data-intensive areas, like SKA.

Braam is a Haskell believer in the same way he believed in his pioneering work on Lustre. “People said you’re wasting your time,” he reminisced. While the use cases may be small, as big data and more complex models drive further into both research and enterprise settings, the appeal of a functional language that emphasizes correctness and productivity will reveal itself.

 

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

AI Chip Start-up Groq to Detail Technology Progress in Fall

August 13, 2020

AI chip startup Groq announced yesterday it had closed its most recent funding round, saying the new investments will help it double in size by the end of this year and double again by the end of next year as it transiti Read more…

By John Russell

Intel Speeds NAMD by 1.8x: Saves Xeon Processor Users Millions of Compute Hours

August 12, 2020

Potentially saving datacenters millions of CPU node hours, Intel and the University of Illinois at Urbana–Champaign (UIUC) have collaborated to develop AVX-512 optimizations for the NAMD scalable molecular dynamics cod Read more…

By Rob Farber

Intel’s Optane/DAOS Solution Tops Latest IO500

August 11, 2020

Intel’s persistent memory technology, Optane, and its DAOS (Distributed Asynchronous Object Storage) stack continue to impress and gain market traction. Yesterday, Intel reported an Optane and DAOS-based system finishe Read more…

By John Russell

Summit Now Offers Virtual Tours

August 10, 2020

Summit, the second most powerful publicly ranked supercomputer in the world, now has a virtual tour. The tour, implemented by 3D platform Matterport, allows users to virtually “walk” around the massive supercomputer Read more…

By Oliver Peckham

Supercomputer Simulations Examine Changes in Chesapeake Bay

August 8, 2020

The Chesapeake Bay, the largest estuary in the continental United States, weaves its way south from Maryland, collecting waters from West Virginia, Delaware, DC, Pennsylvania and New York along the way. Like many major e Read more…

By Oliver Peckham

AWS Solution Channel

University of Adelaide Provides Seamless Bioinformatics Training Using AWS

The University of Adelaide, established in South Australia in 1874, maintains a rich history of scientific innovation. For more than 140 years, the institution and its researchers have had an impact all over the world—making vital contributions to the invention of X-ray crystallography, insulin, penicillin, and the Olympic torch. Read more…

Intel® HPC + AI Pavilion

Supercomputing the Pandemic: Scientific Community Tackles COVID-19 from Multiple Perspectives

Since their inception, supercomputers have taken on the biggest, most complex, and most data-intensive computing challenges—from confirming Einstein’s theories about gravitational waves to predicting the impacts of climate change. Read more…

Student Success from ‘Scratch’: CHPC’s Proof is in the Pudding

August 7, 2020

Happy Sithole, who directs the South African Centre for High Performance Computing (SA-CHPC), called the 13th annual CHPC National conference to order on December 1, 2019, at the Birchwood Conference Centre in Kempton Pa Read more…

By Elizabeth Leake

AI Chip Start-up Groq to Detail Technology Progress in Fall

August 13, 2020

AI chip startup Groq announced yesterday it had closed its most recent funding round, saying the new investments will help it double in size by the end of this Read more…

By John Russell

Intel’s Optane/DAOS Solution Tops Latest IO500

August 11, 2020

Intel’s persistent memory technology, Optane, and its DAOS (Distributed Asynchronous Object Storage) stack continue to impress and gain market traction. Yeste Read more…

By John Russell

Summit Now Offers Virtual Tours

August 10, 2020

Summit, the second most powerful publicly ranked supercomputer in the world, now has a virtual tour. The tour, implemented by 3D platform Matterport, allows use Read more…

By Oliver Peckham

Research: A Survey of Numerical Methods Utilizing Mixed Precision Arithmetic

August 5, 2020

Within the past years, hardware vendors have started designing low precision special function units in response to the demand of the machine learning community Read more…

By Hartwig Anzt and Jack Dongarra

Implement Photonic Tensor Cores for Machine Learning?

August 5, 2020

Researchers from George Washington University have reported an approach for building photonic tensor cores that leverages phase change photonic memory to implem Read more…

By John Russell

HPE Keeps Cray Brand Promise, Reveals HPE Cray Supercomputing Line

August 4, 2020

The HPC community, ever-affectionate toward Cray and its eponymous founder, can breathe a (virtual) sigh of relief. The Cray brand will live on, encompassing th Read more…

By Tiffany Trader

Machines, Connections, Data, and Especially People: OAC Acting Director Amy Friedlander Charts Office’s Blueprint for Innovation

August 3, 2020

The path to innovation in cyberinfrastructure (CI) will require continued focus on building HPC systems and secure connections between them, in addition to the Read more…

By Ken Chiacchia, Pittsburgh Supercomputing Center/XSEDE

Nvidia Said to Be Close on Arm Deal

August 3, 2020

GPU leader Nvidia Corp. is in talks to buy U.K. chip designer Arm from parent company Softbank, according to several reports over the weekend. If consummated Read more…

By George Leopold

Supercomputer Modeling Tests How COVID-19 Spreads in Grocery Stores

April 8, 2020

In the COVID-19 era, many people are treating simple activities like getting gas or groceries with caution as they try to heed social distancing mandates and protect their own health. Still, significant uncertainty surrounds the relative risk of different activities, and conflicting information is prevalent. A team of Finnish researchers set out to address some of these uncertainties by... Read more…

By Oliver Peckham

Supercomputer-Powered Research Uncovers Signs of ‘Bradykinin Storm’ That May Explain COVID-19 Symptoms

July 28, 2020

Doctors and medical researchers have struggled to pinpoint – let alone explain – the deluge of symptoms induced by COVID-19 infections in patients, and what Read more…

By Oliver Peckham

Nvidia Said to Be Close on Arm Deal

August 3, 2020

GPU leader Nvidia Corp. is in talks to buy U.K. chip designer Arm from parent company Softbank, according to several reports over the weekend. If consummated Read more…

By George Leopold

Intel’s 7nm Slip Raises Questions About Ponte Vecchio GPU, Aurora Supercomputer

July 30, 2020

During its second-quarter earnings call, Intel announced a one-year delay of its 7nm process technology, which it says it will create an approximate six-month shift for its CPU product timing relative to prior expectations. The primary issue is a defect mode in the 7nm process that resulted in yield degradation... Read more…

By Tiffany Trader

Supercomputer Simulations Reveal the Fate of the Neanderthals

May 25, 2020

For hundreds of thousands of years, neanderthals roamed the planet, eventually (almost 50,000 years ago) giving way to homo sapiens, which quickly became the do Read more…

By Oliver Peckham

10nm, 7nm, 5nm…. Should the Chip Nanometer Metric Be Replaced?

June 1, 2020

The biggest cool factor in server chips is the nanometer. AMD beating Intel to a CPU built on a 7nm process node* – with 5nm and 3nm on the way – has been i Read more…

By Doug Black

HPE Keeps Cray Brand Promise, Reveals HPE Cray Supercomputing Line

August 4, 2020

The HPC community, ever-affectionate toward Cray and its eponymous founder, can breathe a (virtual) sigh of relief. The Cray brand will live on, encompassing th Read more…

By Tiffany Trader

Neocortex Will Be First-of-Its-Kind 800,000-Core AI Supercomputer

June 9, 2020

Pittsburgh Supercomputing Center (PSC - a joint research organization of Carnegie Mellon University and the University of Pittsburgh) has won a $5 million award Read more…

By Tiffany Trader

Leading Solution Providers

Contributors

Nvidia’s Ampere A100 GPU: Up to 2.5X the HPC, 20X the AI

May 14, 2020

Nvidia's first Ampere-based graphics card, the A100 GPU, packs a whopping 54 billion transistors on 826mm2 of silicon, making it the world's largest seven-nanom Read more…

By Tiffany Trader

Australian Researchers Break All-Time Internet Speed Record

May 26, 2020

If you’ve been stuck at home for the last few months, you’ve probably become more attuned to the quality (or lack thereof) of your internet connection. Even Read more…

By Oliver Peckham

15 Slides on Programming Aurora and Exascale Systems

May 7, 2020

Sometime in 2021, Aurora, the first planned U.S. exascale system, is scheduled to be fired up at Argonne National Laboratory. Cray (now HPE) and Intel are the k Read more…

By John Russell

‘Billion Molecules Against COVID-19’ Challenge to Launch with Massive Supercomputing Support

April 22, 2020

Around the world, supercomputing centers have spun up and opened their doors for COVID-19 research in what may be the most unified supercomputing effort in hist Read more…

By Oliver Peckham

Joliot-Curie Supercomputer Used to Build First Full, High-Fidelity Aircraft Engine Simulation

July 14, 2020

When industrial designers plan the design of a new element of a vehicle’s propulsion or exterior, they typically use fluid dynamics to optimize airflow and in Read more…

By Oliver Peckham

John Martinis Reportedly Leaves Google Quantum Effort

April 21, 2020

John Martinis, who led Google’s quantum computing effort since establishing its quantum hardware group in 2014, has left Google after being moved into an advi Read more…

By John Russell

$100B Plan Submitted for Massive Remake and Expansion of NSF

May 27, 2020

Legislation to reshape, expand - and rename - the National Science Foundation has been submitted in both the U.S. House and Senate. The proposal, which seems to Read more…

By John Russell

Google Cloud Debuts 16-GPU Ampere A100 Instances

July 7, 2020

On the heels of the Nvidia’s Ampere A100 GPU launch in May, Google Cloud is announcing alpha availability of the A100 “Accelerator Optimized” VM A2 instance family on Google Compute Engine. The instances are powered by the HGX A100 16-GPU platform, which combines two HGX A100 8-GPU baseboards using... Read more…

By Tiffany Trader

  • arrow
  • Click Here for More Headlines
  • arrow
Do NOT follow this link or you will be banned from the site!
Share This