Brookhaven Ramps Up Computing for National Security Effort

By John Russell

February 14, 2018

Last week, Dan Coats, the director of Director of National Intelligence for the U.S., warned the Senate Intelligence Committee that Russia was likely to meddle in the 2018 mid-term U.S. elections, much as it stands accused of doing in the 2016 Presidential election. A week earlier, a report surfaced in a Russian media outlet that a group of Russian nuclear scientists had been arrested for using a government supercomputer to mine crypto-currency.

These very public episodes of computer misdeeds are a small portion of a growing and largely hidden iceberg of computer-related dangers with the potential to harm society. There are, of course, many active efforts to mitigate the ‘hacker’ onslaught as well as to use computational capabilities for U.S. national security purposes. Now, a formal effort is ramping up at Brookhaven National Laboratory (BNL).

Last fall, Adolfy Hoisie then at the Pacific Northwest National Laboratory was tapped to join Brookhaven’s expanding computing research and to become chair of the new Computing for National Security (CSN) Department. Since then Hoisie has been quickly drawing up the roadmap for the new effort – it’s charged with researching and developing novel technologies and applications for use in solving computing challenges in the national security arena.

The new CNS department is a recent addition to Brookhaven’s roughly three-year old Computational Science Initiative (CSI) which is intended to further computational capability and research at Brookhaven with a distinct emphasis on data science. Brookhaven is probably best known for its high-energy physics research. Most recently its National Synchrotron Light Source II is grabbing attention – it will be the brightest in the world when completed and accommodate 60 to 70 beamlines. Brookhaven also houses RHIC (Relativistic Heavy Ion Collider), which among other things is currently looking for the missing spin of the proton.

Adolfy Hoisie, Chair, Computing for National Security (CSN) Department, Brookhaven National Laboratory

Not surprisingly, the synchrotron, RHIC, and a variety of other experimental instruments at Brookhaven produce a lot of data. “We have the second largest scientific data archive in the U.S. and the fourth largest in the world,” said Hoisie, founding chairman of the CSN department. “On an annual basis, data to the tune of 35 petabytes are being ingested, 37 petabytes are being exported, and 400 petabytes of data analyzed. [What’s more] given the scientific community nature of this work, a lot of this data needs to be accessed at high bandwidth in and out of the experimental facilities and the Lab’s storage systems.”

Dealing with that mountain of experimental data is the main computational challenge at Brookhaven and Hoisie noted the CNS mission is ‘highly synergistic’ with those efforts.

“A large spectrum, if not a preponderance of applications, inspired by national security challenges, are in actual fact data sciences problems. It is speed of collection from various sources, whether the volume or velocity of data, the quality of data, analysis of data, which sets performance bounds for [security-related] applications. Just like data being streamed from a detector on an x-ray beam, data that is being streamed from a UAV (unmanned aerial vehicle) also has the challenges of too much data being generated and not enough bandwidth-to-the-ground in order for it to become actionable information and then make it back to the flying vehicle,” he said.

“The methodologies for data analysis, including machine learning and deep learning, required for national security concerns are very much synergistic with the challenges in data sciences. The spectrum of applications of interest to my department includes intelligence apps, cybersecurity, non-proliferation activities including international aspects of that, supply chain security, and a number of computational aspects of security of the computing infrastructure.”

Hoisie is no stranger to HPC or to building focused HPC research organizations. He joined Brookhaven from PNNL where he was the Director of the Advanced Computing, Mathematics, and Data Division, and the founding director of the Center for Advanced Technology Evaluation (CENATE). He plans to significantly expand the breadth, depth, and reach of the technologies and applications considered, with a focus on the full technology pipeline (basic research through devices, board, systems, to algorithms and applications).

Brookhaven, of course, already has substantial computational resources, a big chunk of which are co-located with the new synchrotron and dedicated to it. Predictably, I/O and storage is a particularly thorny issue and Hoisie noted Brookhaven has a large assortment of storage solutions and devices “from novel solutions all the way to discs and tapes of many generations that require computational resources in order to operate and do the data management.”

Brookhaven Light Source II

Currently, there is a second effort to centralize and expand the remaining computational infrastructure. The new CSN, along with much of the CSI, will be located in the new center.

“The first floor of the old synchrotron (National Synchrotron Light Source I) is being refurbished to a modern machine room through a DOE sponsored project. The approximate size of the area is 50,000 square feet. Significant power will be added to house the existing large scale computing and storage systems, and provide for the ability to grow in the future commensurate with the computing aspirations of Brookhaven. The new facility will also include computing Lab space for high accuracy and resolution measurement of computing technologies from device to systems, and to house computing systems “beyond Moore’s law” that will likely require special operating conditions,” said Hoisie.

Brookhaven has a diverse portfolio of ongoing research some of which will be tapped by CNS. “For example, there’s a significant scientific emphasis in materials design. That includes a center for nano materials, developing methodologies for material design and actual development of materials. We are trying to enmesh this expertise in materials with that in computing to tackle the challenges of computing at the device level,” Hoise said.

Hoisie’s group will also look at emerging technologies such as quantum computing. “That’s an area of major interest. We are looking at not only creating the appropriate facilities for siting quantum computing, such as the infrastructure for deep cooling and whatnot, but also looking at very significantly expanding the range of applications that are suitable for quantum computing. On that we have active discussions with IBM and others. You know, quantum computing is a little bit of a work in progress. I know I am stating the obvious but a lot depends on expanding significantly the range of applications to which quantum computing is applicable. We too often say, yes, quantum computing is very good for quantum chemistry or studying quantum effects in all kinds of processes, and cryptography, but there are many other areas we are trying to explore.”

Industry collaboration is an important part of the plan. In fact, noted Hoisie, “CSI, for example, is partly endowed by a New York State grant and part of the rules of engagement related to the grant and the management structure of Brookhaven [requires] development of a bona fide, high quality, high bandwidth interaction with regional powerhouses in computing including IBM. So we have quite a few ongoing in-depth discussions with potential partners that we hope soon to materialize to tackle together specific technologies.”

Throughout his computing career, Hoisie developed fruitful collaborations with technology providers with many collaborators such as IBM, AMD, Nvidia, and Data Vortex, just to name a few. He expects to do the same now.

Also, the modeling and simulation (ModSim) workshop series he helped organize and run will also continue including through his leadership of it and the participation of his new group. “The series of ModSim meetings will continue. Although I am not on the West Coast now we decided to organize them for continuity in Seattle at the University of Washington. These are events in which we are going to showcase technologies and applications including those national security interests and how ModSim is going to help. We’ve refreshed the committee to expand its base. That will continue as an interagency-funded operation that involves DOE, NSF, and a number of sectors from DoD,” Hoisie said.

Obviously these are still early days for the Computing for National Security initiative. A limited number of projects are still taking shape and there are few details available. That said Hoisie has high expectations:

“We have very significant plans to grow this department. The goal is to bring this Computing for National Security department, which is small at the moment, to the level of a high quality, and the emphasis is on the highest possible quality, of a top-notch national laboratory division level effort.

“This is the way in which we conducted HPC research for decades in my groups. There is the highest quality staff that we hire. There is active integration across the spectrum from technology and systems to the system software to applications and algorithms. And there is a healthy mixture of applied mathematics and computer science and domain sciences that are all contributing to the team effort. And there is a pipeline that we are interested in at all stages: as the technology matures you get more and more into areas that are related to computer science and mathematics and algorithm development and end up in tech development arena. These technologies materialize into boards, devices, systems and then into very large scale supercomputers that offer efficient solutions for solving science or national security problems. We absolutely plan to follow this way.”

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

ORNL Helps Identify Challenges of Extremely Heterogeneous Architectures

March 21, 2019

Exponential growth in classical computing over the last two decades has produced hardware and software that support lightning-fast processing speeds, but advancements are topping out as computing architectures reach thei Read more…

By Laurie Varma

Interview with 2019 Person to Watch Jim Keller

March 21, 2019

On the heels of Intel's reaffirmation that it will deliver the first U.S. exascale computer in 2021, which will feature the company's new Intel Xe architecture, we bring you our interview with our 2019 Person to Watch Jim Keller, head of the Silicon Engineering Group at Intel. Read more…

By HPCwire Editorial Team

What’s New in HPC Research: TensorFlow, Buddy Compression, Intel Optane & More

March 20, 2019

In this bimonthly feature, HPCwire highlights newly published research in the high-performance computing community and related domains. From parallel programming to exascale to quantum computing, the details are here. Read more…

By Oliver Peckham

HPE Extreme Performance Solutions

HPE and Intel® Omni-Path Architecture: How to Power a Cloud

Learn how HPE and Intel® Omni-Path Architecture provide critical infrastructure for leading Nordic HPC provider’s HPCFLOW cloud service.

powercloud_blog.jpgFor decades, HPE has been at the forefront of high-performance computing, and we’ve powered some of the fastest and most robust supercomputers in the world. Read more…

IBM Accelerated Insights

Insurance: Where’s the Risk?

Insurers are facing extreme competitive challenges in their core businesses. Property and Casualty (P&C) and Life and Health (L&H) firms alike are highly impacted by the ongoing globalization, increasing regulation, and digital transformation of their client bases. Read more…

At GTC: Nvidia Expands Scope of Its AI and Datacenter Ecosystem

March 19, 2019

In the high-stakes race to provide the AI life-cycle solution of choice, three of the biggest horses in the field are IBM, Intel and Nvidia. While the latter is only a fraction of the size of its two bigger rivals, and has been in business for only a fraction of the time, Nvidia continues to impress with an expanding array of new GPU-based hardware, software, robotics, partnerships and... Read more…

By Doug Black

At GTC: Nvidia Expands Scope of Its AI and Datacenter Ecosystem

March 19, 2019

In the high-stakes race to provide the AI life-cycle solution of choice, three of the biggest horses in the field are IBM, Intel and Nvidia. While the latter is only a fraction of the size of its two bigger rivals, and has been in business for only a fraction of the time, Nvidia continues to impress with an expanding array of new GPU-based hardware, software, robotics, partnerships and... Read more…

By Doug Black

Nvidia Debuts Clara AI Toolkit with Pre-Trained Models for Radiology Use

March 19, 2019

AI’s push into healthcare got a boost yesterday with Nvidia’s release of the Clara Deploy AI toolkit which includes 13 pre-trained models for use in radiolo Read more…

By John Russell

It’s Official: Aurora on Track to Be First US Exascale Computer in 2021

March 18, 2019

The U.S. Department of Energy along with Intel and Cray confirmed today that an Intel/Cray supercomputer, "Aurora," capable of sustained performance of one exaf Read more…

By Tiffany Trader

Why Nvidia Bought Mellanox: ‘Future Datacenters Will Be…Like High Performance Computers’

March 14, 2019

“Future datacenters of all kinds will be built like high performance computers,” said Nvidia CEO Jensen Huang during a phone briefing on Monday after Nvidia revealed scooping up the high performance networking company Mellanox for $6.9 billion. Read more…

By Tiffany Trader

Oil and Gas Supercloud Clears Out Remaining Knights Landing Inventory: All 38,000 Wafers

March 13, 2019

The McCloud HPC service being built by Australia’s DownUnder GeoSolutions (DUG) outside Houston is set to become the largest oil and gas cloud in the world th Read more…

By Tiffany Trader

Quick Take: Trump’s 2020 Budget Spares DoE-funded HPC but Slams NSF and NIH

March 12, 2019

U.S. President Donald Trump’s 2020 budget request, released yesterday, proposes deep cuts in many science programs but seems to spare HPC funding by the Depar Read more…

By John Russell

Nvidia Wins Mellanox Stakes for $6.9 Billion

March 11, 2019

The long-rumored acquisition of Mellanox came to fruition this morning with GPU chipmaker Nvidia’s announcement that it has purchased the high-performance net Read more…

By Doug Black

Optalysys Rolls Commercial Optical Processor

March 7, 2019

Optalysys, Ltd., a U.K. company seeking to advance it optical co-processor technology, moved a step closer this week with the unveiling of what it claims is th Read more…

By George Leopold

Quantum Computing Will Never Work

November 27, 2018

Amid the gush of money and enthusiastic predictions being thrown at quantum computing comes a proposed cold shower in the form of an essay by physicist Mikhail Read more…

By John Russell

The Case Against ‘The Case Against Quantum Computing’

January 9, 2019

It’s not easy to be a physicist. Richard Feynman (basically the Jimi Hendrix of physicists) once said: “The first principle is that you must not fool yourse Read more…

By Ben Criger

ClusterVision in Bankruptcy, Fate Uncertain

February 13, 2019

ClusterVision, European HPC specialists that have built and installed over 20 Top500-ranked systems in their nearly 17-year history, appear to be in the midst o Read more…

By Tiffany Trader

Intel Reportedly in $6B Bid for Mellanox

January 30, 2019

The latest rumors and reports around an acquisition of Mellanox focus on Intel, which has reportedly offered a $6 billion bid for the high performance interconn Read more…

By Doug Black

Why Nvidia Bought Mellanox: ‘Future Datacenters Will Be…Like High Performance Computers’

March 14, 2019

“Future datacenters of all kinds will be built like high performance computers,” said Nvidia CEO Jensen Huang during a phone briefing on Monday after Nvidia revealed scooping up the high performance networking company Mellanox for $6.9 billion. Read more…

By Tiffany Trader

Looking for Light Reading? NSF-backed ‘Comic Books’ Tackle Quantum Computing

January 28, 2019

Still baffled by quantum computing? How about turning to comic books (graphic novels for the well-read among you) for some clarity and a little humor on QC. The Read more…

By John Russell

Contract Signed for New Finnish Supercomputer

December 13, 2018

After the official contract signing yesterday, configuration details were made public for the new BullSequana system that the Finnish IT Center for Science (CSC Read more…

By Tiffany Trader

Deep500: ETH Researchers Introduce New Deep Learning Benchmark for HPC

February 5, 2019

ETH researchers have developed a new deep learning benchmarking environment – Deep500 – they say is “the first distributed and reproducible benchmarking s Read more…

By John Russell

Leading Solution Providers

SC 18 Virtual Booth Video Tour

Advania @ SC18 AMD @ SC18
ASRock Rack @ SC18
DDN Storage @ SC18
HPE @ SC18
IBM @ SC18
Lenovo @ SC18 Mellanox Technologies @ SC18
NVIDIA @ SC18
One Stop Systems @ SC18
Oracle @ SC18 Panasas @ SC18
Supermicro @ SC18 SUSE @ SC18 TYAN @ SC18
Verne Global @ SC18

IBM Quantum Update: Q System One Launch, New Collaborators, and QC Center Plans

January 10, 2019

IBM made three significant quantum computing announcements at CES this week. One was introduction of IBM Q System One; it’s really the integration of IBM’s Read more…

By John Russell

IBM Bets $2B Seeking 1000X AI Hardware Performance Boost

February 7, 2019

For now, AI systems are mostly machine learning-based and “narrow” – powerful as they are by today's standards, they're limited to performing a few, narro Read more…

By Doug Black

The Deep500 – Researchers Tackle an HPC Benchmark for Deep Learning

January 7, 2019

How do you know if an HPC system, particularly a larger-scale system, is well-suited for deep learning workloads? Today, that’s not an easy question to answer Read more…

By John Russell

HPC Reflections and (Mostly Hopeful) Predictions

December 19, 2018

So much ‘spaghetti’ gets tossed on walls by the technology community (vendors and researchers) to see what sticks that it is often difficult to peer through Read more…

By John Russell

Arm Unveils Neoverse N1 Platform with up to 128-Cores

February 20, 2019

Following on its Neoverse roadmap announcement last October, Arm today revealed its next-gen Neoverse microarchitecture with compute and throughput-optimized si Read more…

By Tiffany Trader

It’s Official: Aurora on Track to Be First US Exascale Computer in 2021

March 18, 2019

The U.S. Department of Energy along with Intel and Cray confirmed today that an Intel/Cray supercomputer, "Aurora," capable of sustained performance of one exaf Read more…

By Tiffany Trader

Move Over Lustre & Spectrum Scale – Here Comes BeeGFS?

November 26, 2018

Is BeeGFS – the parallel file system with European roots – on a path to compete with Lustre and Spectrum Scale worldwide in HPC environments? Frank Herold Read more…

By John Russell

France to Deploy AI-Focused Supercomputer: Jean Zay

January 22, 2019

HPE announced today that it won the contract to build a supercomputer that will drive France’s AI and HPC efforts. The computer will be part of GENCI, the Fre Read more…

By Tiffany Trader

  • arrow
  • Click Here for More Headlines
  • arrow
Do NOT follow this link or you will be banned from the site!
Share This