PRACEdays18 Keynote Allan Williams (Australia/NCI): We’re Open for Business Down Under!

By Elizabeth Leake (STEM-Trek for HPCwire)

July 5, 2018

The University of Ljubljana in Slovenia hosted the third annual EHPCSW18 and fifth annual PRACEdays18 events which opened with a plenary session on May 29, 2018. The conference was chaired by PRACE Council Vice-Chair (June 2016-June 2017) Sergi Girona (Barcelona Supercomputing Center), and officially opened by PRACE Managing Director and Chair of the EHPCSW & PRACEdays OPC Serge Bogaerts. An official welcome was provided by PRACE Council Chair Anwar Osseyran (Dutch National HPC Center, SURFsara); and Minister of Education, Science and Sport Maja Makovec Brenčič.

Monday opened with the EXDCI workshop. Tuesday began with general session keynotes and split into one industrial and five scientific parallel tracks, with three workshops organized by EHPCSW partnering organizations and projects. In late afternoon, everyone reconvened for general sessions. Wednesday and Thursday featured a similar format with four parallel workshops each day, and Friday was reserved for private project meetings.

Wednesday’s keynote was by Allan Williams, the Associate Director for Services and Technology at the Australian National Computational Infrastructure (NCI). His talk, “Building a world-class national high-performance e-infrastructure for Australian research and innovation,” chronicled the history of Australia’s national cyberinfrastructure (CI). “We’re finally to the point where our program is research-driven and focused on national priorities, but it hasn’t always been that way,” he said.

Australia’s seven states comprise a land mass larger than Europe. Historically, centers sprung up ubiquitously from universities in several states beginning with the first at the Australian National University in Canberra in 1987. The co-investment between states and government wasn’t always well synced. “You may have found compute or storage at one location, but rarely both,” he said. It took years of trial and error before a fully-functioning federated program was established.

Two time zones separate their flagship national high-performance computing (HPC) centers. NCI in Canberra, the nation’s capital, is on the east coast, and Pawsey Supercomputing Center is in Perth on the west coast. Flying distance between them is 3,088 kilometers, or 1,919 miles. Travelling by car with an average speed of 70 mph takes more than 30 hours. But high-speed networks have closed geopolitical gaps, enable high-availability of resources and ensure the prospect of disaster recovery.

The two flagship centers, which once competed for government funding, are now collaborating and developing a joint strategy for the nation. Their leadership is collaborating to develop a more strategic plan to benefit Australian researchers. While there were lean years—zero capital funding in 2012, for example—they’ve managed to progress by innovating and developing integrated cloud, data and HPC services. In 2016, the Australian government asked Australia’s Chief Scientist Dr. Alan Finkel to develop a roadmap outlining the infrastructure needs for Australian researchers. After careful consideration, the government recently released their response to the roadmap, with funding support for an AU$1.9 billion for research infrastructure investments over the next 12 years. This boost in funding under the National Collaborative Research Infrastructure Strategy (NCRIS) scheme will see an initial investment over the next five years of AU$140 million for renewal of the nation’s HPC infrastructure between the two centers. In addition to HPC funding, the government has committed to a strategy of reviewing the roadmap every two years to ensure that it continues to align with researcher needs. The need for tightly integrated services has been recognized, and in addition to the AU$140 million for HPC, another AU$72 million for a shared cloud and storage research platform has been allocated to support the national priority research areas.

Pawsey Supercomputing Centre Acting Director Ugo Varetto also attended PRACEdays18 and said, “Australian researchers have access every year to over 250 Million CPU hours awarded purely on scientific merit though our HPC National Merit Allocation Scheme (NCMAS).” The scheme gives researchers access to The Pawsey Supercomputing Centre flagship system Magnus, NCI’s Raijin, MASSIVE at Monash University in Melbourne and the University of Queensland’s multi-node cluster, Flashlite. All are anchored by major HPC centers and interconnected via the Australian Academic and Research Network (AARNet). “The demand for HPC resources was three times over-subscribed last year, which demonstrated the endless thirst of Australian researchers for high-performance compute resources and the need to grow,” Varetto continued.

Increasingly it’s not just HPC services in isolation, but the integrated workflows of big compute, big data and data analysis in the cloud that are required by researchers to deliver scientific outcomes. However, to get the most out of these resources, dedicated expertise within the HPC computer centers is needed to assist researchers in developing and optimizing software codes for fast IO and integrated workflows.

Both facilities provide researchers across the country with access to large supercomputing resources. Pawsey currently has 45 staff members who support 1,500 researchers and 170 projects in domains such as radio astronomy, energy, engineering, bioinformatics and health sciences. One of the more notorious projects supported by the Australian centers is the Square Kilometer Array (SKA); one of the greatest scientific instruments of our time. With more than 60 personnel who help more than 4,000 researchers, NCI supports the full gamut of research, with a focus on climate, weather, earth system sciences and bioinformatics. National research data collections exceed 20 petabytes and serve as regional hubs for many international data sets, such as the Copernicus and Sentinel satellite data.

Serge Bogaerts (left) and Ugo Varetto signing the PRACE-Pawsey MoU at EHPCSW2018 in Ljubljana, Slovenia.

Australia, like other federated CIs, struggles to recruit and retain skilled personnel. “It’s especially challenging in Canberra since it’s one-fourth the size of Perth, but there is high demand for HPC and data analytical skills from the government and industry sectors,” said Williams. “We need to continually ‘grow our own,’ and are keen to benefit from lessons learned by other CIs that have built successful student programs,” he said. “Unfortunately, it has been difficult to organize teams to compete at the International Supercomputing Conference in Germany, or at the annual Supercomputing Conference in the United States because Australian university student exams fall in July and November,” he added.

“Both Australian centers welcome collaborations with industry partners and federated CIs,” said Varetto. Plans to participate in staff exchanges; visiting scholar programs; shared Tier-0 systems with United States, European Union and Japanese programs; innovative allocation strategies; group procurements; technical exchanges; shared student strategies; online courses; and more are on the horizon. A step towards realizing this was achieved recently when Pawsey signed an MOU with PRACE. “We hope that through close collaboration we can leverage this agreement nationally as we move toward a unified national HPC strategy,” he added.

The distance ‘down under’ doesn’t matter as much as it used to. The Australian Access Federation supports eduroam which facilitates access among 40 similar federations around the world, including the U.S. and most European countries. “AARNet is working with GÉANT and other providers to alleviate transoceanic network bottlenecks, so we expect international data transfers to improve in all directions, but most recently toward Singapore,” said Williams. Those who wish to learn more about AARNet, and how it peers with other high-speed networks in the region may wish to attend the Asia Pacific Advanced Network (APAN’18) conference in Auckland, New Zealand August 5-9, and QUESTNet’18 September 26-28 in Cairns, Australia.

For more information about Australia’s federated CI, visit the NCI and Pawsey websites.

Read additional news about PRACEdays18 in HPCwire. Meanwhile, mark your calendars for #PRACEdays19 and #EHPCSW19 in Poznan, Poland, May 13-17, 2019.

Pawsey booth at the ISC High Performance conference in Frankfurt; photo provided by Pawsey.

About NCI

NCI, Australia’s national high-end research computing service, is a partnership between the Australian National University, CSIRO, the Australian Bureau of Meteorology, Geoscience Australia, research intensive universities and consortia support by the Australian Research Council, and medical research institutes. NCI is supported by the Australian Government through the National Collaborative Research Infrastructure Strategy (NCRIS), with a large fraction of its operations sustained by co-investment from the partner organizations. Through its tightly-coupled, high-performance computing and data platforms, overlaid with internationally renowned expertise in computational science, data science and data management, NCI provides essential services that underpin the requirements of research and industry, today and into the future. For more information, please visit www.nci.org.au.

About Pawsey Supercomputing Centre

The Pawsey Supercomputing Centre is a world-class high-performance computing facility representing Australia’s commitment to the solution of Big Science problems. The facility provides researchers across the country, access to one of the largest supercomputers in the Southern Hemisphere. Pawsey is currently serving over 80 organisations and achieving unprecedented results, in domains such as radio astronomy, energy and resources, engineering, bioinformatics and health sciences. The Centre is focused on providing integrated research solutions by giving users simultaneous access to world-class expertise and infrastructure in supercomputing, data, and visualisation services. Pawsey is funded by the Western Australian State Government and the Australian Government National Collaborative Research Infrastructure Strategy (NCRIS). For more information, please visit www.pawsey.org.au.

About PRACE

The Partnership for Advanced Computing in Europe (PRACE) is an international non-profit association with its seat in Brussels. The PRACE Research Infrastructure provides a persistent world-class high performance computing service for scientists and researchers from academia and industry in Europe. The computer systems and their operations accessible through PRACE are provided by 5 PRACE members (BSC representing Spain, CINECA representing Italy, ETH Zurich/CSCS representing Switzerland, GCS representing Germany and GENCI representing France). The Implementation Phase of PRACE receives funding from the EU’s Horizon 2020 Research and Innovation Programme (2014-2020) under grant agreement 730913. For more information, see www.prace-ri.eu.

About the Author

HPCwire Contributing Editor Elizabeth Leake is a consultant, correspondent and advocate who serves the global high performance computing (HPC) and data science industries. In 2012, she founded STEM-Trek, a global, grassroots nonprofit organization that supports workforce development opportunities for science, technology, engineering and mathematics (STEM) scholars from underserved regions and underrepresented groups.

As a program director, Leake has mentored hundreds of early-career professionals who are breaking cultural barriers in an effort to accelerate scientific and engineering discoveries. Her multinational programs have specific themes that resonate with global stakeholders, such as food security data science, blockchain for social good, cybersecurity/risk mitigation, and more. As a conference blogger and communicator, her work drew recognition when STEM-Trek received the 2016 and 2017 HPCwire Editors’ Choice Awards for Workforce Diversity Leadership.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

GigaIO Gets $14.7M in Series B Funding to Expand Its Composable Fabric Technology to Customers

September 16, 2021

Just before the COVID-19 pandemic began in March 2020, GigaIO introduced its Universal Composable Fabric technology, which allows enterprises to bring together any HPC and AI resources and integrate them with networking, Read more…

What’s New in HPC Research: Solar Power, ExaWorks, Optane & More

September 16, 2021

In this regular feature, HPCwire highlights newly published research in the high-performance computing community and related domains. From parallel programming to exascale to quantum computing, the details are here. Read more…

Cerebras Brings Its Wafer-Scale Engine AI System to the Cloud

September 16, 2021

Five months ago, when Cerebras Systems debuted its second-generation wafer-scale silicon system (CS-2), co-founder and CEO Andrew Feldman hinted of the company’s coming cloud plans, and now those plans have come to fruition. Today, Cerebras and Cirrascale Cloud Services are launching... Read more…

AI Hardware Summit: Panel on Memory Looks Forward

September 15, 2021

What will system memory look like in five years? Good question. While Monday's panel, Designing AI Super-Chips at the Speed of Memory, at the AI Hardware Summit, tackled several topics, the panelists also took a brief glimpse into the future. Unlike compute, storage and networking, which... Read more…

ECMWF Opens Bologna Datacenter in Preparation for Atos Supercomputer

September 14, 2021

In January 2020, the European Centre for Medium-Range Weather Forecasts (ECMWF) – a juggernaut in the weather forecasting scene – signed a four-year, $89-million contract with European tech firm Atos to quintuple its supercomputing capacity. With the deal approaching the two-year mark, ECMWF... Read more…

AWS Solution Channel

Supporting Climate Model Simulations to Accelerate Climate Science

The Amazon Sustainability Data Initiative (ASDI), AWS is donating cloud resources, technical support, and access to scalable infrastructure and fast networking providing high performance computing (HPC) solutions to support simulations of near-term climate using the National Center for Atmospheric Research (NCAR) Community Earth System Model Version 2 (CESM2) and its Whole Atmosphere Community Climate Model (WACCM). Read more…

Quantum Computer Market Headed to $830M in 2024

September 13, 2021

What is one to make of the quantum computing market? Energized (lots of funding) but still chaotic and advancing in unpredictable ways (e.g. competing qubit technologies), the quantum computing landscape is transforming Read more…

Cerebras Brings Its Wafer-Scale Engine AI System to the Cloud

September 16, 2021

Five months ago, when Cerebras Systems debuted its second-generation wafer-scale silicon system (CS-2), co-founder and CEO Andrew Feldman hinted of the company’s coming cloud plans, and now those plans have come to fruition. Today, Cerebras and Cirrascale Cloud Services are launching... Read more…

AI Hardware Summit: Panel on Memory Looks Forward

September 15, 2021

What will system memory look like in five years? Good question. While Monday's panel, Designing AI Super-Chips at the Speed of Memory, at the AI Hardware Summit, tackled several topics, the panelists also took a brief glimpse into the future. Unlike compute, storage and networking, which... Read more…

ECMWF Opens Bologna Datacenter in Preparation for Atos Supercomputer

September 14, 2021

In January 2020, the European Centre for Medium-Range Weather Forecasts (ECMWF) – a juggernaut in the weather forecasting scene – signed a four-year, $89-million contract with European tech firm Atos to quintuple its supercomputing capacity. With the deal approaching the two-year mark, ECMWF... Read more…

Quantum Computer Market Headed to $830M in 2024

September 13, 2021

What is one to make of the quantum computing market? Energized (lots of funding) but still chaotic and advancing in unpredictable ways (e.g. competing qubit tec Read more…

Amazon, NCAR, SilverLining Team for Unprecedented Cloud Climate Simulations

September 10, 2021

Earth’s climate is, to put it mildly, not in a good place. In the wake of a damning report from the Intergovernmental Panel on Climate Change (IPCC), scientis Read more…

After Roadblocks and Renewals, EuroHPC Targets a Bigger, Quantum Future

September 9, 2021

The EuroHPC Joint Undertaking (JU) was formalized in 2018, beginning a new era of European supercomputing that began to bear fruit this year with the launch of several of the first EuroHPC systems. The undertaking, however, has not been without its speed bumps, and the Union faces an uphill... Read more…

How Argonne Is Preparing for Exascale in 2022

September 8, 2021

Additional details came to light on Argonne National Laboratory’s preparation for the 2022 Aurora exascale-class supercomputer, during the HPC User Forum, held virtually this week on account of pandemic. Exascale Computing Project director Doug Kothe reviewed some of the 'early exascale hardware' at Argonne, Oak Ridge and NERSC (Perlmutter), while Ti Leggett, Deputy Project Director & Deputy Director... Read more…

IBM Introduces its First Power10-based Server, the Power E1080; Targets Hybrid Cloud

September 8, 2021

IBM today introduced the Power E1080 server, its first system powered by a Power10 IBM microprocessor. The new system reinforces IBM’s emphasis on hybrid cloud markets and the new chip beefs up its inference capabilities. IBM – like other CPU makers – is hoping to make inferencing a core capability... Read more…

Ahead of ‘Dojo,’ Tesla Reveals Its Massive Precursor Supercomputer

June 22, 2021

In spring 2019, Tesla made cryptic reference to a project called Dojo, a “super-powerful training computer” for video data processing. Then, in summer 2020, Tesla CEO Elon Musk tweeted: “Tesla is developing a [neural network] training computer called Dojo to process truly vast amounts of video data. It’s a beast! … A truly useful exaflop at de facto FP32.” Read more…

Berkeley Lab Debuts Perlmutter, World’s Fastest AI Supercomputer

May 27, 2021

A ribbon-cutting ceremony held virtually at Berkeley Lab's National Energy Research Scientific Computing Center (NERSC) today marked the official launch of Perlmutter – aka NERSC-9 – the GPU-accelerated supercomputer built by HPE in partnership with Nvidia and AMD. Read more…

Google Launches TPU v4 AI Chips

May 20, 2021

Google CEO Sundar Pichai spoke for only one minute and 42 seconds about the company’s latest TPU v4 Tensor Processing Units during his keynote at the Google I Read more…

Esperanto, Silicon in Hand, Champions the Efficiency of Its 1,092-Core RISC-V Chip

August 27, 2021

Esperanto Technologies made waves last December when it announced ET-SoC-1, a new RISC-V-based chip aimed at machine learning that packed nearly 1,100 cores onto a package small enough to fit six times over on a single PCIe card. Now, Esperanto is back, silicon in-hand and taking aim... Read more…

Enter Dojo: Tesla Reveals Design for Modular Supercomputer & D1 Chip

August 20, 2021

Two months ago, Tesla revealed a massive GPU cluster that it said was “roughly the number five supercomputer in the world,” and which was just a precursor to Tesla’s real supercomputing moonshot: the long-rumored, little-detailed Dojo system. “We’ve been scaling our neural network training compute dramatically over the last few years,” said Milan Kovac, Tesla’s director of autopilot engineering. Read more…

CentOS Replacement Rocky Linux Is Now in GA and Under Independent Control

June 21, 2021

The Rocky Enterprise Software Foundation (RESF) is announcing the general availability of Rocky Linux, release 8.4, designed as a drop-in replacement for the soon-to-be discontinued CentOS. The GA release is launching six-and-a-half months after Red Hat deprecated its support for the widely popular, free CentOS server operating system. The Rocky Linux development effort... Read more…

Intel Completes LLVM Adoption; Will End Updates to Classic C/C++ Compilers in Future

August 10, 2021

Intel reported in a blog this week that its adoption of the open source LLVM architecture for Intel’s C/C++ compiler is complete. The transition is part of In Read more…

Iran Gains HPC Capabilities with Launch of ‘Simorgh’ Supercomputer

May 18, 2021

Iran is said to be developing domestic supercomputing technology to advance the processing of scientific, economic, political and military data, and to strengthen the nation’s position in the age of AI and big data. On Sunday, Iran unveiled the Simorgh supercomputer, which will deliver.... Read more…

Leading Solution Providers

Contributors

AMD-Xilinx Deal Gains UK, EU Approvals — China’s Decision Still Pending

July 1, 2021

AMD’s planned acquisition of FPGA maker Xilinx is now in the hands of Chinese regulators after needed antitrust approvals for the $35 billion deal were receiv Read more…

Hot Chips: Here Come the DPUs and IPUs from Arm, Nvidia and Intel

August 25, 2021

The emergence of data processing units (DPU) and infrastructure processing units (IPU) as potentially important pieces in cloud and datacenter architectures was Read more…

10nm, 7nm, 5nm…. Should the Chip Nanometer Metric Be Replaced?

June 1, 2020

The biggest cool factor in server chips is the nanometer. AMD beating Intel to a CPU built on a 7nm process node* – with 5nm and 3nm on the way – has been i Read more…

Julia Update: Adoption Keeps Climbing; Is It a Python Challenger?

January 13, 2021

The rapid adoption of Julia, the open source, high level programing language with roots at MIT, shows no sign of slowing according to data from Julialang.org. I Read more…

HPE Wins $2B GreenLake HPC-as-a-Service Deal with NSA

September 1, 2021

In the heated, oft-contentious, government IT space, HPE has won a massive $2 billion contract to provide HPC and AI services to the United States’ National Security Agency (NSA). Following on the heels of the now-canceled $10 billion JEDI contract (reissued as JWCC) and a $10 billion... Read more…

Intel Launches 10nm ‘Ice Lake’ Datacenter CPU with Up to 40 Cores

April 6, 2021

The wait is over. Today Intel officially launched its 10nm datacenter CPU, the third-generation Intel Xeon Scalable processor, codenamed Ice Lake. With up to 40 Read more…

Quantum Roundup: IBM, Rigetti, Phasecraft, Oxford QC, China, and More

July 13, 2021

IBM yesterday announced a proof for a quantum ML algorithm. A week ago, it unveiled a new topology for its quantum processors. Last Friday, the Technical Univer Read more…

Frontier to Meet 20MW Exascale Power Target Set by DARPA in 2008

July 14, 2021

After more than a decade of planning, the United States’ first exascale computer, Frontier, is set to arrive at Oak Ridge National Laboratory (ORNL) later this year. Crossing this “1,000x” horizon required overcoming four major challenges: power demand, reliability, extreme parallelism and data movement. Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire