South Africa Maps HPC Future as SKA Plans Take Shape

By Elizabeth Leake, STEM-Trek -- Photography by Lawrette McFarlane

March 1, 2016

The South African Center for High Performance Computing’s (SA-CHPC) Ninth Annual National Meeting was held Nov. 30 – Dec. 4, 2015, at the Council for Scientific and Industrial Research (CSIR) International Convention Center in Pretoria, SA. The award-winning venue was the perfect location to host what has become a popular industry, regional and educational showcase.

Exascale in the 2020s

With the Square Kilometer Array (SKA) being built in the great Karoo region, implications for SA and the HPC industry have captured the attention of a broad range of stakeholders. SKA will be the world’s biggest radio telescope, and the most ambitious technology project ever funded. With an expected 50-year lifespan, SKA Phase One construction is scheduled to begin in 2018, and early science and data generation will follow by 2020.

With only a few years in which to prepare for SKA, it’s not surprising that the CHPC conference has begun to feature in-depth data science and network infrastructure content, in addition to the meeting’s traditional HPC tutorials, workshops, plenaries, and student programs. Once again, the Southern African Development Community (SADC) HPC and Industry Forums were co-located with the CHPC meeting. An increased number of conference attendees from data science and high-speed network occupations added diversity in terms of gender, discipline and nationalities represented. All things considered, the annual CHPC meeting provides a wealth of learning opportunities, and brings professional networking to an emerging region of the HPC world.

Just how resource-intensive will SKA be?

Peter Braam (SKA Cambridge University, Parallel Scientific)
Peter Braam (SKA Cambridge University, Parallel Scientific)

It’s safe to say that SKA will set the “Big Data” curve. In his plenary address, Peter Braam (SKA Cambridge University, Parallel Scientific) described the range of instrumentation that will support the project, and how a combination of dedicated and cloud-enabled resources will fulfill its varied and complex missions. As for data, by 2020 SKA’s central signal processing array—50 times more sensitive than any current radio instrument—will generate 1 exabytes per day, and 100 exabytes per day by 2028. Its imaging function will produce 400 terabytes daily for worldwide consumption by 2020, and 10,000 petabytes per day by 2028. As for computational processing power, it will require 300 petaflops (archiving 1 exabyte) by 2020 and 10 times more by 2028.

Rudolph Pienaar (Boston Children’s Hospital, Harvard) noted that even before SKA data enters the infostream, by 2019 general network traffic will explode as a larger percentage of the population has access to networks; with an additional 30 percent more networked devices per capita and many more applications that are increasingly resource-intensive. Global IP traffic will reach 1.1 zettabytes per year in 2016, or 88.4 exabytes (one billion gigabytes) per month. By 2019, global IP traffic will reach 2.0 zettabytes per year, or 168 exabytes per month.

Most of the Karoo region and surrounding areas currently lack high-speed networks, and a reliable electrical supply. However, with ten wealthier countries and more than 100 organizations behind the project, SA expects to have the support it will need to host SKA. Additionally, many of SADC’s 15 member states will benefit from an improved power grid and access to high-speed networks, in addition to slipstream advantages such as workforce development opportunities and access to tools that support international research engagement.

CHPC National Meeting

Happy Sithole (CHPC/CSIR-SA)
Happy Sithole (CHPC/CSIR-SA)

The 2015 meeting was called to order by General Chair Janse Van Rensburg (CHPC) who introduced Director General Phil Mjwara (SA Dept. of Science & Technology). Dr. Mjwara expressed the vital role HPC will play in South Africa’s future. “A greater investment in cyberinfrastructure (CI) and supportive human capital development are essential for good governance, sustainability and commerce,” he said.

Mjwara shared 2015 highlights, including a milestone partnership between CHPC and SANRen. The agreement, reached in April, 2015, allows CHPC to engage with 155 tier-2 sites around the world that access the Large Hadron Collider at CERN in Geneva, Switzerland.

SA-CHPC New System FeaturesCHPC Director Happy Sithole described how their Cape Town center has grown since launching in 2007 when it supported 15 researchers with 2.5 teraflops of computational power. “That was a good start for South Africa, and CHPC was the only center on the continent at the time,” said Sithole. Since then, CHPC has expanded to meet demands. At the time of the 2015 conference, CHPC supported 700 researchers with 7,000 cores and 64 teraflops. “But, we could be fully subscribed with our three largest research projects,” he added.

Sithole was pleased to announce the addition of a new Dell system that will be operational in early 2016. Launched in two phases, the first is expected to achieve 700 teraflops and the second will add an additional 300 teraflops with GPU acceleration. “This brings a total of one petaflops of computational power to the region,” he added. Thirty percent of the system’s cycles will be available for lease by CSIR industry partners.

Thomas Sterling (Indiana University)
Thomas Sterling (Indiana University)

The student poster and cluster competition awards were presented Thursday evening following a plenary address by Thomas Sterling (Indiana University). Sterling is executive associate director and chief scientist at the Center for Research in Extreme Scale Technologies (CREST) and is best known for his pioneering work in commodity clusters as “the father of Beowulf.” He noted the accelerated progress being made by CHPC and pioneer projects in region, and credited Sithole for blazing the trail on behalf of industry, science and education.

“The new CHPC Dell and Mellanox system will provide world-class compute capability to prepare the emerging southern African region for exascale computing in the next decade,” said Sterling.

Plenary Highlights

The opening plenary address by Merle Giles (National Center for Supercomputing Applications, U.S.) was titled “HPC-Enabled Innovation and Transformational Science & Engineering: The Role of CI.” As the leader of NCSA’s private sector program, Giles explained HPC’s macro and micro economic impact on the economy, with the federal investment defining macro-, and micro-economic impact coming from universities and industry.

Giles described the “R&D Valley of Death,” or the funding gap that exists between the theoretical and basic research led by universities (or startups), and the production-commercialization phase effectuated by industry. “Somewhere in the middle, before optimization and ‘robustification,’ great ideas tend to crash and burn for lack of funding,” he said. “When this happens, it adversely affects how the public perceives science and technology spending, in general,” he added. Greater emphases on investment and tech transfer will help bridge this gap.

Merle Giles (NCSA Private Sector Program - U.S.)
Merle Giles (NCSA Private Sector Program – U.S.)

Giles said President Obama initiated an important discussion in January, 2015, during his state of the union address. By explaining how precision medicine and the curing of common diseases are enabled by fast computers and data science, he demystified the concept so that average citizens could understand why HPC is important to them. He then announced the nation’s strategic computing initiative in August. “Through this steady dialogue, Obama is laying the groundwork for future support of a greater public investment in advanced CI,” Giles said.

He added that all sectors—public, private and industry—must share the responsibility for preparing the workforce. “And, by the way, coding is no longer the new literacy; modeling and the ability to master data are more important as HPC becomes more accessible, and the long tail of science engages a broader range of practitioners,” he added. He concluded with facts from an International Data Corporation study that found for every dollar invested in HPC, $515 dollars in revenue and $43 dollars of profit are generated. Feasibility should be addressed, but it’s often overlooked. No single company, agency or government can fund everything. A sustainable program requires collaboration and a holistic approach to spending.

Peter Braam (SKA Cambridge University, Parallel Scientific) presented “HPC Stack—Scientific Computing Meets Cloud.” Braam explained how cloud-augmented cluster services satisfy a greater spectrum of administrative and production applications than earth-bound HPC can on its own. By provisioning clusters with containers, or cloud-enabled virtual machines (VMs), it’s possible to facilitate core services, such as identity management, storage, scheduling, and monitoring. “We discovered there are generally two groups of users: people performing operations, and developers who are experimenting in pursuit of discovery. To support the latter, we realized it’s more feasible to deploy 100 small virtual cloud-enabled environments than 100 HPC systems.” Cambridge, CHPC and Canonical Ltd are pursuing this study.

Simon Hodson (CODATA - France)
Simon Hodson (CODATA – France)

Thursday’s plenary was delivered by CODATA Executive Director Simon Hodson, and was titled “Mobilizing the data revolution: CODATA’s work on data policy, data science and capacity building.”

Hodson suggested that a 2012 report by The Royal Society titled “Science as an open enterprise” made a profound impact on the industry when it stated that data underpinning research findings must be openly available. “Transparency, credibility and reproducibility are the keys to gaining public confidence; data must therefore be accessible, assessable, intelligible, usable, and reusable,” he said.

The European Union’s Horizon 2020 project included, word-for-word, excerpts from the report that suggested principal investigators are guilty of scientific misconduct if their data aren’t accessible. Most European and U.S. agencies now require data generated by research they fund to be liberated, and many have issued policies regarding open research data. Leading industry journals and digital repositories have also adopted the practice, including Dryad, GenBank and TreeBASE.

Hodson addressed data citation best practices, and financing strategies to support sustainable data repositories. He presented the findings of a joint declaration of data citation principles by the CODATA-ICSTI Task Group on Data Citation Standards and Practices and FORCE11 (Future of eScience Communications and Scholarship). “Make data available in a usable way, so they can be recognized and properly credited,” he said, referring to a CODATA paper published in the Journal of Data Science titled “Out of Cite, Out of Mind: The Current State of Practice, Policy, and Technology for the Citation of Data.”

Hodson announced a series of 2016-17 Data Science Summer Schools that are co-sponsored by CODATA and the Research Data Alliance (RDA). The two-week programs will cover software and data carpentry, data stewardship, curation, visualization, and more. CODATA-RDA earmarked $60,000 for travel funding for registrants who lack institutional support. The first will be held in Trieste, Italy on August 1-12, 2016. The International Center for Theoretical Physics (ICTP) will support up to 120 students, and 30,000 Euros are allocated for student travel. Students from low and middle-income countries (LMICs) will be given priority, and additional sponsors are welcome.

Rudolph Pienaar (Boston Children's Hospital, Harvard)
Rudolph Pienaar (Boston Children’s Hospital, Harvard)

Health data concerns were addressed by Rudolph Pienaar (Boston Children’s Hospital) with his presentation titled “Web 2.0 and beyond: Leveraging Web Technologies as Middleware in Healthcare and High Performance Compute Clusters; Data, Apps, Results, Sharing and Collaboration.”

Pienaar argued that even today, most medical clinical applications follow 1990’s vintage interfaces and patient medical data is housed in locked-down silos that don’t facilitate cross-comparison. From an integration perspective, medical data is dead on arrival – the only common central point to all medical data in a hospital is the billing department. It is largely impossible for physicians or researchers to make meaningful comparisons of data housed in different silos. The system was designed to facilitate billing, and to protect patient privacy, but it impedes research and diagnostics. Pienaar believes that the current infrastructure is not at all well suited to handle the amount and complexity of data that is coming down the pipe in the next five years.

That’s when ChRIS was born. The Boston Children’s Hospital Research Integration System (ChRIS) is a novel browser-based data storage and data processing workflow manager. Developed using Javascript and Web2.0, ChRIS anonymizes personal information, and includes a plug-in to accommodate clusters of collaborators that could, potentially, be located around the world. By employing a local virtual machine on the desktop, ChRIS hides the complexity of data scheduling on an HPC by keeping everything local. The system also uses Google real-time API services that facilitate to enable real-time true image sharing and collaboration. Multiple parties can interact with the same medical visual scene, each in their own browsers, and all views, slices, are updated in real time – using a design approach that is not screen sharing, but more akin to how multi-player 3D gaming works.

SADC HPC Forum

SADC Forum 2015The SADC HPC Forum has been meeting since 2013 when the University of Texas, U.S. donated a decommissioned HPC system called “Ranger” to CHPC. More than 20 Ranger racks were divided into several mini-Rangers that were placed in eight centers in five SADC states. Each mini-Ranger forms a footprint for human capital development (HCD) and the initiative has launched an important public-private dialogue that SADC hopes will inspire support for future expansion.

Tshiamo Motshegwa (U-Botswana, SADC Forum Chair)
Tshiamo Motshegwa (U-Botswana, SADC Forum Chair)

Ms. Mmampei Chaba (Dept. of Science & Technology, SA) welcomed everyone on behalf of the host country, and Ms. Anneline Morgan (SADC Secretariat) introduced Forum Chair Tshiamo Motshegwa (U-Botswana).

Forum delegates and international advisers further refined the SADC collaborative framework document that last year’s forum attendees had begun to draft, and a final version will be presented to the SADC Ministry. There were several newcomers; delegates who hadn’t attended in the past, and representatives from countries that were entirely new to the forum, including Mauritius, Namibia and Seychelles. All were eager to know how their countries could contribute to and engage with the shared CI.

Everyone was eager to discuss best practices relating to data sharing across national borders; an uncomfortable concept for those who haven’t managed research data. The international advisers explained that the ability to facilitate the secure, seamless and reliable transfer of data among SADC sites, and beyond, is crucial to the project’s success. To that end, following the meeting, Motshegwa began to plan a cybersecurity and data conference scheduled for mid-April, 2016 in Gaborone, Botswana. U.S. and European cybersecurity experts are invited to participate. They will share roughly 50 years of collective experience with the facilitation of secure data across peered networks, international computational systems and interfederated CIs.

SADC HPC Forum delegate questions frame future discussions and HCD programming. While technology training has been the focus, each site is encouraged to add education, outreach, communication, and external relations skills to their teams. By building teams that include a combination of technical and soft skills, they will be better prepared to support and sustain their CI programs for the future.

The CHPC National Meeting, co-located meetings and student programs would not have been possible without the generosity of sponsors IntelDellAltairSeagateEclipse HoldingsMellanox, and Bright Computing. We appreciate their continued support,” said Conference Program Planner Happy Sithole (CHPC).

Presentations and videos from the awards evening are available on the CHPC website.

2016 CHPC National Meeting

Please join us in East London, South Africa for the 2016 CHPC National Meeting, and SADC HPC Forum Dec. 5-9, 2016.

Photo by Adel Groenewald
Photo by Adel Groenewald

Plan to spend extra time while visiting this beautiful region, and be sure to pack your hiking boots! It will be summer in South Africa, and you’ll find some of the best hiking, bird watching, fishing, swimming, and horseback riding in the world. East London is South Africa’s only river port city. The nearby Wild Coast region has miles of unspoiled, white beaches framed by thick forests that give way to steep, rocky cliffs. The area is steeped in Xhosa tradition, and their farms are scattered along the coast. It’s sparsely-populated, and it’s likely you’ll meet more cows than people. With a favorable international currency exchange rate, you’ll only be limited your energy and time.

 

About the Author

ElizabethLeake-headshotElizabeth Leake is the president and founder of STEM-Trek Nonprofit, a global, grassroots organization that supports scholarly travel for science, technology, engineering, and mathematics scholars from underrepresented groups and regions. Since 2011, she has worked as a communications consultant for a variety of education and research organizations, and served as correspondent for activities sponsored by the eXtreme Science and Engineering Discovery Environment (TeraGrid/XSEDE), the Partnerhip for Advanced Computing in Europe (DEISA/PRACE), the European Grid Infrastructure (EGEE/EGI), South African Center for High Performance Computing (CHPC), the Southern African Development Community (SADC), and Sustainable Horizons, Inc.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

PRACEdays Reflects Europe’s HPC Commitment

May 25, 2017

More than 250 attendees and participants came together for PRACEdays17 in Barcelona last week, part of the European HPC Summit Week 2017, held May 15-19 at t Read more…

By Tiffany Trader

Russian Researchers Claim First Quantum-Safe Blockchain

May 25, 2017

The Russian Quantum Center today announced it has overcome the threat of quantum cryptography by creating the first quantum-safe blockchain, securing cryptocurr Read more…

By Doug Black

Google Debuts TPU v2 and will Add to Google Cloud

May 25, 2017

Not long after stirring attention in the deep learning/AI community by revealing the details of its Tensor Processing Unit (TPU), Google last week announced the Read more…

By John Russell

Nvidia CEO Predicts AI ‘Cambrian Explosion’

May 25, 2017

The processing power and cloud access to developer tools used to train machine-learning models are making artificial intelligence ubiquitous across computing pl Read more…

By George Leopold

HPE Extreme Performance Solutions

Exploring the Three Models of Remote Visualization

The explosion of data and advancement of digital technologies are dramatically changing the way many companies do business. With the help of high performance computing (HPC) solutions and data analytics platforms, manufacturers are developing products faster, healthcare providers are improving patient care, and energy companies are improving planning, exploration, and production. Read more…

PGAS Use will Rise on New H/W Trends, Says Reinders

May 25, 2017

If you have not already tried using PGAS, it is time to consider adding PGAS to the programming techniques you know. Partitioned Global Array Space, commonly kn Read more…

By James Reinders

Exascale Escapes 2018 Budget Axe; Rest of Science Suffers

May 23, 2017

President Trump's proposed $4.1 trillion FY 2018 budget is good for U.S. exascale computing development, but grim for the rest of science and technology spend Read more…

By Tiffany Trader

Hedge Funds (with Supercomputing help) Rank First Among Investors

May 22, 2017

In case you didn’t know, The Quants Run Wall Street Now, or so says a headline in today’s Wall Street Journal. Quant-run hedge funds now control the largest Read more…

By John Russell

IBM, D-Wave Report Quantum Computing Advances

May 18, 2017

IBM said this week it has built and tested a pair of quantum computing processors, including a prototype of a commercial version. That progress follows an an Read more…

By George Leopold

PRACEdays Reflects Europe’s HPC Commitment

May 25, 2017

More than 250 attendees and participants came together for PRACEdays17 in Barcelona last week, part of the European HPC Summit Week 2017, held May 15-19 at t Read more…

By Tiffany Trader

PGAS Use will Rise on New H/W Trends, Says Reinders

May 25, 2017

If you have not already tried using PGAS, it is time to consider adding PGAS to the programming techniques you know. Partitioned Global Array Space, commonly kn Read more…

By James Reinders

Exascale Escapes 2018 Budget Axe; Rest of Science Suffers

May 23, 2017

President Trump's proposed $4.1 trillion FY 2018 budget is good for U.S. exascale computing development, but grim for the rest of science and technology spend Read more…

By Tiffany Trader

Cray Offers Supercomputing as a Service, Targets Biotechs First

May 16, 2017

Leading supercomputer vendor Cray and datacenter/cloud provider the Markley Group today announced plans to jointly deliver supercomputing as a service. The init Read more…

By John Russell

HPE’s Memory-centric The Machine Coming into View, Opens ARMs to 3rd-party Developers

May 16, 2017

Announced three years ago, HPE’s The Machine is said to be the largest R&D program in the venerable company’s history, one that could be progressing tow Read more…

By Doug Black

What’s Up with Hyperion as It Transitions From IDC?

May 15, 2017

If you’re wondering what’s happening with Hyperion Research – formerly the IDC HPC group – apparently you are not alone, says Steve Conway, now senior V Read more…

By John Russell

Nvidia’s Mammoth Volta GPU Aims High for AI, HPC

May 10, 2017

At Nvidia's GPU Technology Conference (GTC17) in San Jose, Calif., this morning, CEO Jensen Huang announced the company's much-anticipated Volta architecture a Read more…

By Tiffany Trader

HPE Launches Servers, Services, and Collaboration at GTC

May 10, 2017

Hewlett Packard Enterprise (HPE) today launched a new liquid cooled GPU-driven Apollo platform based on SGI ICE architecture, a new collaboration with NVIDIA, a Read more…

By John Russell

Quantum Bits: D-Wave and VW; Google Quantum Lab; IBM Expands Access

March 21, 2017

For a technology that’s usually characterized as far off and in a distant galaxy, quantum computing has been steadily picking up steam. Just how close real-wo Read more…

By John Russell

Trump Budget Targets NIH, DOE, and EPA; No Mention of NSF

March 16, 2017

President Trump’s proposed U.S. fiscal 2018 budget issued today sharply cuts science spending while bolstering military spending as he promised during the cam Read more…

By John Russell

Google Pulls Back the Covers on Its First Machine Learning Chip

April 6, 2017

This week Google released a report detailing the design and performance characteristics of the Tensor Processing Unit (TPU), its custom ASIC for the inference Read more…

By Tiffany Trader

HPC Compiler Company PathScale Seeks Life Raft

March 23, 2017

HPCwire has learned that HPC compiler company PathScale has fallen on difficult times and is asking the community for help or actively seeking a buyer for its a Read more…

By Tiffany Trader

CPU-based Visualization Positions for Exascale Supercomputing

March 16, 2017

Since our first formal product releases of OSPRay and OpenSWR libraries in 2016, CPU-based Software Defined Visualization (SDVis) has achieved wide-spread adopt Read more…

By Jim Jeffers, Principal Engineer and Engineering Leader, Intel

Nvidia Responds to Google TPU Benchmarking

April 10, 2017

Last week, Google reported that its custom ASIC Tensor Processing Unit (TPU) was 15-30x faster for inferencing workloads than Nvidia's K80 GPU (see our coverage Read more…

By Tiffany Trader

Nvidia’s Mammoth Volta GPU Aims High for AI, HPC

May 10, 2017

At Nvidia's GPU Technology Conference (GTC17) in San Jose, Calif., this morning, CEO Jensen Huang announced the company's much-anticipated Volta architecture a Read more…

By Tiffany Trader

TSUBAME3.0 Points to Future HPE Pascal-NVLink-OPA Server

February 17, 2017

Since our initial coverage of the TSUBAME3.0 supercomputer yesterday, more details have come to light on this innovative project. Of particular interest is a ne Read more…

By Tiffany Trader

Leading Solution Providers

Facebook Open Sources Caffe2; Nvidia, Intel Rush to Optimize

April 18, 2017

From its F8 developer conference in San Jose, Calif., today, Facebook announced Caffe2, a new open-source, cross-platform framework for deep learning. Caffe2 is Read more…

By Tiffany Trader

Tokyo Tech’s TSUBAME3.0 Will Be First HPE-SGI Super

February 16, 2017

In a press event Friday afternoon local time in Japan, Tokyo Institute of Technology (Tokyo Tech) announced its plans for the TSUBAME3.0 supercomputer, which w Read more…

By Tiffany Trader

Is Liquid Cooling Ready to Go Mainstream?

February 13, 2017

Lost in the frenzy of SC16 was a substantial rise in the number of vendors showing server oriented liquid cooling technologies. Three decades ago liquid cooling Read more…

By Steve Campbell

MIT Mathematician Spins Up 220,000-Core Google Compute Cluster

April 21, 2017

On Thursday, Google announced that MIT math professor and computational number theorist Andrew V. Sutherland had set a record for the largest Google Compute Eng Read more…

By Tiffany Trader

US Supercomputing Leaders Tackle the China Question

March 15, 2017

As China continues to prove its supercomputing mettle via the Top500 list and the forward march of its ambitious plans to stand up an exascale machine by 2020, Read more…

By Tiffany Trader

HPC Technique Propels Deep Learning at Scale

February 21, 2017

Researchers from Baidu's Silicon Valley AI Lab (SVAIL) have adapted a well-known HPC communication technique to boost the speed and scale of their neural networ Read more…

By Tiffany Trader

DOE Supercomputer Achieves Record 45-Qubit Quantum Simulation

April 13, 2017

In order to simulate larger and larger quantum systems and usher in an age of "quantum supremacy," researchers are stretching the limits of today's most advance Read more…

By Tiffany Trader

Knights Landing Processor with Omni-Path Makes Cloud Debut

April 18, 2017

HPC cloud specialist Rescale is partnering with Intel and HPC resource provider R Systems to offer first-ever cloud access to Xeon Phi "Knights Landing" process Read more…

By Tiffany Trader

  • arrow
  • Click Here for More Headlines
  • arrow
Share This