Intel Brings Parallel Computing to High School

By John E. West

July 30, 2009

Earlier this month Intel announced it was helping lead a parallel programming experience for high school students. The three-day “Clubhouse Parallel Universe Boot-Camp” was held at Brooklyn Technical High School (BTHS). This idea is consistent with Intel’s overall drive to help develop the expertise that applications developers — and ultimately users — need to get the most out of the company’s chips. There is a clear business driver here, but in this case, the business driver lines up well with the broader societal goals of enabling users and developers to do more with technology.

The project started with Jeffrey Birnbaum from the Bank of America. Birnbaum has lots of experience working on lock-free and parallel programming techniques for “low latency high throughput messaging systems” of the kind you find in finance. Birnbaum’s idea started with interactions he had with a high school student interested in parallel programming, and he saw an opportunity to start at the high school level to teach students to “think parallel.”

“If students start thinking parallel when they are first introduced to software development, it opens the door to new creative solutions that more experienced programmers might not attempt. In essence, the student minds have not been spoiled by old serial programming methodologies and experimentation when multi-core multi-socket systems did not exist,” says Birnbaum. “We are at the beginning of a new age in programming where the exploitation of advanced multi socket multicore systems to solve new and interesting problems requires developers who combine a “think parallel” mindset with the skill to execute.”

Birnbaum hooked up with Intel’s Bob Chesebrough, and they got together to implement the vision in the pilot program at BTHS. Fifteen students participated in the first workshop that wrapped up last week, and they wrote real code on hardware donated by Intel, IBM, and BLADE Network Technologies.

I think these kinds of efforts are tremendously important for the future of our community. Intel’s Head Software Evangelist, James Reinders, took part in the event and gave me some time over email to answer a few questions.

—–

HPCwire: Why target high schoolers? Parallel programming has traditionally been left to college. Are the students ready to grasp the concepts?

James Reinders: Because they are ready to learn it as they learn programming, there is no reason to wait. Of all the programmers, these are the ones that will be doing parallel programming their entire careers. Virtually every new computer is ready for parallel programming — multicore processors are everywhere now. So, programming is parallel programming — it is fundamental.

I’d say parallel programming in the past has been a graduate level activity because parallel programming has been a niche. It was not graduate level because it is too hard — it was graduate level because the machines to programming in parallel were scarce, and the topic affected only a minority of programmers. Now that it is fundamental, it is time to introduce early on in learning about programming. It should be part of teaching computer programming, not tacked on afterwards.

My first languages were assembly and BASIC. Neither taught structured programming nor data structures particularly. My professors whined about getting students that needed to be re-taught — some said it was worse than having us come in knowing nothing. I’m not sure I agree — but it’s absolutely true that teaching minds that are uncluttered has advantages.

I can tell you that the students we got were definitely ready for the material!

HPCwire: Regarding the involvement of Bank of America, it’s odd (but great) to see someone from the user side of the community so active in leading this effort. How did the concept develop? What made Intel want to team up with Birnbaum and BoA on this?

Reinders: Jeff Birnbaum is an energetic guy who’s hard to say “no” to! I really enjoy his enthusiasm — he knew we had an interest in teaching students but we were focused on universities. About the time we were crossing the one-thousand universities in our teach-parallel program (we started with 40 universities in 2006) — Jeff was the one that told us we should take this to a high school. For a few of us, he didn’t need to twist our arms, and we knew that actions speak louder than words.

Jeff pushed us to think about this seriously, secured some equipment support from IBM and Blade Network Technologies, and taught some himself on our day 3 — bringing together the concepts and making a deep application of it in analyzing some real code he shared from his work. Jeff also encouraged us to come out to New York City to teach a High School — and that seemed to be a fine idea, especially after we had the great fortune to hook up with Randy Asher, the principle at Brooklyn Technical High School.

HPCwire: Is this a one-off event, or will there be others? How did you get hooked up with Brooklyn Technical High School?

Reinders: I’m sure we’ll do more, but I’m not sure the exact form. We will be taking the student and teacher feedback, and seeing what we can do. Our small team of engineers from Intel that taught this are top notch experts with full time jobs. We might be able to sneak out of our jobs a time or two without our management missing us too much, but we might be missed if we tried to do this a lot more! With the universities, we started small and learned how to scale. We learned what worked and how to teach others to teach by sharing what we learned and developed. That’s the partnership that worked with universities. Something like that might be in the future for high schools. I hope so. Lots of work lies ahead to make it happen.

We actually had no pre-existing relationship with Brooklyn Technical High School — we got a few contacts in the New York school system and made a few cold calls. Next thing you know, we talked with Randy Asher. He’s the type of principle you want at a school — a huge advocate for bringing in challenge for the student and infectious in his commitment to make things happen. We were hooked. Randy’s the guy already talking about doing this again, and for more time (to earn credits), etc. I know all of us from Intel found it rewarding, and with Jeff and Randy pushing now, well, we probably have to do this again!

HPCwire: The workshop looks like three full days of student time — how did the school respond to this? Do the students have to make up the time?

Reinders: We did it during the summer, so the students didn’t have to take time off school. Doing it during school might be an option next time. One way we have to compete with summer jobs and summer vacations, and the other way we’d need to have them take off time from school for school (seems a bit funny). I’m not sure — but I suspect one or two weeks in summer will tend to work out better until we figure out how to incorporate content into regular computer science classes in high school. I think we’re learning things to let us consider both.

HPCwire: Now that the workshop is concluded can you give me some reactions from the teachers and students? Did they seem to get it? Enjoy it? Were they good at it? What did Intel learn about teaching parallel in this age group that will help shape your next event?

Reinders: We had 16 high school students plus five high school teachers in our class. We ultimately mixed teachers and students — and that worked very well. We did a short three-day — but could easily have expanded to a couple weeks.

One student told us the first day was boring, another said it was the best thing ever. They both actually got something out of it, but had different expectations. Their direct feedback is helpful. There is a lot of “let’s just DO IT” energy in the room. They had great attention span, and were very engaged, but were constantly eager to work on the computers. More lab time would have been popular I think. It was a little less than half the classroom time over three days. We split the rest of time between lectures and some hands-on exercises to simulate computer algorithms with activities — to help make things intuitive.

They all did very well. No student was “lost” by any means. Each exercise challenges each student in a different way — but ultimately they all understood the concepts and learned what we were hoping they would. By the third day, we had them changing our “Destroy the Castle” program (http://software.intel.com/en-us/articles/code-demo-destroy-the-castle/) — and we saw a lot of knowledge being used that they didn’t have the first day of the class. They added parallelism and improved the game a great deal (we gave it to them with the parallel programming removed from our downloadable version).

What did we learn? We validated that teaching at the high school level is appropriate. Those of us teaching got a little better handle on pacing and that will help us. We really reinforced the need to present basic concepts multiple ways (to drill home what a “data race” is, and “task decomposition”). We debated the relative merits, timing, etc. — I’m sure we have a better feel for it now. We also know if we expand time for the class, we would expand the hands-on time to be a higher percentage of the time. I’m interested to talk more with the high school teachers we had in our class, and see what more feedback they have. I think we have to digest the experience and feedback more — and we’ve learned a lot that will help us next time.

Bottom-line: if someone else considers doing this, we have experience that we would share to help others! Now, if we can find the time to write it down, we will. Hopefully soon.

HPCwire: Was the hardware taken on site? Were there logistical challenges (from the mundane, like cabbing a cluster across NY, to the specific, like was there enough power) and how did you address them?

Reinders: As funny as a 32-core cluster in a New York taxi would have been, we didn’t go that way. We used the power of the Internet. Blade Network Technology loaned space and expertise in their Santa Clara facility — and IBM provided the 32 core cluster, and Intel provided four 8-core machines. We used them remotely over the Internet from New York. In New York, we used BTHS machines (every student had a dual-core machine) and we brought along 16 dual-core laptops, and an 8-core machine. Those we shipped, and they were just here at BTHS for us. One of the benefits of being at BTHS was that they had plenty of capability for power and cooling for us, that was easy. It is often a concern as you look where to teach, but at BTHS that was not an issue — they have fantastic facilities, which made this easy. And their alumni association kicked in money to feed the students lunch — which was very much appreciated too.

HPCwire: I suspect this effort might inspire others to do something similar in their own community. Would you welcome others to adopt the curriculum in their own communities? What kind of support would there be for those wanting to take such a step?

Reinders: I’d love to be contacted by people with a serious interest in doing this at other high schools. They can drop a note to me at Intel — e-mail: [email protected].

HPCwire: I know that Intel has a big effort in education, so I’m going to do the natural thing and ask you to boil it down to a couple sentences so readers are more aware of the range of your efforts.

Reinders: We know that young people are the key to solving global challenges, and a solid math and science foundation coupled with skills such as critical thinking, collaboration, and digital literacy are crucial for their success. That is why we get directly involved in education programs, advocacy, and technology access to enable tomorrow’s innovators. Intel’s education outreach includes K-12 education, education competitions, high education and outside the classroom programs — see http://intel.com/education. Focusing on our outreach for computer science instruction in particular — we have our Intel Academic Program (“Teach Parallel”) that instructors can learn more about at http://intel.com/software/college.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

Q&A with Nvidia’s Chief of DGX Systems on the DGX-GB200 Rack-scale System

March 27, 2024

Pictures of Nvidia's new flagship mega-server, the DGX GB200, on the GTC show floor got favorable reactions on social media for the sheer amount of computing power it brings to artificial intelligence.  Nvidia's DGX Read more…

Call for Participation in Workshop on Potential NSF CISE Quantum Initiative

March 26, 2024

Editor’s Note: Next month there will be a workshop to discuss what a quantum initiative led by NSF’s Computer, Information Science and Engineering (CISE) directorate could entail. The details are posted below in a Ca Read more…

Waseda U. Researchers Reports New Quantum Algorithm for Speeding Optimization

March 25, 2024

Optimization problems cover a wide range of applications and are often cited as good candidates for quantum computing. However, the execution time for constrained combinatorial optimization applications on quantum device Read more…

NVLink: Faster Interconnects and Switches to Help Relieve Data Bottlenecks

March 25, 2024

Nvidia’s new Blackwell architecture may have stolen the show this week at the GPU Technology Conference in San Jose, California. But an emerging bottleneck at the network layer threatens to make bigger and brawnier pro Read more…

Who is David Blackwell?

March 22, 2024

During GTC24, co-founder and president of NVIDIA Jensen Huang unveiled the Blackwell GPU. This GPU itself is heavily optimized for AI work, boasting 192GB of HBM3E memory as well as the the ability to train 1 trillion pa Read more…

Nvidia Appoints Andy Grant as EMEA Director of Supercomputing, Higher Education, and AI

March 22, 2024

Nvidia recently appointed Andy Grant as Director, Supercomputing, Higher Education, and AI for Europe, the Middle East, and Africa (EMEA). With over 25 years of high-performance computing (HPC) experience, Grant brings a Read more…

Q&A with Nvidia’s Chief of DGX Systems on the DGX-GB200 Rack-scale System

March 27, 2024

Pictures of Nvidia's new flagship mega-server, the DGX GB200, on the GTC show floor got favorable reactions on social media for the sheer amount of computing po Read more…

NVLink: Faster Interconnects and Switches to Help Relieve Data Bottlenecks

March 25, 2024

Nvidia’s new Blackwell architecture may have stolen the show this week at the GPU Technology Conference in San Jose, California. But an emerging bottleneck at Read more…

Who is David Blackwell?

March 22, 2024

During GTC24, co-founder and president of NVIDIA Jensen Huang unveiled the Blackwell GPU. This GPU itself is heavily optimized for AI work, boasting 192GB of HB Read more…

Nvidia Looks to Accelerate GenAI Adoption with NIM

March 19, 2024

Today at the GPU Technology Conference, Nvidia launched a new offering aimed at helping customers quickly deploy their generative AI applications in a secure, s Read more…

The Generative AI Future Is Now, Nvidia’s Huang Says

March 19, 2024

We are in the early days of a transformative shift in how business gets done thanks to the advent of generative AI, according to Nvidia CEO and cofounder Jensen Read more…

Nvidia’s New Blackwell GPU Can Train AI Models with Trillions of Parameters

March 18, 2024

Nvidia's latest and fastest GPU, codenamed Blackwell, is here and will underpin the company's AI plans this year. The chip offers performance improvements from Read more…

Nvidia Showcases Quantum Cloud, Expanding Quantum Portfolio at GTC24

March 18, 2024

Nvidia’s barrage of quantum news at GTC24 this week includes new products, signature collaborations, and a new Nvidia Quantum Cloud for quantum developers. Wh Read more…

Houston We Have a Solution: Addressing the HPC and Tech Talent Gap

March 15, 2024

Generations of Houstonian teachers, counselors, and parents have either worked in the aerospace industry or know people who do - the prospect of entering the fi Read more…

Alibaba Shuts Down its Quantum Computing Effort

November 30, 2023

In case you missed it, China’s e-commerce giant Alibaba has shut down its quantum computing research effort. It’s not entirely clear what drove the change. Read more…

Nvidia H100: Are 550,000 GPUs Enough for This Year?

August 17, 2023

The GPU Squeeze continues to place a premium on Nvidia H100 GPUs. In a recent Financial Times article, Nvidia reports that it expects to ship 550,000 of its lat Read more…

Shutterstock 1285747942

AMD’s Horsepower-packed MI300X GPU Beats Nvidia’s Upcoming H200

December 7, 2023

AMD and Nvidia are locked in an AI performance battle – much like the gaming GPU performance clash the companies have waged for decades. AMD has claimed it Read more…

DoD Takes a Long View of Quantum Computing

December 19, 2023

Given the large sums tied to expensive weapon systems – think $100-million-plus per F-35 fighter – it’s easy to forget the U.S. Department of Defense is a Read more…

Synopsys Eats Ansys: Does HPC Get Indigestion?

February 8, 2024

Recently, it was announced that Synopsys is buying HPC tool developer Ansys. Started in Pittsburgh, Pa., in 1970 as Swanson Analysis Systems, Inc. (SASI) by John Swanson (and eventually renamed), Ansys serves the CAE (Computer Aided Engineering)/multiphysics engineering simulation market. Read more…

Choosing the Right GPU for LLM Inference and Training

December 11, 2023

Accelerating the training and inference processes of deep learning models is crucial for unleashing their true potential and NVIDIA GPUs have emerged as a game- Read more…

Intel’s Server and PC Chip Development Will Blur After 2025

January 15, 2024

Intel's dealing with much more than chip rivals breathing down its neck; it is simultaneously integrating a bevy of new technologies such as chiplets, artificia Read more…

Baidu Exits Quantum, Closely Following Alibaba’s Earlier Move

January 5, 2024

Reuters reported this week that Baidu, China’s giant e-commerce and services provider, is exiting the quantum computing development arena. Reuters reported � Read more…

Leading Solution Providers

Contributors

Comparing NVIDIA A100 and NVIDIA L40S: Which GPU is Ideal for AI and Graphics-Intensive Workloads?

October 30, 2023

With long lead times for the NVIDIA H100 and A100 GPUs, many organizations are looking at the new NVIDIA L40S GPU, which it’s a new GPU optimized for AI and g Read more…

Shutterstock 1179408610

Google Addresses the Mysteries of Its Hypercomputer 

December 28, 2023

When Google launched its Hypercomputer earlier this month (December 2023), the first reaction was, "Say what?" It turns out that the Hypercomputer is Google's t Read more…

AMD MI3000A

How AMD May Get Across the CUDA Moat

October 5, 2023

When discussing GenAI, the term "GPU" almost always enters the conversation and the topic often moves toward performance and access. Interestingly, the word "GPU" is assumed to mean "Nvidia" products. (As an aside, the popular Nvidia hardware used in GenAI are not technically... Read more…

Shutterstock 1606064203

Meta’s Zuckerberg Puts Its AI Future in the Hands of 600,000 GPUs

January 25, 2024

In under two minutes, Meta's CEO, Mark Zuckerberg, laid out the company's AI plans, which included a plan to build an artificial intelligence system with the eq Read more…

Google Introduces ‘Hypercomputer’ to Its AI Infrastructure

December 11, 2023

Google ran out of monikers to describe its new AI system released on December 7. Supercomputer perhaps wasn't an apt description, so it settled on Hypercomputer Read more…

China Is All In on a RISC-V Future

January 8, 2024

The state of RISC-V in China was discussed in a recent report released by the Jamestown Foundation, a Washington, D.C.-based think tank. The report, entitled "E Read more…

Intel Won’t Have a Xeon Max Chip with New Emerald Rapids CPU

December 14, 2023

As expected, Intel officially announced its 5th generation Xeon server chips codenamed Emerald Rapids at an event in New York City, where the focus was really o Read more…

IBM Quantum Summit: Two New QPUs, Upgraded Qiskit, 10-year Roadmap and More

December 4, 2023

IBM kicks off its annual Quantum Summit today and will announce a broad range of advances including its much-anticipated 1121-qubit Condor QPU, a smaller 133-qu Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire