TORVALDS WROTE BOOK ON LINUX REVOLUTION

March 17, 2000

FEATURES & COMMENTARY

San Diego, CA — Linus Torvalds would make a lousy dictator, and it’s hard to imagine him as a corporate chief executive. Dan Gillmor reports that he laughingly calls himself lazy. He avoids making decisions about the growing, worldwide movement he leads – a movement that has turned him, in the eyes of many, into an icon of the Information Age.

“The best result,” he says, “is still what happens naturally.” Torvalds is the man who wrote a pivotal piece of software almost a decade ago – the code that became the core of the GNU/Linux operating system, better known as just plain Linux.

I was curious about what it took to guide a movement that started off as anything but a crusade. Torvalds’ answers were illuminating. The Linux movement is an army of volunteers, mostly unpaid

Leadership in the Linux universe is “getting people to trust you enough that they take your advice,” said Torvalds, who remains as strikingly soft-spoken and, yes, humble as he was when I first met him in Finland almost 4 years ago. (I should add that he’s developed quite the performer’s flair for certain tasks, such as giving keynote speeches at conferences.)

“Good leadership is always a matter of making people want to do things because of their own reasons rather than due to any external pressure,” he says. “And, probably, realizing when you’re wrong and deciding that it’s not worth it.”

Keep the word “trust” in your mind. It imbues everything about the Linux process as it has developed over the past decade. And in an era where technology is having such a massive impact on everything, it speaks to the way leadership itself must evolve.

Torvalds was a college student in Helsinki, Finland, back in 1991 when his role in the project first took shape. Building on work begun in the 1980s by the Free Software Foundation, which wanted to develop a free version of the Unix operating system, he wrote a “kernel,” the central component of any operating system and the core of what became Linux.

Leaders make decisions. What Torvalds did next was the linchpin of Linux’s future: He posted the kernel on the Internet and invited people to make suggestions and contributions. Today Linux is the poster child for what has become widely known as the “open source” software genre, in which the source code, or programming instructions, is openly available to others who then modify it and give their improvements back to the larger community.

Posting the kernel publicly “was obviously the best decision” in the entire process, he says. “But it was such a small one at the time. It only turned out to be a big one much, much later.”

From a tiny group of people at the start, Linux development ultimately drew in a global community of programmers. How, I ask, did all this come together? What was the process?

“It just happened by a kind of natural selection,” Torvalds says. “I’d been doing Linux as my own personal project, and I put it out (publicly) just because I wanted comments and because I thought that somebody else was interested, and, obviously, partly because I thought it was a really interesting project and it’s a way of just showing off.”

People tried it out. “Somebody said, ‘I need this feature,”‘ he says. ” And I took it not as a challenge, but more as (realizing), ‘Oh, that’s an extension I should have done anyway, or that’s one I’d maybe never use myself but I see why people would like that…’ ”

“So there were a lot of things that people asked for and also implemented themselves. They started out just asking for small things and then asking for larger things or doing them themselves, and none of this was very planned for. The leadership part came by default, because nobody wants to make decisions, right? Things just happened, and it wasn’t really planned. And I was the obvious person for it.”

The Linux development team would never fit into a corporate organizational chart. “It started out very flat – no organization, no hierarchy, because there weren’t that many people involved,” Torvalds said. “It was mainly an issue of my having told people, ‘Hey, I’m working on this project…’ I did it all by e-mail and, more than that, I did it all by personal e-mail…It was all one-to-one.”

It didn’t stay that way, of course. As the complexity grew, personal e-mails evolved into mail lists, where everything anyone posted to a single, central address automatically got delivered to everyone on the list. Then came public Internet discussions on Usenet newsgroups. Today, Linux developers communicate in a variety of online forums and even hold huge offline conventions.

Linux, like all operating systems, is a kernel plus a conglomerate of sub-systems. Think of the ongoing project, in a sense, as a house that’s constantly being expanded and renovated. Torvalds maintains control over the kernel – the foundation and basic floor plan – for the pre-release versions of Linux, the versions that aren’t considered stable enough for general distribution. Other people are in charge of fit and finish details, and in fact there are competing versions of those parts. But it’s essential for the kernel and central parts of the architecture to be consistent.

“I’ve actually tried to divest myself of the things that I wasn’t all that interested in,” Torvalds says. “So first it was getting rid of the user level” – external parts of the system that end users deal with directly, as opposed to the deep-down, internal code. And the moment somebody stepped up and said, ‘Hey, I think you should handle this that way,’ I said, ‘Go ahead! Do it!”‘

As Linux evolves, someone always “steps up and becomes the leader for a particular sub-system,” becoming what is sometimes called a ” maintainer” of a piece of the project. “Sometimes it’s one person having multiple sub-systems, sometimes it’s just one person for one sub-system. And it’s very much an organic process…It’s not as if there has been any voting (on who should be a maintainer). People just know who’s been active there and who they trust, and it just happens.”

The natural world is far from serene, as Darwin noted in his observations on evolution. Competition is a vital part of the Linux process, too. “Without rivalry – at least the potential for rivalry – you don’t get anything done,” Torvalds says. “So we’ve often had cases where there’s been two people maintaining very similar kinds of things, and what ends up happening is that I often accept both of them …and see which one ends up getting used. Sometimes what happens is that the two end up being two completely different things–they just evolve into different directions, and suddenly they aren’t very similar any more and they have very distinct uses.”

This kind of thing happens frequently with software drivers, which communicate with computer hardware such as disk drives, video cards, network connectors and the like. Hardware evolves, too, and a driver that worked well on several similar network cards, for example, may need revision.

If rivalries are common, bitter disputes are not, says Torvalds, who becomes the arbiter in those cases. Sometimes someone will post a ” patch”–code that changes some part of the system–that conflicts with someone else’s code.

“The only time I remember it getting nasty – (where) people started sending patches that fought the other person’s patches – I just told them ‘OK, I’m not accepting patches from either of you, and this driver’s dead as far as I’m concerned.’ A few months later, one of the maintainers had just lost interest.”

That contributor may have left the team with bad memories, “but the problem went away on its own, basically. So I made one decision. It happens, but it really is very rare.”

A leader who rarely makes decisions? What a concept. “I’m lazy, anyway,” Torvalds laughs. “Part of what I do is more of a ‘what I don’t do’ – trying to avoid making too many decisions, because eventually the best result is still what happens naturally.”

One of the things Torvalds puts in the “what I don’t do” category has been vital to the movement: “not being political with any of the (Linux) vendors.” That’s going to be difficult to maintain, I suggest, as Linux companies such as Red Hat and VA Linux Systems get bigger and more powerful.

“It hasn’t actually been that hard,” he says. “To some degree, the hardest part has been saying no to money (from vendors that want special treatment). There is so much money involved that sometimes…that’s the hardest choice to make, to say, ‘No, I am not going to do that.”‘ (While Torvalds hasn’t gone to work for or endorsed any Linux vendors, he has accepted stock options from several unnamed companies that wanted to reward him for his years of effort.)

The advantages of the Linux development method are plain enough. The expanding army of volunteers fills in holes and constantly refines the software. The project “scales well,” as Torvalds says in the jargon of the technology industry.

The major disadvantage, he observes, is that “some changes actually take a longer time. Linux is very well known for having evolved very quickly, but what really happens is that this kind of less organized, more networked way is really good at just tackling a lot of different problems.”

Because of its nature, Linux doesn’t have anyone, not even Torvalds, with the power to turn the project on a dime and say, “This is how it will be done,” and get them to do it. “And that’s when you get great things done sometimes – the Pyramids, the Great Wall of China, things that are still considered to be hard to do several thousand years later. So to some degree, dictatorship is wonderful. But it falls flat on its face because, while it has an upside, it also an immense downside, which is that when the dictator makes a mistake, there’s no safety net.”

The “do it my way or you’re fired” kind of leadership of the past has limitations in the Internet era, where creativity is a growing part of the average job description and a strong economy gives workers many job options. Coercion not only is less effective, but less efficient, in many ca ses. And with the Linux volunteer developers, it’s less than useless–it’s downright counterproductive.

People are motivated, Torvalds says, by survival, social order and entertainment. “You always start out being motivated by survival,” he says. “Once your survival is secured, you move up to social order–love, marriage, relationships.” When you feel secure with social order, you crave entertainment.

More than TV, I hope?

“Oh, yes. This is chess, this is going to the moon just because nobody’s been there before. This is Einstein kind of entertainment, too, where the entertainment is trying to figure out how the world works. But it’s also Linux kind of entertainment.”

“I refuse to provide people with the actual survival part, but these days Linux obviously does that, too,” with the explosion of commercial interest in the software and strong demand for Linux programmers. “But what Linux always has done – you get both the social part of having real social interactions with other people, even though it’s through e-mail, and you get the entertainment part. And you get it for free.”

============================================================

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

Harvard/Google use AI to help Produce Astonishing 3D Map of Brain Tissue

May 10, 2024

Although LLMs are getting all the notice lately, AI techniques of many varieties are being infused throughout science. For example, Harvard researchers, Google, and colleagues published a 3D map in Science this week that Read more…

ISC Preview: Focus Will Be on Top500 and HPC Diversity 

May 9, 2024

Last year's Supercomputing 2023 in November had record attendance, but the direction of high-performance computing was a hot topic on the floor. Expect more of that at the upcoming ISC High Performance 2024, which is hap Read more…

Processor Security: Taking the Wong Path

May 9, 2024

More research at UC San Diego revealed yet another side-channel attack on x86_64 processors. The research identified a new vulnerability that allows precise control of conditional branch prediction in modern processors.� Read more…

The Ultimate 2024 Winter Class Round-Up

May 8, 2024

To make navigating easier, we have compiled a collection of all the 2024 Winter Classic News in this single page round-up. Meet The Teams   Introducing Team Lobo This is the other team from University of New Mex Read more…

How the Chip Industry is Helping a Battery Company

May 8, 2024

Chip companies, once seen as engineering pure plays, are now at the center of geopolitical intrigue. Chip manufacturing firms, especially TSMC and Intel, have become the backbone of devices with an on/off switch. Thes Read more…

Illinois Considers $20 Billion Quantum Manhattan Project Says Report

May 7, 2024

There are multiple reports that Illinois governor Jay Robert Pritzker is considering a $20 billion Quantum Manhattan-like project for the Chicago area. According to the reports, photonics quantum computer developer PsiQu Read more…

ISC Preview: Focus Will Be on Top500 and HPC Diversity 

May 9, 2024

Last year's Supercomputing 2023 in November had record attendance, but the direction of high-performance computing was a hot topic on the floor. Expect more of Read more…

Illinois Considers $20 Billion Quantum Manhattan Project Says Report

May 7, 2024

There are multiple reports that Illinois governor Jay Robert Pritzker is considering a $20 billion Quantum Manhattan-like project for the Chicago area. Accordin Read more…

The NASA Black Hole Plunge

May 7, 2024

We have all thought about it. No one has done it, but now, thanks to HPC, we see what it looks like. Hold on to your feet because NASA has released videos of wh Read more…

How Nvidia Could Use $700M Run.ai Acquisition for AI Consumption

May 6, 2024

Nvidia is touching $2 trillion in market cap purely on the brute force of its GPU sales, and there's room for the company to grow with software. The company hop Read more…

Hyperion To Provide a Peek at Storage, File System Usage with Global Site Survey

May 3, 2024

Curious how the market for distributed file systems, interconnects, and high-end storage is playing out in 2024? Then you might be interested in the market anal Read more…

Qubit Watch: Intel Process, IBM’s Heron, APS March Meeting, PsiQuantum Platform, QED-C on Logistics, FS Comparison

May 1, 2024

Intel has long argued that leveraging its semiconductor manufacturing prowess and use of quantum dot qubits will help Intel emerge as a leader in the race to de Read more…

Stanford HAI AI Index Report: Science and Medicine

April 29, 2024

While AI tools are incredibly useful in a variety of industries, they truly shine when applied to solving problems in scientific and medical discovery. Research Read more…

IBM Delivers Qiskit 1.0 and Best Practices for Transitioning to It

April 29, 2024

After spending much of its December Quantum Summit discussing forthcoming quantum software development kit Qiskit 1.0 — the first full version — IBM quietly Read more…

Nvidia H100: Are 550,000 GPUs Enough for This Year?

August 17, 2023

The GPU Squeeze continues to place a premium on Nvidia H100 GPUs. In a recent Financial Times article, Nvidia reports that it expects to ship 550,000 of its lat Read more…

Synopsys Eats Ansys: Does HPC Get Indigestion?

February 8, 2024

Recently, it was announced that Synopsys is buying HPC tool developer Ansys. Started in Pittsburgh, Pa., in 1970 as Swanson Analysis Systems, Inc. (SASI) by John Swanson (and eventually renamed), Ansys serves the CAE (Computer Aided Engineering)/multiphysics engineering simulation market. Read more…

Intel’s Server and PC Chip Development Will Blur After 2025

January 15, 2024

Intel's dealing with much more than chip rivals breathing down its neck; it is simultaneously integrating a bevy of new technologies such as chiplets, artificia Read more…

Comparing NVIDIA A100 and NVIDIA L40S: Which GPU is Ideal for AI and Graphics-Intensive Workloads?

October 30, 2023

With long lead times for the NVIDIA H100 and A100 GPUs, many organizations are looking at the new NVIDIA L40S GPU, which it’s a new GPU optimized for AI and g Read more…

Choosing the Right GPU for LLM Inference and Training

December 11, 2023

Accelerating the training and inference processes of deep learning models is crucial for unleashing their true potential and NVIDIA GPUs have emerged as a game- Read more…

Shutterstock 1606064203

Meta’s Zuckerberg Puts Its AI Future in the Hands of 600,000 GPUs

January 25, 2024

In under two minutes, Meta's CEO, Mark Zuckerberg, laid out the company's AI plans, which included a plan to build an artificial intelligence system with the eq Read more…

AMD MI3000A

How AMD May Get Across the CUDA Moat

October 5, 2023

When discussing GenAI, the term "GPU" almost always enters the conversation and the topic often moves toward performance and access. Interestingly, the word "GPU" is assumed to mean "Nvidia" products. (As an aside, the popular Nvidia hardware used in GenAI are not technically... Read more…

Nvidia’s New Blackwell GPU Can Train AI Models with Trillions of Parameters

March 18, 2024

Nvidia's latest and fastest GPU, codenamed Blackwell, is here and will underpin the company's AI plans this year. The chip offers performance improvements from Read more…

Leading Solution Providers

Contributors

Shutterstock 1285747942

AMD’s Horsepower-packed MI300X GPU Beats Nvidia’s Upcoming H200

December 7, 2023

AMD and Nvidia are locked in an AI performance battle – much like the gaming GPU performance clash the companies have waged for decades. AMD has claimed it Read more…

Eyes on the Quantum Prize – D-Wave Says its Time is Now

January 30, 2024

Early quantum computing pioneer D-Wave again asserted – that at least for D-Wave – the commercial quantum era has begun. Speaking at its first in-person Ana Read more…

The GenAI Datacenter Squeeze Is Here

February 1, 2024

The immediate effect of the GenAI GPU Squeeze was to reduce availability, either direct purchase or cloud access, increase cost, and push demand through the roof. A secondary issue has been developing over the last several years. Even though your organization secured several racks... Read more…

Intel Plans Falcon Shores 2 GPU Supercomputing Chip for 2026  

August 8, 2023

Intel is planning to onboard a new version of the Falcon Shores chip in 2026, which is code-named Falcon Shores 2. The new product was announced by CEO Pat Gel Read more…

The NASA Black Hole Plunge

May 7, 2024

We have all thought about it. No one has done it, but now, thanks to HPC, we see what it looks like. Hold on to your feet because NASA has released videos of wh Read more…

GenAI Having Major Impact on Data Culture, Survey Says

February 21, 2024

While 2023 was the year of GenAI, the adoption rates for GenAI did not match expectations. Most organizations are continuing to invest in GenAI but are yet to Read more…

China Is All In on a RISC-V Future

January 8, 2024

The state of RISC-V in China was discussed in a recent report released by the Jamestown Foundation, a Washington, D.C.-based think tank. The report, entitled "E Read more…

Q&A with Nvidia’s Chief of DGX Systems on the DGX-GB200 Rack-scale System

March 27, 2024

Pictures of Nvidia's new flagship mega-server, the DGX GB200, on the GTC show floor got favorable reactions on social media for the sheer amount of computing po Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire