Thinking Forward: A Conversation with Wolfram Research Co-Founder Theo Gray

By Nicole Hemsoth

December 20, 2011

In 1987, Theodore (Theo) Gray, along with Stephen Wolfram, co-founded Wolfram Research and created its flagship product, Mathematica. Gray developed the concept of Mathematica notebook, which provides the main interface to the tool. Today, as the Director of User Interface Technology, he continues to guide the user interface strategy for Wolfram Research.

Besides his day job, Gray is also an award-winning science writer, a role he uses to communicate his unbounded enthusiasm for science, technology, the arts, and how they interact. Recently he founded Touch Press, an electronic book publishing company that Gray hopes will further that cause. In this wide-ranging interview, Gray talks about his new Touch Press venture, Wolfram|Alpha, science education, software, cloud computing, and HPC.

HPCwire: Theo, you recently founded a new company called Touch Press. What are your goals with this venture?

Gray: Touch Press is a publishing company that specializes in top-quality, highly interactive electronic books. We aim to surprise and delight people as they discover interests they never knew they had, through outstanding writing, outstanding visuals, and outstanding interactivity.

Out main goal is to invent and discover what books should be in the new world of electronic reading. We have a strong belief that “book” is as relevant a concept now as it ever has been. Even though you now have to talk about acoustic guitars and electric guitars, there is still a clear concept of what is or is not a guitar, and likewise “books” will always maintain a distinct identity as a calm place where an author can communicate a self-contained message to an interested reader.

HPCwire: One of the strengths of ‘The Elements’ app is its strong visual design. Aesthetics appears to be highly valued in your approach to application development. How important is design for Touch Press?

Gray: Visual design is important for some titles, less so for others where text or interactivity are the most important factors. The Elements is a coffee table photo book, so a strong aesthetic is key, along with beautiful photographs and engaging text. The Waste Land, our book about the iconic T.S. Eliot poem, relies less on visual design and more on clever and effective interactivity to bring the poem to life. But even there, good typography is important to make the reading experience pleasing, and good filmmaking is key to making Fiona Shaw’s filmed performance engaging.

HPCwire: In many ways, Touch Press brings art and science together. Is this an important goal for you?

Gray: Science is inherently beautiful, because science is about truth. And we like beautiful things. But science is not the only source of beauty in the world, and our titles do and will include poetry, fiction, music, theater, and the whole range of human expression, not just non-fiction science titles.

What we do insist be part of all of our titles is an appreciation for learning and discovery. We want people to be delighted with what they find, and delighted in themselves for finding it. Interactivity allows for a more engaging, wider ranging exploration of a topic than print allows, meaning that a wider range of people can find something to enjoy in a given topic.

HPCwire: What role does creativity play in collaborating across the various disciplines — coding, engineering, design, pedagogy — that come together in designing and producing rich applications?

Gray: A key strength of Touch Press is that we come from a combination of backgrounds including publishing, writing, television production, and software development. We strongly believe in the value of creativity in all areas of endeavor, including writing, visual production, and programming. Many traditional companies seem to fall down in one or another of these areas: Print publishing companies clearly understand that they need great authors, but often seem to think that programmers are hired grunts not deserving of much respect. Video game companies understand that programmers are the stars that make their products shine, but don’t seem to be able to put together two minutes of video that anyone wants to watch.

At Touch Press our goal is to combine the best of all these worlds to create great narratives, written by real writers, accompanied by great photography and video, held together and brought to life by top-notch user interface designers and developers who can make the hardware sing.

HPCwire: Clearly cloud computing has become the frame of reference for talking about software today. Has cloud computing changed your initial trajectory for developing applications for either Wolfram or Touch Press?

Gray: Wolfram’s apps are completely based on cloud computing: All the hard work is done on the server side by Wolfram|Alpha, because it would be completely out of the question to do that much work on an iPhone (let alone store the vast amounts of data and real-time feeds that Wolfram|Alpha has access to when formulating its answers).

This is one reason why Wolfram|Alpha was such a natural fit for Apple’s new Siri service, which uses cloud servers to answer questions from a wide range of subject areas. Even when asked to do a local task like add a reminder, Siri uses cloud computing to analyze the query, and if the conclusion is that it’s something Wolfram|Alpha can answer, our cloud is right there to supply the result.

Touch Press’ products use the cloud through their inclusion of Wolfram|Alpha results, but this is a more limited use, and generally speaking we try to keep as much content as possible on the device, in order to deliver a seamless, fluid experience.

HPCwire: How do you envision expanding the capacities of electronic books using technologies like Wolfram|Alpha in the decades to come? Could you imagine, for example, using data mining to build relevant data and/or support services across the books?

Gray: Books about factual subjects, which is to say books that refer to things in the real world, should, as much as possible, contain not copies of data but references to it, references that point to something in the cloud that can be kept up to date. Since it’s often not economical to maintain a special database just for a book that may have been published years ago, services like Wolfram|Alpha provide a convenient central repository that can provide updated, authoritative data for a wide range of books.

HPCwire: The multimedia nature of electronic books lends itself to extreme, storage, computation and analytical issues. What are some of the design challenges in the continued evolution of electronic books?

Gray: File size is definitely an issue for media-rich products, and providing a smooth, seamless user experience requires that as much of the media as possible be stored locally. Where that’s not possible, robust network and cloud storage can be the next best thing. And because devices often have limited local computational power, cloud computation can be even more important. A perfect example is Siri, just introduced by Apple, which does excellent voice recognition because it doesn’t try to do it on the device, but rather sends a compressed waveform to servers that are better able to handle this task.

HPCwire: Wolfram Research is particularly focused on the convergence of software innovation and science. How do you see high performance computing impacting science in the decades to come?

Gray: High performance computing is an instrument, like a microscope, and all instruments increase the range of what you can see and study. Large-scale numerical simulations are like very specialized measuring instruments, but potentially even more interesting are knowledge-processing systems that expand and magnify the power of human imagination.

A flexible, symbolic, linguistic computational tool allows scientists to explore spaces of possible solutions in ways not possible before. As usual, the more natural and “simple” the interface to computation, the harder the machine has to work behind the scenes to make it appear easy. Our goal is to allow people to ask questions of computers in simple ways, even if the answers require vast amounts of computation to determine.

HPCwire: This sounds fascinating. How might advanced computing change the way we deal with questions and challenges around big data and complexity?

Gray: The simplest example, and one that’s been around for a long time, is of course data visualization. A huge table of numbers is incomprehensible, but a graph, possibly of a highly processed form of the data, may show some obvious feature that makes a conclusion all but inevitable. But not all data is numerical or plotable, which is where symbolic analysis comes in. For example, an analysis of the network of references in Supreme Court opinions can reveal interesting insights into which Justices were the most influential in which areas of law, insights that are not at all obvious from simply reading all the opinions.

HPCwire: We know that digital technologies are having a huge impact on the hard sciences. Do you see technology having a unique impact on the humanities and social sciences?

Gray: Technology has arguably had as much or more influence on the arts than it has on science. Music and performance used to be ephemeral, now they have become defined by the existence of recording technology, and every advance in how such material is delivered changes the relationship of the artist to their audience.

The creation of a genuinely new medium is a rare thing. Paper, audio and video recordings, photography, radio, movies, television, computers, internet, and tablets. I think that tablets belong on this list not so much because of their present form, but as a representative of the future of people’s relationship with computing devices, one in which they are personal and intimate, something to lie in bed with, not to sit in front of.

This kind of relationship to computers is fundamentally more relevant to the arts and humanities than to hard science, and in fact one of the dangers to science is that as more and more people switch to more personal devices, the kinds of high-powered desktop systems used by scientists will become expensive exotics, rather than beefed up derivatives of mainstream devices.

HPCwire: You have been particularly influential in the development of advanced software applications for education. How do you see education changing as a result of innovations in technology?

Gray: Education is a hard nut to crack. At this point the most interesting applications of technology in education are happening outside schools. Kids have a completely different relationship to knowledge than we are used to. They take for granted that every possible bit of factual knowledge they might want is available instantly: Whole categories of argument and discussion don’t exist anymore because you can simply pull out your phone and get the answer. Many classes of computational problems simply aren’t problems anymore because the answer is at your fingertips using something like Wolfram|Alpha or Mathematica.

Schools are very slow to react to this kind of change, and it may be a generation before they catch up. In the meantime, a lot of actual education is happening outside the classroom environment, through home schooling, informal learning, online resources like Khan Academy, and other self-directed learning opportunities.

This is one of the reasons that Touch Press is not interested in publishing textbooks: We think that we can have more of an effect by publishing titles that people buy because they want to learn, not because someone is telling them they should. And while Wolfram|Alpha is a great learning resource in any context, it’s the kind of things kids are much more likely to discover on their own than through their teacher.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

US Exascale Computing Update with Paul Messina

December 8, 2016

Around the world, efforts are ramping up to cross the next major computing threshold with machines that are 50-100x more performant than today’s fastest number crunchers.  Read more…

By Tiffany Trader

Weekly Twitter Roundup (Dec. 8, 2016)

December 8, 2016

Here at HPCwire, we aim to keep the HPC community apprised of the most relevant and interesting news items that get tweeted throughout the week. Read more…

By Thomas Ayres

Qualcomm Targets Intel Datacenter Dominance with 10nm ARM-based Server Chip

December 8, 2016

Claiming no less than a reshaping of the future of Intel-dominated datacenter computing, Qualcomm Technologies, the market leader in smartphone chips, announced the forthcoming availability of what it says is the world’s first 10nm processor for servers, based on ARM Holding’s chip designs. Read more…

By Doug Black

Which Schools Produce the Top Coders in the World?

December 8, 2016

Ever wonder which universities worldwide produce the best coders? The answers may surprise you, at least as judged by the results of a competition posted yesterday on the HackerRank blog. Read more…

By John Russell

Enlisting Deep Learning in the War on Cancer

December 7, 2016

Sometime in Q2 2017 the first ‘results’ of the Joint Design of Advanced Computing Solutions for Cancer (JDACS4C) will become publicly available according to Rick Stevens. He leads one of three JDACS4C pilot projects pressing deep learning (DL) into service in the War on Cancer. The pilots, supported in part by DOE exascale funding, not only seek to do good by advancing cancer research and therapy but also to advance deep learning capabilities and infrastructure with an eye towards eventual use on exascale machines. Read more…

By John Russell

DDN Enables 50TB/Day Trans-Pacific Data Transfer for Yahoo Japan

December 6, 2016

Transferring data from one data center to another in search of lower regional energy costs isn’t a new concept, but Yahoo Japan is putting the idea into transcontinental effect with a system that transfers 50TB of data a day from Japan to the U.S., where electricity costs a quarter of the rates in Japan. Read more…

By Doug Black

Infographic Highlights Career of Admiral Grace Murray Hopper

December 5, 2016

Dr. Grace Murray Hopper (December 9, 1906 – January 1, 1992) was an early pioneer of computer science and one of the most famous women achievers in a field dominated by men. Read more…

By Staff

Ganthier, Turkel on the Dell EMC Road Ahead

December 5, 2016

Who is Dell EMC and why should you care? Glad you asked is Jim Ganthier’s quick response. Ganthier is SVP for validated solutions and high performance computing for the new (even bigger) technology giant Dell EMC following Dell’s acquisition of EMC in September. In this case, says Ganthier, the blending of the two companies is a 1+1 = 5 proposition. Not bad math if you can pull it off. Read more…

By John Russell

US Exascale Computing Update with Paul Messina

December 8, 2016

Around the world, efforts are ramping up to cross the next major computing threshold with machines that are 50-100x more performant than today’s fastest number crunchers.  Read more…

By Tiffany Trader

Enlisting Deep Learning in the War on Cancer

December 7, 2016

Sometime in Q2 2017 the first ‘results’ of the Joint Design of Advanced Computing Solutions for Cancer (JDACS4C) will become publicly available according to Rick Stevens. He leads one of three JDACS4C pilot projects pressing deep learning (DL) into service in the War on Cancer. The pilots, supported in part by DOE exascale funding, not only seek to do good by advancing cancer research and therapy but also to advance deep learning capabilities and infrastructure with an eye towards eventual use on exascale machines. Read more…

By John Russell

Ganthier, Turkel on the Dell EMC Road Ahead

December 5, 2016

Who is Dell EMC and why should you care? Glad you asked is Jim Ganthier’s quick response. Ganthier is SVP for validated solutions and high performance computing for the new (even bigger) technology giant Dell EMC following Dell’s acquisition of EMC in September. In this case, says Ganthier, the blending of the two companies is a 1+1 = 5 proposition. Not bad math if you can pull it off. Read more…

By John Russell

AWS Launches Massive 100 Petabyte ‘Sneakernet’

December 1, 2016

Amazon Web Services now offers a way to move data into its cloud by the truckload. Read more…

By Tiffany Trader

Lighting up Aurora: Behind the Scenes at the Creation of the DOE’s Upcoming 200 Petaflops Supercomputer

December 1, 2016

In April 2015, U.S. Department of Energy Undersecretary Franklin Orr announced that Intel would be the prime contractor for Aurora: Read more…

By Jan Rowell

Seagate-led SAGE Project Delivers Update on Exascale Goals

November 29, 2016

Roughly a year and a half after its launch, the SAGE exascale storage project led by Seagate has delivered a substantive interim report – Data Storage for Extreme Scale. Read more…

By John Russell

Nvidia Sees Bright Future for AI Supercomputing

November 23, 2016

Graphics chipmaker Nvidia made a strong showing at SC16 in Salt Lake City last week. Read more…

By Tiffany Trader

HPE-SGI to Tackle Exascale and Enterprise Targets

November 22, 2016

At first blush, and maybe second blush too, Hewlett Packard Enterprise’s (HPE) purchase of SGI seems like an unambiguous win-win. SGI’s advanced shared memory technology, its popular UV product line (Hanna), deep vertical market expertise, and services-led go-to-market capability all give HPE a leg up in its drive to remake itself. Bear in mind HPE came into existence just a year ago with the split of Hewlett-Packard. The computer landscape, including HPC, is shifting with still unclear consequences. One wonders who’s next on the deal block following Dell’s recent merger with EMC. Read more…

By John Russell

Why 2016 Is the Most Important Year in HPC in Over Two Decades

August 23, 2016

In 1994, two NASA employees connected 16 commodity workstations together using a standard Ethernet LAN and installed open-source message passing software that allowed their number-crunching scientific application to run on the whole “cluster” of machines as if it were a single entity. Read more…

By Vincent Natoli, Stone Ridge Technology

IBM Advances Against x86 with Power9

August 30, 2016

After offering OpenPower Summit attendees a limited preview in April, IBM is unveiling further details of its next-gen CPU, Power9, which the tech mainstay is counting on to regain market share ceded to rival Intel. Read more…

By Tiffany Trader

AWS Beats Azure to K80 General Availability

September 30, 2016

Amazon Web Services has seeded its cloud with Nvidia Tesla K80 GPUs to meet the growing demand for accelerated computing across an increasingly-diverse range of workloads. The P2 instance family is a welcome addition for compute- and data-focused users who were growing frustrated with the performance limitations of Amazon's G2 instances, which are backed by three-year-old Nvidia GRID K520 graphics cards. Read more…

By Tiffany Trader

The Exascale Computing Project Awards $39.8M to 22 Projects

September 7, 2016

The Department of Energy’s Exascale Computing Project (ECP) hit an important milestone today with the announcement of its first round of funding, moving the nation closer to its goal of reaching capable exascale computing by 2023. Read more…

By Tiffany Trader

Think Fast – Is Neuromorphic Computing Set to Leap Forward?

August 15, 2016

Steadily advancing neuromorphic computing technology has created high expectations for this fundamentally different approach to computing. Read more…

By John Russell

ARM Unveils Scalable Vector Extension for HPC at Hot Chips

August 22, 2016

ARM and Fujitsu today announced a scalable vector extension (SVE) to the ARMv8-A architecture intended to enhance ARM capabilities in HPC workloads. Fujitsu is the lead silicon partner in the effort (so far) and will use ARM with SVE technology in its post K computer, Japan’s next flagship supercomputer planned for the 2020 timeframe. This is an important incremental step for ARM, which seeks to push more aggressively into mainstream and HPC server markets. Read more…

By John Russell

IBM Debuts Power8 Chip with NVLink and Three New Systems

September 8, 2016

Not long after revealing more details about its next-gen Power9 chip due in 2017, IBM today rolled out three new Power8-based Linux servers and a new version of its Power8 chip featuring Nvidia’s NVLink interconnect. Read more…

By John Russell

Vectors: How the Old Became New Again in Supercomputing

September 26, 2016

Vector instructions, once a powerful performance innovation of supercomputing in the 1970s and 1980s became an obsolete technology in the 1990s. But like the mythical phoenix bird, vector instructions have arisen from the ashes. Here is the history of a technology that went from new to old then back to new. Read more…

By Lynd Stringer

Leading Solution Providers

US, China Vie for Supercomputing Supremacy

November 14, 2016

The 48th edition of the TOP500 list is fresh off the presses and while there is no new number one system, as previously teased by China, there are a number of notable entrants from the US and around the world and significant trends to report on. Read more…

By Tiffany Trader

Intel Launches Silicon Photonics Chip, Previews Next-Gen Phi for AI

August 18, 2016

At the Intel Developer Forum, held in San Francisco this week, Intel Senior Vice President and General Manager Diane Bryant announced the launch of Intel's Silicon Photonics product line and teased a brand-new Phi product, codenamed "Knights Mill," aimed at machine learning workloads. Read more…

By Tiffany Trader

CPU Benchmarking: Haswell Versus POWER8

June 2, 2015

With OpenPOWER activity ramping up and IBM’s prominent role in the upcoming DOE machines Summit and Sierra, it’s a good time to look at how the IBM POWER CPU stacks up against the x86 Xeon Haswell CPU from Intel. Read more…

By Tiffany Trader

Dell EMC Engineers Strategy to Democratize HPC

September 29, 2016

The freshly minted Dell EMC division of Dell Technologies is on a mission to take HPC mainstream with a strategy that hinges on engineered solutions, beginning with a focus on three industry verticals: manufacturing, research and life sciences. "Unlike traditional HPC where everybody bought parts, assembled parts and ran the workloads and did iterative engineering, we want folks to focus on time to innovation and let us worry about the infrastructure," said Jim Ganthier, senior vice president, validated solutions organization at Dell EMC Converged Platforms Solution Division. Read more…

By Tiffany Trader

Beyond von Neumann, Neuromorphic Computing Steadily Advances

March 21, 2016

Neuromorphic computing – brain inspired computing – has long been a tantalizing goal. The human brain does with around 20 watts what supercomputers do with megawatts. And power consumption isn’t the only difference. Fundamentally, brains ‘think differently’ than the von Neumann architecture-based computers. While neuromorphic computing progress has been intriguing, it has still not proven very practical. Read more…

By John Russell

Container App ‘Singularity’ Eases Scientific Computing

October 20, 2016

HPC container platform Singularity is just six months out from its 1.0 release but already is making inroads across the HPC research landscape. It's in use at Lawrence Berkeley National Laboratory (LBNL), where Singularity founder Gregory Kurtzer has worked in the High Performance Computing Services (HPCS) group for 16 years. Read more…

By Tiffany Trader

Micron, Intel Prepare to Launch 3D XPoint Memory

August 16, 2016

Micron Technology used last week’s Flash Memory Summit to roll out its new line of 3D XPoint memory technology jointly developed with Intel while demonstrating the technology in solid-state drives. Micron claimed its Quantx line delivers PCI Express (PCIe) SSD performance with read latencies at less than 10 microseconds and writes at less than 20 microseconds. Read more…

By George Leopold

D-Wave SC16 Update: What’s Bo Ewald Saying These Days

November 18, 2016

Tucked in a back section of the SC16 exhibit hall, quantum computing pioneer D-Wave has been talking up its new 2000-qubit processor announced in September. Forget for a moment the criticism sometimes aimed at D-Wave. This small Canadian company has sold several machines including, for example, ones to Lockheed and NASA, and has worked with Google on mapping machine learning problems to quantum computing. In July Los Alamos National Laboratory took possession of a 1000-quibit D-Wave 2X system that LANL ordered a year ago around the time of SC15. Read more…

By John Russell

  • arrow
  • Click Here for More Headlines
  • arrow
Share This