StackIQ Widens Net

By Steve Campbell

August 31, 2011

Continuing adventures in San Diego led me to StackIQ to meet with President and Co-founder Tim McIntire. Many of you will know StackIQ by their original name Clustercorp and the highly successful HPC cluster management suite Rocks.

Rocks was first developed at UCSD, circa 2000, and over a ten-year period, there are over ten thousand Rocks clusters worldwide. Many in traditional HPC environments but also growing installed base in the enterprises such as Aerospace, Automotive, Oil and Gas.  The one thing in common is managing large cluster installations in environments generating and processing vast amounts of data.

It is clearly an exciting time for StackIQ; a new name, new funding in place, new location and two of the original Rocks co-founders Greg Bruno and Mason Katz recently joining the team full time. More importantly, however, is the growing list of new customers for Rocks in their traditional HPC community and growing commercial enterprise installed base.

StackIQ is seeing growing acceptance in the new market segments of big data and naturally cloud computing. Recent alliances with Amazon for a port of Rocks to EC2 together with a recently announced OEM relationship with Amazon. In addition, their HPC expertise and heritage is well suited to Big Data solutions such as Apache Hadoop, Cassandra and others.  Rocks enables Hadoop clusters to be deployed in fraction of the time compared to conventional methods, StackIQ put a lot of emphasis on the ease of use and ease of deployment.

HPCc: You recently changed the company name from Clustercorp to StackIQ.  What’s behind the name change?

McIntire: Many people associated our previous name exclusively with High Performance Computing  (HPC). We wanted to change our name to better reflect what we do, which is to apply a decade of cluster computing expertize and experience to full-stack enterprise automation.
 
HPCc: I heard you also closed a round of financing.  Was this a private round or VC round and what can you tell me about it?

McIntire: It was a VC round, Series A. We secured the funding we needed to take the company to the next level by bringing in the resources to address the cloud and big data markets. We are very excited to be working with both Avalon Ventures and Anthem Venture Partners.
 
HPCc: How do you plan to spend the dollars raised?

McIntire: Some of it is focused on accelerating product development in the cloud and big data market segments while maintaining our leadership position in HPC. Some is earmarked to help us get our message out. We’ve been quite fortunate in building a strong community in the HPC space, but we need to let people outside of HPC know how much easier things are when you use Rocks+ to deploy and manage their servers.
 
HPCc: When I look at your website it is very clear that you have three distinct yet related segments, Clouds, Clusters and Big Data?  Starting with Clouds what is the plan?

McIntire: I’m glad you asked. Rocks is a horizontal platform for building out scalable solutions, but one of the things that made Rocks so successful in the cluster space was its ability to nail down a vertical solution (HPC) into a single, integrated stack. Open Source Rocks provided the first turnkey downloadable cluster ISO that allowed anybody — even researchers with little to no system administration experience — to build and manage a supercomputer.  

We are approaching the Cloud and Big Data verticals with the same strategy. You’ll notice that there is a complete downloadable stack for each of the segments on our website, so aspiring cloud and big data administrators can leverage the same simple turnkey solution we offer for HPC community. In addition, it’s free to use for clusters of up to 16 nodes.
 
HPCc: What about HPC clusters?

McIntire: Our roots are in HPC, and we’re proud of our position as the market leader in the HPC cluster management space. We are actively developing our HPC product line, and remain committed to delivering the best-of-breed cluster management solution for open source and commercial users.
 
There is a growing discussion of Big Data. What is your vision and why is this important to StackIQ and why is it such a hot topic in the world of data management?

The need to extract value from ever-growing volumes of both structured, and unstructured data is very real, and represents a tremendous business opportunity.

Apache Hadoop is a powerful, accessible open source tool that many are turning to, and at the heart of every Hadoop solution lies a high-performance cluster. Our HPC heritage puts us in the perfect position to bring best-of-breed technology to the foundation of Big Data solutions such as Apache Hadoop, Cassandra, and others. By laying the foundation of a rock-solid, predictable, reliable cluster at the base of each big data installation, Rocks+ leaves our customers free to focus on the business problem they’re trying to solve. Using conventional methods, building a working Hadoop solution can take weeks or months. Using our products, customers can bring up their Hadoop cluster in minutes.

HPCc: What’s the intersection of Big Data with Cloud Computing?

McIntire: The most interesting intersection I’ve seen is Amazon’s Elastic Map Reduce (EMR). Here, you have a market leading public cloud provider with customers who are generating a tremendous amount of data in the cloud. Rather than making customers deal with the difficult problem of downloading their data to a Hadoop cluster for analysis, Amazon brought compute to the data. They now have a very strong position in the big data space.

HPCc: Speaking of Amazon, are you also working to solve management problems in public cloud?

McIntire: Yes, one of our first cloud projects was a deep port of Rocks to support Amazon EC2. In June, we announced that Amazon has OEM’d Rocks+ (in much the same way they’ve done with Red Hat Enterprise Linux and Microsoft Windows) and now offers Rocks+ as an instance type. Thanks to Amazon, administrators can use the exact same management tools in public clouds that they use in their own data center. This can be a tremendous advantage. For example, you could leverage EC2 for development and testing purposes, running our Hadoop Roll there, tweak it to suit your needs, or you might even develop your own Roll. Then, should you decide to move your project in-house for large-scale deployment, you could simply download your Roll as an ISO and do complete bare metal provisioning of an in-house private cloud. You’d even have the same automated check-box installation Rocks users have become accustomed to.  

HPCc: You have been very successful with Rocks in the traditional HPC market. Are you changing direction and going after the commercial enterprise and if so why?

McIntire: The customers for our Cloud and Big Data solutions are primarily enterprises, but we’ve already seen great penetration in the enterprise HPC space. Therefore, while we are indeed marketing to the enterprise, we don’t see it as a change of direction. It’s just the next step along the path we were already on — bringing the power of Rocks to everyone who needs it.

HPCc: Can you do both markets? Do you have resources people and funds for both?

McIntire: Yes, one of the neat things about Rocks is its modularity.  Much of the work we do is applicable to all three verticals, which gives us a multiplying effect on the development side. By combining our architecture, leveraging the funding we talked about earlier, and some incredible work done by our partner network, we have everything we need to get the job done.
 
HPCc: Who is your primary competition and why should potential prospect choose you?

McIntire: There is no other product that can spin up Clouds, HPC Clusters, and Hadoop Clusters with the ease and efficiency of Rocks+. However, we do run in to different companies in certain spaces. Fortunately for us, most of them are in the early days of discovering all the ins and outs of deploying and managing large groups of connected servers at scale.

What we’ve seen is that people can be fairly successful in building small-scale clusters using less powerful tools, but once they grow beyond the test and proof-of-concept stage, the processes they’d been using fall short. We recommend people start with the end in mind, and use a proven cloud and cluster power tool right from the start. We make that easy by offering it free for clusters up to 16 nodes.
 
HPCc: What is you product roadmap, what’s next?

McIntire: I don’t like talking too far into the future when it comes to product features, however, there are some key items that are under development now.

We have a project underway that will significantly improve the Rocks user interface. We are also broadening the Big Data product line to include Cassandra, and plan to add other Big Data services to that package in the future as well.

In the Cloud space, work is well underway on an OpenStack product, and we are adding new capabilities to our Amazon EC2 offering. We’re also pushing ahead on the open source Rocks project, and plan to contribute RHEL and CentOS 6 support soon.
 
What’s your go to market approach?

We have a three-pronged Go-to-market approach:

-Hardware partners resell our software stacks to their customers to go along with their servers. Our current partners include Dell and HP, who have both given us tremendous support considering our company size.  Amazon, while not a traditional hardware partner, also fits into this channel go-to-market strategy.

-We also have a strong ISV partner network — we realize that our customers have a wide breadth of needs — our strategy here has always been to be supportive, yet agnostic at the applications layer.  For instance in HPC, we have Rocks Rolls for

Adaptive Computing’s Moab, Univa Grid Engine, and Altair PBS Pro.  You’ll notice we are executing the same strategy in the Big Data space, as we’ve already rolled out support for Apache Hadoop, MapR, and Cloudera.  In the coming months, you’ll see this list continue to grow.

-Lastly, StackIQ works directly with a number of customers who have pre-existing hardware and/or heterogeneous data centers.  Direct customers are usually more on the hyper-scale end of the size spectrum.  

What are the big trends you are seeing and how do they impact your vision?

We see a continuation of the trend towards more data and more compute — clusters are now mission critical to enterprise.  StackIQ is in the unique position of participating in a leading edge market segment with a mature, robust software solution.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

CMU’s Latest “Card Shark” – Libratus – is Beating the Poker Pros (Again)

January 20, 2017

It’s starting to look like Carnegie Mellon University has a gambling problem – can’t stay away from the poker table. Read more…

By John Russell

IDG to Be Bought by Chinese Investors; IDC to Spin Out HPC Group

January 19, 2017

US-based publishing and investment firm International Data Group, Inc. (IDG) will be acquired by a pair of Chinese investors, China Oceanwide Holdings Group Co., Ltd. Read more…

By Tiffany Trader

Weekly Twitter Roundup (Jan. 19, 2017)

January 19, 2017

Here at HPCwire, we aim to keep the HPC community apprised of the most relevant and interesting news items that get tweeted throughout the week. Read more…

By Thomas Ayres

France’s CEA and Japan’s RIKEN to Partner on ARM and Exascale

January 19, 2017

France’s CEA and Japan’s RIKEN institute announced a multi-faceted five-year collaboration to advance HPC generally and prepare for exascale computing. Among the particulars are efforts to: build out the ARM ecosystem; work on code development and code sharing on the existing and future platforms; share expertise in specific application areas (material and seismic sciences for example); improve techniques for using numerical simulation with big data; and expand HPC workforce training. It seems to be a very full agenda. Read more…

By Nishi Katsuya and John Russell

HPE Extreme Performance Solutions

Remote Visualization: An Integral Technology for Upstream Oil & Gas

As the exploration and production (E&P) of natural resources evolves into an even more complex and vital task, visualization technology has become integral for the upstream oil and gas industry. Read more…

ARM Waving: Attention, Deployments, and Development

January 18, 2017

It’s been a heady two weeks for the ARM HPC advocacy camp. At this week’s Mont-Blanc Project meeting held at the Barcelona Supercomputer Center, Cray announced plans to build an ARM-based supercomputer in the U.K. while Mont-Blanc selected Cavium’s ThunderX2 ARM chip for its third phase of development. Last week, France’s CEA and Japan’s Riken announced a deep collaboration aimed largely at fostering the ARM ecosystem. This activity follows a busy 2016 when SoftBank acquired ARM, OpenHPC announced ARM support, ARM released its SVE spec, Fujistu chose ARM for the post K machine, and ARM acquired HPC tool provider Allinea in December. Read more…

By John Russell

Women Coders from Russia, Italy, and Poland Top Study

January 17, 2017

According to a study posted on HackerRank today the best women coders as judged by performance on HackerRank challenges come from Russia, Italy, and Poland. Read more…

By John Russell

Spurred by Global Ambitions, Inspur in Joint HPC Deal with DDN

January 17, 2017

Inspur, the fast-growth cloud computing and server vendor from China that has several systems on the current Top500 list, and DDN, a leader in high-end storage, have announced a joint sales and marketing agreement to produce solutions based on DDN storage platforms integrated with servers, networking, software and services from Inspur. Read more…

By Doug Black

Weekly Twitter Roundup (Jan. 12, 2017)

January 12, 2017

Here at HPCwire, we aim to keep the HPC community apprised of the most relevant and interesting news items that get tweeted throughout the week. Read more…

By Thomas Ayres

IDG to Be Bought by Chinese Investors; IDC to Spin Out HPC Group

January 19, 2017

US-based publishing and investment firm International Data Group, Inc. (IDG) will be acquired by a pair of Chinese investors, China Oceanwide Holdings Group Co., Ltd. Read more…

By Tiffany Trader

France’s CEA and Japan’s RIKEN to Partner on ARM and Exascale

January 19, 2017

France’s CEA and Japan’s RIKEN institute announced a multi-faceted five-year collaboration to advance HPC generally and prepare for exascale computing. Among the particulars are efforts to: build out the ARM ecosystem; work on code development and code sharing on the existing and future platforms; share expertise in specific application areas (material and seismic sciences for example); improve techniques for using numerical simulation with big data; and expand HPC workforce training. It seems to be a very full agenda. Read more…

By Nishi Katsuya and John Russell

ARM Waving: Attention, Deployments, and Development

January 18, 2017

It’s been a heady two weeks for the ARM HPC advocacy camp. At this week’s Mont-Blanc Project meeting held at the Barcelona Supercomputer Center, Cray announced plans to build an ARM-based supercomputer in the U.K. while Mont-Blanc selected Cavium’s ThunderX2 ARM chip for its third phase of development. Last week, France’s CEA and Japan’s Riken announced a deep collaboration aimed largely at fostering the ARM ecosystem. This activity follows a busy 2016 when SoftBank acquired ARM, OpenHPC announced ARM support, ARM released its SVE spec, Fujistu chose ARM for the post K machine, and ARM acquired HPC tool provider Allinea in December. Read more…

By John Russell

Spurred by Global Ambitions, Inspur in Joint HPC Deal with DDN

January 17, 2017

Inspur, the fast-growth cloud computing and server vendor from China that has several systems on the current Top500 list, and DDN, a leader in high-end storage, have announced a joint sales and marketing agreement to produce solutions based on DDN storage platforms integrated with servers, networking, software and services from Inspur. Read more…

By Doug Black

For IBM/OpenPOWER: Success in 2017 = (Volume) Sales

January 11, 2017

To a large degree IBM and the OpenPOWER Foundation have done what they said they would – assembling a substantial and growing ecosystem and bringing Power-based products to market, all in about three years. Read more…

By John Russell

UberCloud Cites Progress in HPC Cloud Computing

January 10, 2017

200 HPC cloud experiments, 80 case studies, and a ton of hands-on experience gained, that’s the harvest of four years of UberCloud HPC Experiments. Read more…

By Wolfgang Gentzsch and Burak Yenier

A Conversation with Women in HPC Director Toni Collis

January 6, 2017

In this SC16 video interview, HPCwire Managing Editor Tiffany Trader sits down with Toni Collis, the director and founder of the Women in HPC (WHPC) network, to discuss the strides made since the organization’s debut in 2014. Read more…

By Tiffany Trader

BioTeam’s Berman Charts 2017 HPC Trends in Life Sciences

January 4, 2017

Twenty years ago high performance computing was nearly absent from life sciences. Today it’s used throughout life sciences and biomedical research. Genomics and the data deluge from modern lab instruments are the main drivers, but so is the longer-term desire to perform predictive simulation in support of Precision Medicine (PM). There’s even a specialized life sciences supercomputer, ‘Anton’ from D.E. Shaw Research, and the Pittsburgh Supercomputing Center is standing up its second Anton 2 and actively soliciting project proposals. There’s a lot going on. Read more…

By John Russell

AWS Beats Azure to K80 General Availability

September 30, 2016

Amazon Web Services has seeded its cloud with Nvidia Tesla K80 GPUs to meet the growing demand for accelerated computing across an increasingly-diverse range of workloads. The P2 instance family is a welcome addition for compute- and data-focused users who were growing frustrated with the performance limitations of Amazon's G2 instances, which are backed by three-year-old Nvidia GRID K520 graphics cards. Read more…

By Tiffany Trader

US, China Vie for Supercomputing Supremacy

November 14, 2016

The 48th edition of the TOP500 list is fresh off the presses and while there is no new number one system, as previously teased by China, there are a number of notable entrants from the US and around the world and significant trends to report on. Read more…

By Tiffany Trader

For IBM/OpenPOWER: Success in 2017 = (Volume) Sales

January 11, 2017

To a large degree IBM and the OpenPOWER Foundation have done what they said they would – assembling a substantial and growing ecosystem and bringing Power-based products to market, all in about three years. Read more…

By John Russell

Vectors: How the Old Became New Again in Supercomputing

September 26, 2016

Vector instructions, once a powerful performance innovation of supercomputing in the 1970s and 1980s became an obsolete technology in the 1990s. But like the mythical phoenix bird, vector instructions have arisen from the ashes. Here is the history of a technology that went from new to old then back to new. Read more…

By Lynd Stringer

Container App ‘Singularity’ Eases Scientific Computing

October 20, 2016

HPC container platform Singularity is just six months out from its 1.0 release but already is making inroads across the HPC research landscape. It's in use at Lawrence Berkeley National Laboratory (LBNL), where Singularity founder Gregory Kurtzer has worked in the High Performance Computing Services (HPCS) group for 16 years. Read more…

By Tiffany Trader

Dell EMC Engineers Strategy to Democratize HPC

September 29, 2016

The freshly minted Dell EMC division of Dell Technologies is on a mission to take HPC mainstream with a strategy that hinges on engineered solutions, beginning with a focus on three industry verticals: manufacturing, research and life sciences. "Unlike traditional HPC where everybody bought parts, assembled parts and ran the workloads and did iterative engineering, we want folks to focus on time to innovation and let us worry about the infrastructure," said Jim Ganthier, senior vice president, validated solutions organization at Dell EMC Converged Platforms Solution Division. Read more…

By Tiffany Trader

Enlisting Deep Learning in the War on Cancer

December 7, 2016

Sometime in Q2 2017 the first ‘results’ of the Joint Design of Advanced Computing Solutions for Cancer (JDACS4C) will become publicly available according to Rick Stevens. He leads one of three JDACS4C pilot projects pressing deep learning (DL) into service in the War on Cancer. Read more…

By John Russell

Lighting up Aurora: Behind the Scenes at the Creation of the DOE’s Upcoming 200 Petaflops Supercomputer

December 1, 2016

In April 2015, U.S. Department of Energy Undersecretary Franklin Orr announced that Intel would be the prime contractor for Aurora: Read more…

By Jan Rowell

Leading Solution Providers

D-Wave SC16 Update: What’s Bo Ewald Saying These Days

November 18, 2016

Tucked in a back section of the SC16 exhibit hall, quantum computing pioneer D-Wave has been talking up its new 2000-qubit processor announced in September. Forget for a moment the criticism sometimes aimed at D-Wave. This small Canadian company has sold several machines including, for example, ones to Lockheed and NASA, and has worked with Google on mapping machine learning problems to quantum computing. In July Los Alamos National Laboratory took possession of a 1000-quibit D-Wave 2X system that LANL ordered a year ago around the time of SC15. Read more…

By John Russell

CPU Benchmarking: Haswell Versus POWER8

June 2, 2015

With OpenPOWER activity ramping up and IBM’s prominent role in the upcoming DOE machines Summit and Sierra, it’s a good time to look at how the IBM POWER CPU stacks up against the x86 Xeon Haswell CPU from Intel. Read more…

By Tiffany Trader

Nvidia Sees Bright Future for AI Supercomputing

November 23, 2016

Graphics chipmaker Nvidia made a strong showing at SC16 in Salt Lake City last week. Read more…

By Tiffany Trader

Beyond von Neumann, Neuromorphic Computing Steadily Advances

March 21, 2016

Neuromorphic computing – brain inspired computing – has long been a tantalizing goal. The human brain does with around 20 watts what supercomputers do with megawatts. And power consumption isn’t the only difference. Fundamentally, brains ‘think differently’ than the von Neumann architecture-based computers. While neuromorphic computing progress has been intriguing, it has still not proven very practical. Read more…

By John Russell

The Exascale Computing Project Awards $39.8M to 22 Projects

September 7, 2016

The Department of Energy’s Exascale Computing Project (ECP) hit an important milestone today with the announcement of its first round of funding, moving the nation closer to its goal of reaching capable exascale computing by 2023. Read more…

By Tiffany Trader

BioTeam’s Berman Charts 2017 HPC Trends in Life Sciences

January 4, 2017

Twenty years ago high performance computing was nearly absent from life sciences. Today it’s used throughout life sciences and biomedical research. Genomics and the data deluge from modern lab instruments are the main drivers, but so is the longer-term desire to perform predictive simulation in support of Precision Medicine (PM). There’s even a specialized life sciences supercomputer, ‘Anton’ from D.E. Shaw Research, and the Pittsburgh Supercomputing Center is standing up its second Anton 2 and actively soliciting project proposals. There’s a lot going on. Read more…

By John Russell

Dell Knights Landing Machine Sets New STAC Records

November 2, 2016

The Securities Technology Analysis Center, commonly known as STAC, has released a new report characterizing the performance of the Knight Landing-based Dell PowerEdge C6320p server on the STAC-A2 benchmarking suite, widely used by the financial services industry to test and evaluate computing platforms. The Dell machine has set new records for both the baseline Greeks benchmark and the large Greeks benchmark. Read more…

By Tiffany Trader

What Knights Landing Is Not

June 18, 2016

As we get ready to launch the newest member of the Intel Xeon Phi family, code named Knights Landing, it is natural that there be some questions and potentially some confusion. Read more…

By James Reinders, Intel

  • arrow
  • Click Here for More Headlines
  • arrow
Share This