Gateways for Open Science

By Elizabeth Murray

August 12, 2013

“Science is really ripe for disruption. A lot of the practices are still very much rooted in their analog beginnings.” That is how Kaitlin Thaney, Director of the Mozilla Science Lab—a new open science initiative focused on innovation, best practice, and skills training for research—began her plenary talk at XSEDE13 in San Diego last month.

Thaney believes that the web has fundamentally transformed how we interrogate, how we interact with content, how we discover information, our work environments, and our agility. “We at Mozilla are focusing on how we can help researchers use the power of the open web to change science’s future,” she said.

The Mozilla Science Lab is funded by the Alfred P. Sloan Foundation, a leading funder in digital scholarship and information technology with projects focused on data sharing, new forms of metrics for scholarly research, and other technologies on the library side. Thaney sees this as a larger play to see how all of them can work together toward a broader means of coordinating these various efforts to provide infrastructure and also leadership in the open science space while pushing this practice into the mainstream. 

Thaney makes the case that our current systems are still designed to create friction despite their original intentions. “Modern discoveries are still locked up in various silos and not as interlinked as they could be,” she said. “Even looking at the way we reward scientific contribution, it is still very much reliant on a paper-based system. We are starting to see what the behavioral effects will be from this sort of reward system, and what we are seeing is more error creep into the way research is done.”

Citing Elizabeth Iorns, Co-founder of Science Exchange, Thaney said that “up to 70 percent of research from academic labs cannot be reproduced, representing an enormous waste of money and effort.” She pointed to this statistic as reflective of a larger problem that the research community should address by developing a better way to reflect and reward research contributions and practices. “It is really keeping us from that whole notion of building on additional knowledge, or prior knowledge, or standing on the shoulders of giants, and really looking at how we can start to minimize not only the amount of error but also the amount of duplication,” said Thaney.

Moving Forward

Luckily we have the Internet, which Thaney views as one of the most important advances since the printing press; however, inventing and putting into practice are two very different things. “Even though the web was created by scientists, I think we can all probably largely agree that the web has not yet transformed science in the same way that it has transformed the way we do business or the way we look at education,” said Thaney.

Step one is gateways. It is no coincidence that there are commonalities between her project at Mozilla and XSEDE’s Science Gateways, the theme of XSEDE13. Both look at preparing web-based resources so science and engineering researchers can have better access to the data, the information, the software, and the code through online community spaces. Both hope making these tools more accessible will increase the power behind the computation. 

Thaney said that in her previous work at the technology company Digital Science they were looking at application-based technologies that would help bring researchers a little bit closer to a world of reproducibility and better practice via the web. They found that the most successful work was with tools that were mapped into a ubiquitous layer, where users didn’t even realize they were interacting with a web-based tool anymore.

Closing the Gap

Starting with the physical aspects of research—the lab mice, the DNA, the cell lines—there are ways to attach digital imprints. “Whether it’s a tracking number or some other means of attaching identity to it, the community can start to integrate that into the systems to make it a little bit easier for the next researcher who comes along to be able to reproduce and start from that without having to reverse engineer,” explained Thaney.

Research isn’t cheap, she reminded the conference attendees. “For example, getting one Huntington’s protein, that can cost you $400, only to get it to your lab and realize there is a massive efficacy issue around using various proteins and antibodies. And now you need to start from scratch again.”

“The Mozilla Science Lab is looking at what we could possibly learn from the open source community, both in terms of culture and technology,” said Thaney. That community believes that sharing risk and also reward by mixing internal and also external involvement and development will often times get you much further toward your goal. “Looking at the broader idea of having innovation not just be putting your own ideas into a funnel and then pushing it out to the greater world, but having it be much more of a porous process,” Thaney said.

Thaney’s and Mozilla’s mission also includes increasing digital literacy. Relying on ad-hoc, self-taught practices to close the gap between what you are expected to know and what you have the resources to learn doesn’t scale, according to Thaney. “The amount of times researchers have come to me and said ‘I wanted to do this post-doc but my PI told me I need to know Python along with a range of things I have never experienced before, and so I just bought a book.’ That is not best practice.”

One way the Mozilla Science Lab is increasing digital literacy is by working with a program called Software Carpentry. The program teaches basic computational competency and digital skills to researchers to help provide the springboard needed for 21st century science. 

Measuring Up and Fighting Fears

A traditional metric for evaluating the impact of scholarly research has been the number of times an article is cited; however, with the growing use of alternative metrics, or “altmetrics,” citation is no longer the only way to measure success. How many times an article has been bookmarked, tweeted, shared, blogged about, or cited in Wikipedia can now matter just as much. “The data there is actually quite staggering in some context. Where a paper it is associated with might be cited ten times, the data might be reused 1,500. That is really powerful to be able to go to your funder or be able to go to your research administrator and say this is a useful bit of my research,” explained Thaney.

Thaney understands the fear that goes along with the practice of open science:  “Relinquishing information and opening it up for anyone to make use of it can be slightly terrifying, especially when there is a lot of time that goes into collecting that information, but using the power of the network, we can really have the opportunity to open it up to as many eyes as possible to see the broader use and impact of what that research may be.”

XSEDE13 participant Anthony Frachioni, who will enter into the physics PhD program at Binghamton University, New York, in the fall, said that while he is excited at the prospect of an open science and research world, at the end of the day he still lives in constant fear he will get scooped. “What do you do about credit and courtesy?” he asked Thaney.

“A lot of it comes down to being human. The technology there has shown we have the ability to start to making this information available, but when it comes to the reward mechanisms, we need to start providing some sort of assurance, because otherwise, we can only go so far,” she responded. “I can say that researchers getting scooped simply because they made some information available early happens a lot less than you might think, but I understand when it comes to job security, we need something far more concrete.”

Thaney said that concern is why Mozilla, through a separate program, is looking into ways to provide badges, or some other sort of accolade within the researcher’s university or institution, to show proof of intellectual property in a particular area. The hope is that having something to show for sharing information will provide comfort for the researcher while cautioning others to think twice about scooping it. “It is not an easy problem to solve, but we are working on it,” concluded Thaney.    

Even without concrete solutions, Frachioni remains enthusiastic about the possibilities of open science. “This is all completely unprecedented, and that isn’t going to give us any reassurance at the end of the day,” he said, “but I think that it’s our responsibility to enter into this knowing that and knowing that we should do it anyway.” 

The annual XSEDE conference, organized by the National Science Foundation’s Extreme Science and Engineering Discovery Environment with the support of corporate and non-profit sponsors, brings together the extended community of individuals interested in advancing research cyberinfrastructure and integrated digital services for the benefit of science and society. XSEDE13 was held July 22-25 in San Diego; XSEDE14 will be held July 13-18 in Atlanta. For more information, visit https://conferences.xsede.org/xsede14

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Fluid HPC: How Extreme-Scale Computing Should Respond to Meltdown and Spectre

February 15, 2018

The Meltdown and Spectre vulnerabilities are proving difficult to fix, and initial experiments suggest security patches will cause significant performance penalties to HPC applications. Even as these patches are rolled o Read more…

By Pete Beckman

Intel Touts Silicon Spin Qubits for Quantum Computing

February 14, 2018

Debate around what makes a good qubit and how best to manufacture them is a sprawling topic. There are many insistent voices favoring one or another approach. Referencing a paper published today in Nature, Intel has offe Read more…

By John Russell

Brookhaven Ramps Up Computing for National Security Effort

February 14, 2018

Last week, Dan Coats, the director of Director of National Intelligence for the U.S., warned the Senate Intelligence Committee that Russia was likely to meddle in the 2018 mid-term U.S. elections, much as it stands accused of doing in the 2016 Presidential election. Read more…

By John Russell

HPE Extreme Performance Solutions

Safeguard Your HPC Environment with the World’s Most Secure Industry Standard Servers

Today’s organizations operate in an environment with ever-evolving threats, and in order to protect themselves they must continuously bolster their security strategy. Hewlett Packard Enterprise (HPE) and Intel® are addressing modern security challenges with the world’s most secure industry standard servers powered by the latest generation of Intel® Xeon® Scalable processors. Read more…

AI Cloud Competition Heats Up: Google’s TPUs, Amazon Building AI Chip

February 12, 2018

Competition in the white hot AI (and public cloud) market pits Google against Amazon this week, with Google offering AI hardware on its cloud platform intended to make it easier, faster and cheaper to train and run machi Read more…

By Doug Black

Fluid HPC: How Extreme-Scale Computing Should Respond to Meltdown and Spectre

February 15, 2018

The Meltdown and Spectre vulnerabilities are proving difficult to fix, and initial experiments suggest security patches will cause significant performance penal Read more…

By Pete Beckman

Brookhaven Ramps Up Computing for National Security Effort

February 14, 2018

Last week, Dan Coats, the director of Director of National Intelligence for the U.S., warned the Senate Intelligence Committee that Russia was likely to meddle in the 2018 mid-term U.S. elections, much as it stands accused of doing in the 2016 Presidential election. Read more…

By John Russell

AI Cloud Competition Heats Up: Google’s TPUs, Amazon Building AI Chip

February 12, 2018

Competition in the white hot AI (and public cloud) market pits Google against Amazon this week, with Google offering AI hardware on its cloud platform intended Read more…

By Doug Black

Russian Nuclear Engineers Caught Cryptomining on Lab Supercomputer

February 12, 2018

Nuclear scientists working at the All-Russian Research Institute of Experimental Physics (RFNC-VNIIEF) have been arrested for using lab supercomputing resources to mine crypto-currency, according to a report in Russia’s Interfax News Agency. Read more…

By Tiffany Trader

The Food Industry’s Next Journey — from Mars to Exascale

February 12, 2018

Global food producer and one of the world's leading chocolate companies Mars Inc. has a unique perspective on the impact that exascale computing will have on the food industry. Read more…

By Scott Gibson, Oak Ridge National Laboratory

Singularity HPC Container Start-Up – Sylabs – Emerges from Stealth

February 8, 2018

The driving force behind Singularity, the popular HPC container technology, is bringing the open source platform to the enterprise with the launch of a new vent Read more…

By George Leopold

Dell EMC Debuts PowerEdge Servers with AMD EPYC Chips

February 6, 2018

AMD notched another EPYC processor win today with Dell EMC’s introduction of three PowerEdge servers (R6415, R7415, and R7425) based on the EPYC 7000-series p Read more…

By John Russell

‘Next Generation’ Universe Simulation Is Most Advanced Yet

February 5, 2018

The research group that gave us the most detailed time-lapse simulation of the universe’s evolution in 2014, spanning 13.8 billion years of cosmic evolution, is back in the spotlight with an even more advanced cosmological model that is providing new insights into how black holes influence the distribution of dark matter, how heavy elements are produced and distributed, and where magnetic fields originate. Read more…

By Tiffany Trader

Inventor Claims to Have Solved Floating Point Error Problem

January 17, 2018

"The decades-old floating point error problem has been solved," proclaims a press release from inventor Alan Jorgensen. The computer scientist has filed for and Read more…

By Tiffany Trader

Japan Unveils Quantum Neural Network

November 22, 2017

The U.S. and China are leading the race toward productive quantum computing, but it's early enough that ultimate leadership is still something of an open questi Read more…

By Tiffany Trader

AMD Showcases Growing Portfolio of EPYC and Radeon-based Systems at SC17

November 13, 2017

AMD’s charge back into HPC and the datacenter is on full display at SC17. Having launched the EPYC processor line in June along with its MI25 GPU the focus he Read more…

By John Russell

Researchers Measure Impact of ‘Meltdown’ and ‘Spectre’ Patches on HPC Workloads

January 17, 2018

Computer scientists from the Center for Computational Research, State University of New York (SUNY), University at Buffalo have examined the effect of Meltdown Read more…

By Tiffany Trader

Nvidia Responds to Google TPU Benchmarking

April 10, 2017

Nvidia highlights strengths of its newest GPU silicon in response to Google's report on the performance and energy advantages of its custom tensor processor. Read more…

By Tiffany Trader

IBM Begins Power9 Rollout with Backing from DOE, Google

December 6, 2017

After over a year of buildup, IBM is unveiling its first Power9 system based on the same architecture as the Department of Energy CORAL supercomputers, Summit a Read more…

By Tiffany Trader

Fast Forward: Five HPC Predictions for 2018

December 21, 2017

What’s on your list of high (and low) lights for 2017? Volta 100’s arrival on the heels of the P100? Appearance, albeit late in the year, of IBM’s Power9? Read more…

By John Russell

Russian Nuclear Engineers Caught Cryptomining on Lab Supercomputer

February 12, 2018

Nuclear scientists working at the All-Russian Research Institute of Experimental Physics (RFNC-VNIIEF) have been arrested for using lab supercomputing resources to mine crypto-currency, according to a report in Russia’s Interfax News Agency. Read more…

By Tiffany Trader

Leading Solution Providers

Chip Flaws ‘Meltdown’ and ‘Spectre’ Loom Large

January 4, 2018

The HPC and wider tech community have been abuzz this week over the discovery of critical design flaws that impact virtually all contemporary microprocessors. T Read more…

By Tiffany Trader

Perspective: What Really Happened at SC17?

November 22, 2017

SC is over. Now comes the myriad of follow-ups. Inboxes are filled with templated emails from vendors and other exhibitors hoping to win a place in the post-SC thinking of booth visitors. Attendees of tutorials, workshops and other technical sessions will be inundated with requests for feedback. Read more…

By Andrew Jones

How Meltdown and Spectre Patches Will Affect HPC Workloads

January 10, 2018

There have been claims that the fixes for the Meltdown and Spectre security vulnerabilities, named the KPTI (aka KAISER) patches, are going to affect applicatio Read more…

By Rosemary Francis

GlobalFoundries, Ayar Labs Team Up to Commercialize Optical I/O

December 4, 2017

GlobalFoundries (GF) and Ayar Labs, a startup focused on using light, instead of electricity, to transfer data between chips, today announced they've entered in Read more…

By Tiffany Trader

Tensors Come of Age: Why the AI Revolution Will Help HPC

November 13, 2017

Thirty years ago, parallel computing was coming of age. A bitter battle began between stalwart vector computing supporters and advocates of various approaches to parallel computing. IBM skeptic Alan Karp, reacting to announcements of nCUBE’s 1024-microprocessor system and Thinking Machines’ 65,536-element array, made a public $100 wager that no one could get a parallel speedup of over 200 on real HPC workloads. Read more…

By John Gustafson & Lenore Mullin

Flipping the Flops and Reading the Top500 Tea Leaves

November 13, 2017

The 50th edition of the Top500 list, the biannual publication of the world’s fastest supercomputers based on public Linpack benchmarking results, was released Read more…

By Tiffany Trader

V100 Good but not Great on Select Deep Learning Aps, Says Xcelerit

November 27, 2017

Wringing optimum performance from hardware to accelerate deep learning applications is a challenge that often depends on the specific application in use. A benc Read more…

By John Russell

2017 Gordon Bell Prize Finalists Named

October 23, 2017

The three finalists for this year’s Gordon Bell Prize in High Performance Computing have been announced. They include two papers on projects run on China’s Read more…

By John Russell

  • arrow
  • Click Here for More Headlines
  • arrow
Share This