The Leading Source for Global News and Information Covering the Ecosystem of High Productivity Computing
October 20, 2006
3D visualization has been the key to increased success and efficiency in many areas of exploration and production (E&P). In this industry visualization plays a critical role in gaining insight from data. But often when we discuss visualization, we are talking only about the actual rendering of images on the screen. In fact, the visualization challenge for E&P is characterized by computationally expensive algorithms, a very large number of diverse data sets, and a need for greater interactivity and collaboration. To meet this challenge, we must make data management, computation and rendering work together smoothly and efficiently. In this way we will continue to deliver on 3D visualization’s promise of enabling better decisions in less time.
In the past, the E&P industry has been characterized by its use of big machines for both computation and rendering. As the economics of the "PC" architecture overtook big machines, it seemed that the capabilities of a single machine would never be sufficient. The industry turned to clusters of PCs as a solution. Clusters have been widely adopted for purely computational tasks, but only to a limited extent for visualization. Clusters have significant value for visualization, but also introduce significant complexity and cost in administration compared to single machines. Today, with advances in data management, computing and rendering, the "single machine" is once again a viable platform for visualization of E&P data.
Data management
Seismic volumes are typically tens of gigabytes today, and hundreds of gigabytes are not uncommon. Sixty-four-bit operating systems have enabled much larger system memory, but both system memory and texture memory, on the graphics processing unit, remain scarce resources compared to the size of the data sets. An effective solution using hierarchical multi-resolution bricking is now available in visualization toolkits -- middleware. In this solution, a pre-processing step subdivides the volume data into "bricks" and computes multiple resolution levels. The full-resolution data is the lowest level of the hierarchy and each higher-level brick represents multiple bricks at the level below. With data in this form, the middleware can initially load the lower-resolution data then automatically refine the image as higher-resolution data is loaded in the background. This enables interactive navigation of the largest volumes even on relatively low-end machines. The user does not have to wait for all the data to be loaded, only the data actually needed is loaded and multiple users can access the same data simultaneously because they use only their own local system memory to load the data. The multi-resolution bricking technique is already used in many E&P applications. VolumeViz from Mercury Computer Systems is one example of this visualization middleware. This same technique can be extended to other large data sets such as horizon surfaces and reservoir models.
Computing
For many years applications enjoyed an automatic increase in performance as CPU vendors competed to increase the clock speed in each new generation of chips. Physical limitations such as power consumption and heat dissipation have largely ended this era. The CPU vendors are now competing to increase the number of "cores" in each new generation of chips. Dual-core chips are already common, with quad -- and higher -- core chips coming soon. To take advantage of this new performance curve software developers will need to embrace multi-threading.
At the same time, alternative chip architectures have become available that provide much higher floating-point performance than conventional CPU chips, but require even more unconventional programming models. The GPU chip on every 3D graphics board is programmable and has very high performance for some algorithms. Its biggest advantage is the option of combining computing and rendering on the same processor. The Cell BE processor is a next-generation heterogeneous multi-core chip now available on a PCI-Express accelerator board from Mercury Computer Systems. All of these programming models, whether multi-threading or stream computing, present tremendous challenges for software developers.
Middleware libraries can solve part of this problem. For example the VolumeViz toolkit automatically creates a separate thread to manage data loading and multiple separate threads to do the actual physical I/O. In addition, VolumeViz enables the application to supply computation modules that are executed in parallel by the data threads. This capability enables the application to take advantage of multiple cores without changing the application code. VolumeViz also provides a framework for managing computing and rendering on the GPU chip. Application-defined GPU programs are downloaded and executed by VolumeViz in cooperation with its predefined GPU programs for rendering effects. Middleware libraries also provide building-block algorithms, such as fast Fourier transform (FFT) and convolution that are already highly optimized for new architectures.
(Digg, Technorati, more)
Platform HPC Workgroup Manager
Platform HPC Workgroup Manager integrates all the cluster productivity tools you need to deploy, run and manage your HPC environment.
The ACM Turing Award goes to the creator of the modern personal computer; and Voltaire announces a mid-range InfiniBand switch and new technology that accelerates distributed applications. We recap those stories and more in our weekly wrapup.
Read More...
The prospects for virtual SMP technology got another boost last month when Florida State University announced it had installed a new HPC system from 3Leaf Systems. The servers are being housed at the university's HPC facility and will be used across a range of scientific disciplines.
Read More...
For the first time in 62 years, the four-man Olympics bobsled team from the US captured the gold medal, setting a course world record in the process. The winning bobsled had some state-of-the-art engineering behind it, including CFD software from Exa Corporation. As it turned out, that software may have proved to be the margin of difference in the race.
Read More...
Mar 16 | Bio-IT World | Biotech firm builds genetic models from patient data. Read more...
Mar 15 | The Register | EMC's grand vision for unified global storage. Read more...
Mar 15 | Data Center Knowledge | Company delivers UCS-container solution to NASA. Read more...
Mar 11 | Linux Magazine | CUDA may be the rage, but OpenCL is a standard that has some features you may need. Read more...
Mar 09 | Free Software Magazine | Data-driven computing will need open software. Read more...
Jan 12 | | In-depth look at vSMP Foundation server virtualization technology, technical implementation, use cases and capabilities. The technical whitepaper provides an architectural overview and details on the three vSMP Foundation products: vSMP Foundation for SMP, vSMP Foundation for Cluster and vSMP Foundation for Cloud.
Jan 18 | | This white paper discusses Gore’s copper cable assemblies, and how they continue to exceed the standards for providing reliable, cost-effective solutions for high-performance computer applications.
Join this online panel discussion for live Q&A with leading industry experts, analysts, and end-users to discuss the latest innovations, best practices, barriers to implementation, and measurable benefits of server virtualization with a particular focus on today's real world solutions.
Learn about scalable fault-tolerant architectures and examples of energy efficient and scalable supercomputing clusters using dual QDR InfiniBand to combine capacity computing with network failover capabilities with the help of programming languages such as MPI and a robust Linux cluster management package.
LIVE@SCO9: The IBM team discusses new innovations in hardware, software and services that help clients better understand their workloads and get insight from their R&D efforts. Technology demonstrations include the soon-to-be-released Power7 HPC processor, the DCS990 system with 2.4 petabytes of storage, the xCAT management tool, secure HPC cloud computing and more. Winners of two HPCwire Readers' and Editors’ Choice Awards! Take the IBM virtual tour at SC09 or more information go online to: http://www-03.ibm.com/systems/deepcomputing/sc09.html