UltraScale Visualization with OpenSource Software Berk Geveci Kitware

Ultra-Scale Visualization with Open-Source Software Berk Geveci Kitware Inc.

Background

Kitware Is • A software company • creating open-source collaboration platforms • which are used globally for • • • research teaching commercial application. • This software is created by • • • internationally recognized experts in extended communities using a rigorous, quality-inducing software development process.

Technical Portfolio

Heart and Soul: Software Quality Process

In The Beginning There Was VTK

VTK Development Team • From Ohloh: Very large, active development team: Over the past twelve months, 66 developers contributed new code to VTK. This is one of the largest open-source teams in the world, and is in the top 2% of all project teams on Ohloh. and many others. . .

Then Came Para. View

Para. View Architecture

Support for Large Displays

Para. View is VTK • Para. View is developed by the VTK team • The Para. View team develops in the VTK repository : all development benefits the whole community • Para. View leverages all features of VTK

Short Demo

Problem Statement

The Good

Ability to Compute

Ability to Communicate

Remote Access

The Bad Ability to Compute >> Ability to Transfer >> Ability to Store/Read

State of Large Data Vis

Parallel Visualization

Visualization Resources • LANL Vis Cluster (2001): 128 dual-core nodes with NVIDIA Quadro FX 540 • Sandia Red Rose (2005): 264 dual-core nodes with NVIDIA Quadro FX 3400 • TACC Longhorn (2009): 256 8 core nodes with 2 NVIDIA Quadro FX 5800 s

General Purpose Tools • • • En. Sight Para. View Vis. It Field. View …

Specialized Tools • VAPOR • Vi. SUS • . . .

½ billion element weather simulation (rectilinear) 1 billion cell asteroid detonation simulation (AMR) 150 million element fire simulation (unstructured)

Where to Next?

Large Data, Small Bandwidth and Small Vis Resources • Vis on the supercomputer • Batch • Interactive • Co-Processing • Multi-Resolution Streaming

Ability to Compute

Vis on Supercomputer

Vis on Supercomputer • • Compiling Parallel IO Scalability Software Rendering • Compositing • Client/server • Resource allocation

Para. View on Supercomputers • Blue Gene L and P • Cray Xt 3, 4 and 5 • AIX • Linux Visualization of VPIC results on Kraken (image courtesy of Bill Daughton, LANL)

Co-Processing

Co-Processing 1

Run-Time Visualization and Setup

Library Architecture • • Based on VTK/Para. View C, Fortran and Python bindings Built-in Python interpreter (optional) Full demand-driven pipeline Distributed computing with MPI Extract generation Rendering (off-screen with Mesa)

Connection with the Simulation simulation_initialize() coprocessor_initialize() for t in time_steps: do_compute() if coprocess_needed(): do_coprocess() coprocessor_finalize() simulation_finalize()

Simulations – the More the Merrier • • Overflow (overset curvilinear) Phasta (unstructured) Acusolve (unstructured) Helios (unstructured - AMR hybrid) CTH (AMR) NPIC (structured). . .