# Parallel Computational Fluid Dynamics 2005

## 1st Edition

### Theory and Applications

**Editors:**A. Deane Gunther Brenner David Emerson James McDonough Damien Tromeur-Dervout N. Satofuka A. Ecer Jacques Periaux

**Hardcover ISBN:**9780444522061

**eBook ISBN:**9780080467931

**Imprint:**Elsevier Science

**Published Date:**6th September 2006

**Page Count:**538

## Description

Preface

Acknowledgements

**1. Invited Speakers and Special Sessions**

Parallel Simulation of Lifting Rotor Wakes (C.B. Allen)

A Distributed Lagrange Multipliers Based Fictitious Domain Method for the Numerical Simulation of Particulate Flow and its Parallel Implementation (Roland Glowinski, J. Hao and T.W. Pan)

Solving Fluid Flow Problems on Moving and Adaptive Overlapping Grids (William D. Henshaw)

Towards Optimal Performance for Lattice Boltzmann Applications on Terascale Computers (G. Wellein, P. Lammers, G. Hager, S. Donath and T. Zeiser)

Moore's Law, the Life Cycle of Scientific Computing Codes and the Diminishing Importance of Parallel Computing (Rainald Lohner, Chi Yang, Juan R. Cebral, Fernando F. Camelli, Fumiya Togashi, Joseph D. Baum, Hong Luo, Eric L. Mestreau and Orlando A. Soto)

“Letting physicists be physicists,” and Other Goals of Scalable Solver Research (David Keyes)

**2. Turbulence**

Investigation of Different Parallel Models for DNS of Turbulent Channel Flow (Jin Xu)

Flow Simulation Around a Finite Cylinder on Massively Parallel Computer Architecture (O. Frederich, E. Wassen and F. Thiele)

Parallel Computation of Turbulent Fluid Flows with the Piecewise-Parabolic Method (Paul R. Woodward, David A. Porter, Sarah E. Anderson, B. Kevin Edgar, Amitkumar Puthenveetil and Tyler Fuchs)

Parallel Large-Eddy Simulations of Turbulent Flows with Complex Moving Boundaries on Fixed Cartesian Grids (Jianming Yang and Elias Balaras)

Direct Numerical Simulation of Turbulent Flows on a Low Cost PC Cluster (F.X. Trias, M. Soria, A. Oliva and C.D. Perez-Segarra)

Large Eddy Simulation of Turbulent Couette-Poiseuille Flows in a Square Duct (Wei Lo and Chao-An Lin)

Development of a Framework for a Parallel Incompressible LES Solver Based on Free and Open Source Software (R. Giammanco and J.M. Buchlin)

**3. Grid Computing**

On a Fault Tolerant Algorithm for a Parallel CFD Application (M. Garbey and H. Ltaief)

Computational Fluid Dynamics Applications on TeraGrid (R.U. Payli, H.U. Akay, A.S. Baddi, A. Ecer, E. Yilmaz and E. Oktay)

Mapping LSE Method on a Grid: Software Architecture and Performance Gains (Christophe Picard, Marc Garbey and Venkat Subramaniam)

Acceleration of Fully Implicit Navier-Stokes Solvers with Proper Orthogonal Decomposition on GRID Architecture (D. Tromeur-Dervout and Y. Vassilevsky)

**4. Software Frameworks and Component Architectures**

A Gentle Migration Path to Component-Based Programming (Craig E. Rasmussen, Matthew J. Sottile, Christopher D. Rickett and Benjamin A. Allan)

PyNSol: A Framework for Interactive Development of High Performance Continuum Models (Michael Tobis)

The Exchange Grid: A Mechanism for Data Exchange Between Earth System Components on Independent Grids (V. Balaji, Jeff Anderson, Isaac Held, Michael Winton, Jeff Durachta, Sergey Malyshev and Ronald J. Stouffer)

A Generic Coupler for Earth System Models (Shujia Zhou and Joseph Spahr)

CFD Analyses on Cactus PSE (Kum Won Cho, Soon-Heum Ko, Young Gyun Kim, Jeong-su Na, Young Duk Song and Chongam Kim)

The Scalability Impact of a Component-Based Software Engineering Framework on a Growing SAMR Toolkit: a Case Study (Benjamin A. Allan, S. Lefantzi and Jaideep Ray)

**5. BioFluids**

Dynamics of Biological and Synthetic Polymers Through Large-Scale Parallel Computations (I.D. Dissanayake and P. Dimitrakopoulos)

Parallel Simulation of High Reynolds Number Vascular Flows (Paul Fischer, Francis Loth, Sang-Wook Lee, David Smith, Henry Tufo and Hisham Bassiouny)

**6. Multiphysics and MHD**

Large-Scale Multidisciplinary Computational Physics Simulations Using Parallel Multi-Zone Methods
(Ding Li, Guoping Xia and Charles L. Merkle)

Parallelization of Phase-Field Model for Phase Transformation Problems in a Flow Field (Ying Xu, J.M McDonough and K.A. Tagavi)

A Parallel Unsplit Staggered Mesh Algorithm for Magnetohydrodynamics (Dongwook Lee and Anil E. Deane)

Coupled Magnetogasdynamics -- Radiative Transfer Parallel Computing Using Unstructured Meshes (V.A. Gasilov, S.V. D'yachenko, O.G. Olkhovskaya, O.V. Diyankov, S.V. Kotegov and V.Yu. Pravilnikov)

**7. Aerodynamics**

Parallel Performance of a UKAAC Helicopter Code on HPCx and Other Large-Scale Facilities (A.G. Sunderland, D.R. Emerson and C.B. Allen)

Parallel Computations of Unsteady Aerodynamics and Flight Dynamics of Projectiles (Jubaraj Sahu)

Parallel Adaptive Solvers in Compressible PETSc-FUN3D Simulations (S. Bhowmick, D. Kaushik, L. McInnes, B. Norris and P. Raghavan)

Numerical Simulation of Transonic Flows by a Double Loop Flexible Evolution (Gabriel Winter, Begona Gonzalez, Blas Galvan and Esteban Benitez)

Numerical Simulation of 2D Radiative Heat Transfer for Reentry Vehicles (B.N. Chetverushkin, S.V. Polyakov, T.A. Kudryashova, A. Kononov and A. Sverdlin)

**8. Parallel Algorithms and Solvers**

Parallelism Results on Time Domain Decomposition for Stiff ODEs Systems (D. Guibert and D. Tromeur-Dervout)

Application of an Implicit Dual-Time Stepping Multi-Block Solver to 3D Unsteady Flows (R. Steijl, P. Nayyar, M.A. Woodgate, K.J. Badcock and G.N. Barakos)

Improving the Resolution of an Elliptic Solver for CFD Problems on the Grid (B. Hadri, M. Garbey and W. Shyy)

**9. Structured AMR**

FLASH: Applications and Future (K.B. Antypas, A.C. Calder, A. Dubey, J.B. Gallagher, J. Joshi, D.Q. Lamb, T. Linde, E.L. Lusk, O.E.B. Messer, A. Mignone, H. Pan, M. Papka, F. Peng, T. Plewa, K.M. Riley, P.M. Ricker, D. Sheeler, A. Siegel, N. Taylor, J.W. Truran, N. Vladimirova, G. Weirs, D. Yu and J. Zhang)

An Adaptive Cartesian Detonation Solver for Fluid-Structure Interaction Simulation on Distributed Memory Computers (R. Deiterding)

PARAMESH: A Parallel, Adaptive Grid Tool (Kevin M. Olson)

**10. General Fluid Dynamics**

Embarrassingly Parallel Computations of Bubbly Wakes (Andrei V. Smirnov, Gusheng Hu and Ismail Celik)

Parallelisation of Inundation Simulations (S.C. Kramer and G.S. Stelling)

Towards Numerical Modelling of Surface Tension of Microdroplets (X.J. Gu, D.R. Emerson, R.W. Barber and Y.H. Zhang)

DNS Simulation of Sound Suppression in a Resonator with Upstream Flows (I. Abalakin, A. Alexandrov, V. Bobkov and T. Kozubskaya)

Performance Characterization and Scalability Analysis of a Chimera Based Parallel Navier-Stokes Solver on Commodity Clusters (A. Hamed, D. Basu, K. Tomko and Q. Liu)

A Parallel Unstructured Implicit Solver for Hypersonic Reacting Flow Simulation (I. Nompelis, T.W. Drayna and G.V. Candler)

**11. Boundary Methods**

Toward A MatlabMPI Parallelized Immersed Boundary Method (M. Garbey and F. Pacull)

Dynamics of Multiphase Flows via Spectral Boundary Elements and Parallel Computations (Yechun Wang, Walter R. Dodson and P. Dimitrakopoulos)

**12. Parallel Tools and Load Balancing**

SDLB - Scheduler with Dynamic Load Balancing for Heterogeneous Computers (Stanley Y. Chien, Lionel Giavelli, Akin Ecer and Hasan U. Akay)

Performance Evaluation of Adaptive Scientific Applications using TAU (Sameer Shende, Allen D. Malony, Alan Morris, Steven Parker and J. Davison de St. Germain)

Computational Quality of Service in Parallel CFD (B. Norris, L. McInnes and I. Veljkovic)

**13. Combustion**

Parallel Numerical Simulation of Flame Extinction and Flame Lift-Off (G. Eggenspieler and S. Menon)

Parallel Computation of the Flow- and Acoustic Fields in a Gas Turbine Combustion Chamber (R.Z. Szasz, M. Mihaescu and L. Fuchs)

**14. Discrete Methods and Particles**

Performance of Lattice Boltzmann Codes for Navier-Stokes and MHD Turbulence on High-End Computer Architectures (George Vahala, Jonathan Carter, Min Soe, Jeffrey Yepez, Linda Vahala and Angus Macnab)

An Incompressible Navier-Stokes with Particles Algorithm and Parallel Implementation (Dan Martin, Phil Colella and Noel Keen)
Determination of Lubrication Characteristics of Bearings Using the Lattice Boltzmann Method (G. Brenner, A. Al-Zoubi, H. Schwarze and S. Swoboda)

MPI-OpenMP Hybrid Parallel Computation in Continuous-Velocity Lattice-Gas Model (Masaaki Terai and Teruo Matsuzawa)

**15. High Order Methods and Domain Decomposition**

Parallel Atmospheric Modeling with High-Order Continuous and Discontinuous Galerkin Methods (Amik St-Cyr and Stephen J. Thomas)

A New Formulation of NUDFT Applied to Aitken-Schwarz DDM on Nonuniform Meshes (A. Frullone and D. Tromeur-Dervout)

**16. Unstructured Grid Methods**

Unstructured Mesh Processing in Parallel CFD Project GIMM (B. Chetverushkin, V. Gasilov, M. Iakobovski, S. Polyakov, E. Kartasheva, A. Boldarev, I. Abalakin and A. Minkin)

Investigation of the Parallel Performance of the Unstructured DLR-TAU-Code on Distributed Computing Systems (Thomas Alrutz)

**17. Visualization**

Parallel Visualization of CFD Data on Distributed Systems (Marina A. Kornilina, Mikhail V. Iakobovski, Peter S. Krinov, Sergey V. Muravyov, Ivan A. Nesterov and Sergey A. Sukov)

## Key Features

- Report on current research in the field in an area which is rapidly changing
- Subject is important to all interested in solving large fluid dynamics problems
- Interdisciplinary activity. Contributions include scientists with a variety of backgrounds

## Readership

Engineering, Applied Science and Computer Science

## Table of Contents

Preface

Acknowledgements

**1. Invited Speakers and Special Sessions**

Parallel Simulation of Lifting Rotor Wakes (C.B. Allen)

A Distributed Lagrange Multipliers Based Fictitious Domain Method for the Numerical Simulation of Particulate Flow and its Parallel Implementation (Roland Glowinski, J. Hao and T.W. Pan)

Solving Fluid Flow Problems on Moving and Adaptive Overlapping Grids (William D. Henshaw)

Towards Optimal Performance for Lattice Boltzmann Applications on Terascale Computers (G. Wellein, P. Lammers, G. Hager, S. Donath and T. Zeiser)

Moore's Law, the Life Cycle of Scientific Computing Codes and the Diminishing Importance of Parallel Computing (Rainald Lohner, Chi Yang, Juan R. Cebral, Fernando F. Camelli, Fumiya Togashi, Joseph D. Baum, Hong Luo, Eric L. Mestreau and Orlando A. Soto)

“Letting physicists be physicists,” and Other Goals of Scalable Solver Research (David Keyes)

**2. Turbulence**

Investigation of Different Parallel Models for DNS of Turbulent Channel Flow (Jin Xu)

Flow Simulation Around a Finite Cylinder on Massively Parallel Computer Architecture (O. Frederich, E. Wassen and F. Thiele)

Parallel Computation of Turbulent Fluid Flows with the Piecewise-Parabolic Method (Paul R. Woodward, David A. Porter, Sarah E. Anderson, B. Kevin Edgar, Amitkumar Puthenveetil and Tyler Fuchs)

Parallel Large-Eddy Simulations of Turbulent Flows with Complex Moving Boundaries on Fixed Cartesian Grids (Jianming Yang and Elias Balaras)

Direct Numerical Simulation of Turbulent Flows on a Low Cost PC Cluster (F.X. Trias, M. Soria, A. Oliva and C.D. Perez-Segarra)

Large Eddy Simulation of Turbulent Couette-Poiseuille Flows in a Square Duct (Wei Lo and Chao-An Lin)

Development of a Framework for a Parallel Incompressible LES Solver Based on Free and Open Source Software (R. Giammanco and J.M. Buchlin)

**3. Grid Computing**

On a Fault Tolerant Algorithm for a Parallel CFD Application (M. Garbey and H. Ltaief)

Computational Fluid Dynamics Applications on TeraGrid (R.U. Payli, H.U. Akay, A.S. Baddi, A. Ecer, E. Yilmaz and E. Oktay)

Mapping LSE Method on a Grid: Software Architecture and Performance Gains (Christophe Picard, Marc Garbey and Venkat Subramaniam)

Acceleration of Fully Implicit Navier-Stokes Solvers with Proper Orthogonal Decomposition on GRID Architecture (D. Tromeur-Dervout and Y. Vassilevsky)

**4. Software Frameworks and Component Architectures**

A Gentle Migration Path to Component-Based Programming (Craig E. Rasmussen, Matthew J. Sottile, Christopher D. Rickett and Benjamin A. Allan)

PyNSol: A Framework for Interactive Development of High Performance Continuum Models (Michael Tobis)

The Exchange Grid: A Mechanism for Data Exchange Between Earth System Components on Independent Grids (V. Balaji, Jeff Anderson, Isaac Held, Michael Winton, Jeff Durachta, Sergey Malyshev and Ronald J. Stouffer)

A Generic Coupler for Earth System Models (Shujia Zhou and Joseph Spahr)

CFD Analyses on Cactus PSE (Kum Won Cho, Soon-Heum Ko, Young Gyun Kim, Jeong-su Na, Young Duk Song and Chongam Kim)

The Scalability Impact of a Component-Based Software Engineering Framework on a Growing SAMR Toolkit: a Case Study (Benjamin A. Allan, S. Lefantzi and Jaideep Ray)

**5. BioFluids**

Dynamics of Biological and Synthetic Polymers Through Large-Scale Parallel Computations (I.D. Dissanayake and P. Dimitrakopoulos)

Parallel Simulation of High Reynolds Number Vascular Flows (Paul Fischer, Francis Loth, Sang-Wook Lee, David Smith, Henry Tufo and Hisham Bassiouny)

**6. Multiphysics and MHD**

Large-Scale Multidisciplinary Computational Physics Simulations Using Parallel Multi-Zone Methods
(Ding Li, Guoping Xia and Charles L. Merkle)

Parallelization of Phase-Field Model for Phase Transformation Problems in a Flow Field (Ying Xu, J.M McDonough and K.A. Tagavi)

A Parallel Unsplit Staggered Mesh Algorithm for Magnetohydrodynamics (Dongwook Lee and Anil E. Deane)

Coupled Magnetogasdynamics -- Radiative Transfer Parallel Computing Using Unstructured Meshes (V.A. Gasilov, S.V. D'yachenko, O.G. Olkhovskaya, O.V. Diyankov, S.V. Kotegov and V.Yu. Pravilnikov)

**7. Aerodynamics**

Parallel Performance of a UKAAC Helicopter Code on HPCx and Other Large-Scale Facilities (A.G. Sunderland, D.R. Emerson and C.B. Allen)

Parallel Computations of Unsteady Aerodynamics and Flight Dynamics of Projectiles (Jubaraj Sahu)

Parallel Adaptive Solvers in Compressible PETSc-FUN3D Simulations (S. Bhowmick, D. Kaushik, L. McInnes, B. Norris and P. Raghavan)

Numerical Simulation of Transonic Flows by a Double Loop Flexible Evolution (Gabriel Winter, Begona Gonzalez, Blas Galvan and Esteban Benitez)

Numerical Simulation of 2D Radiative Heat Transfer for Reentry Vehicles (B.N. Chetverushkin, S.V. Polyakov, T.A. Kudryashova, A. Kononov and A. Sverdlin)

**8. Parallel Algorithms and Solvers**

Parallelism Results on Time Domain Decomposition for Stiff ODEs Systems (D. Guibert and D. Tromeur-Dervout)

Application of an Implicit Dual-Time Stepping Multi-Block Solver to 3D Unsteady Flows (R. Steijl, P. Nayyar, M.A. Woodgate, K.J. Badcock and G.N. Barakos)

Improving the Resolution of an Elliptic Solver for CFD Problems on the Grid (B. Hadri, M. Garbey and W. Shyy)

**9. Structured AMR**

FLASH: Applications and Future (K.B. Antypas, A.C. Calder, A. Dubey, J.B. Gallagher, J. Joshi, D.Q. Lamb, T. Linde, E.L. Lusk, O.E.B. Messer, A. Mignone, H. Pan, M. Papka, F. Peng, T. Plewa, K.M. Riley, P.M. Ricker, D. Sheeler, A. Siegel, N. Taylor, J.W. Truran, N. Vladimirova, G. Weirs, D. Yu and J. Zhang)

An Adaptive Cartesian Detonation Solver for Fluid-Structure Interaction Simulation on Distributed Memory Computers (R. Deiterding)

PARAMESH: A Parallel, Adaptive Grid Tool (Kevin M. Olson)

**10. General Fluid Dynamics**

Embarrassingly Parallel Computations of Bubbly Wakes (Andrei V. Smirnov, Gusheng Hu and Ismail Celik)

Parallelisation of Inundation Simulations (S.C. Kramer and G.S. Stelling)

Towards Numerical Modelling of Surface Tension of Microdroplets (X.J. Gu, D.R. Emerson, R.W. Barber and Y.H. Zhang)

DNS Simulation of Sound Suppression in a Resonator with Upstream Flows (I. Abalakin, A. Alexandrov, V. Bobkov and T. Kozubskaya)

Performance Characterization and Scalability Analysis of a Chimera Based Parallel Navier-Stokes Solver on Commodity Clusters (A. Hamed, D. Basu, K. Tomko and Q. Liu)

A Parallel Unstructured Implicit Solver for Hypersonic Reacting Flow Simulation (I. Nompelis, T.W. Drayna and G.V. Candler)

**11. Boundary Methods**

Toward A MatlabMPI Parallelized Immersed Boundary Method (M. Garbey and F. Pacull)

Dynamics of Multiphase Flows via Spectral Boundary Elements and Parallel Computations (Yechun Wang, Walter R. Dodson and P. Dimitrakopoulos)

**12. Parallel Tools and Load Balancing**

SDLB - Scheduler with Dynamic Load Balancing for Heterogeneous Computers (Stanley Y. Chien, Lionel Giavelli, Akin Ecer and Hasan U. Akay)

Performance Evaluation of Adaptive Scientific Applications using TAU (Sameer Shende, Allen D. Malony, Alan Morris, Steven Parker and J. Davison de St. Germain)

Computational Quality of Service in Parallel CFD (B. Norris, L. McInnes and I. Veljkovic)

**13. Combustion**

Parallel Numerical Simulation of Flame Extinction and Flame Lift-Off (G. Eggenspieler and S. Menon)

Parallel Computation of the Flow- and Acoustic Fields in a Gas Turbine Combustion Chamber (R.Z. Szasz, M. Mihaescu and L. Fuchs)

**14. Discrete Methods and Particles**

Performance of Lattice Boltzmann Codes for Navier-Stokes and MHD Turbulence on High-End Computer Architectures (George Vahala, Jonathan Carter, Min Soe, Jeffrey Yepez, Linda Vahala and Angus Macnab)

An Incompressible Navier-Stokes with Particles Algorithm and Parallel Implementation (Dan Martin, Phil Colella and Noel Keen)
Determination of Lubrication Characteristics of Bearings Using the Lattice Boltzmann Method (G. Brenner, A. Al-Zoubi, H. Schwarze and S. Swoboda)

MPI-OpenMP Hybrid Parallel Computation in Continuous-Velocity Lattice-Gas Model (Masaaki Terai and Teruo Matsuzawa)

**15. High Order Methods and Domain Decomposition**

Parallel Atmospheric Modeling with High-Order Continuous and Discontinuous Galerkin Methods (Amik St-Cyr and Stephen J. Thomas)

A New Formulation of NUDFT Applied to Aitken-Schwarz DDM on Nonuniform Meshes (A. Frullone and D. Tromeur-Dervout)

**16. Unstructured Grid Methods**

Unstructured Mesh Processing in Parallel CFD Project GIMM (B. Chetverushkin, V. Gasilov, M. Iakobovski, S. Polyakov, E. Kartasheva, A. Boldarev, I. Abalakin and A. Minkin)

Investigation of the Parallel Performance of the Unstructured DLR-TAU-Code on Distributed Computing Systems (Thomas Alrutz)

**17. Visualization**

Parallel Visualization of CFD Data on Distributed Systems (Marina A. Kornilina, Mikhail V. Iakobovski, Peter S. Krinov, Sergey V. Muravyov, Ivan A. Nesterov and Sergey A. Sukov)

## Details

- No. of pages:
- 538

- Language:
- English

- Copyright:
- © Elsevier Science 2006

- Published:
- 6th September 2006

- Imprint:
- Elsevier Science

- eBook ISBN:
- 9780080467931

- Hardcover ISBN:
- 9780444522061

## About the Editor

### A. Deane

### Affiliations and Expertise

University of Maryland, College Park, MD, USA

### Gunther Brenner

### Affiliations and Expertise

Institute of Applied Mechanics, Germany

### David Emerson

### Affiliations and Expertise

Daresbury Laboratory, UK

### James McDonough

### Affiliations and Expertise

University of Kentucky, USA

### Damien Tromeur-Dervout

### Affiliations and Expertise

Université Claude Bernard, Lyon I, France

### N. Satofuka

### Affiliations and Expertise

Kyoto Institute of Technology, Matsugasaki, Sakuo-ku, Kyoto 606-8585, Japan

### A. Ecer

### Affiliations and Expertise

Indiana University Purdue, University Indianapolis, Purdue University School of Engineering, Indianapolis, IN 46202, USA

### Jacques Periaux

### Affiliations and Expertise

Dassault-Aviation, Saint-Cloud, France