132.zeusmp2
SPEC MPI2007 Benchmark Description

Benchmark Name

132.zeusmp2

Benchmark Author

John Hayes
Lawrence Livermore National Laboratory
PO Box 808, L-550
Livermore, CA 94550

Benchmark Program General Category

Physics / Hydrodynamics / Magnetohydrodynamics

Benchmark Description

ZEUS-MP is a computational fluid dynamics code developed at the Laboratory for Computational Astrophysics (NCSA, SDSC, University of Illinois at Urbana-Champaign, UC San Diego) for the simulation of astrophysical phenomena. The program solves the equations of ideal (non-resistive), non-relativistic, hydrodynamics and magnetohydrodynamics, including externally applied gravitational fields and self-gravity. The gas can be adiabatic or isothermal, and the thermal pressure is isotropic. Boundary conditions may be specified as reflecting, periodic, inflow, or outflow.

ZEUS-MP Version 2 is a new branch of ZEUS-MP under development at UCSD (by John Hayes). Besides it is a Fortran 90 rewrite of ZEUS-MP, new physics models such as flux-limited radiation diffusion (FLD) and multispecies fluid advection are added to the physics set. Application flexibility is also improved in this version.

132.zeusmp2 is based on ZEUS-MP Version 2. It has been modified to be able to run at arbitrary rank sizes with one input file.

MPI Usage

ZEUS-MP divides the computational space into 3D tiles that are distributed across processors. Nonblocking point-to-point communication MPI_Isend with MPI_Irecv and MPI_Waitall are major MPI calls in this code. MPI_Allreduce is the primary collective calls along with a smattering of other MPI calls.

For medium data set, the code supports all jobs sizes between 1 and 512. For large data set, it supports all job sizes between 1 and 2048. However, it runs at rank counts that show generally increasing performance. At some cases, some ranks may be idled due to the requirement of minimal number of zones along each axis.

The optimal rank counts (without idled ranks) for mref dataset are: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 12, 14, 15, 16, 18, 20, 21, 24, 25, 28, 30, 32, 35, 36, 40, 42, 45, 48, 49, 50, 56, 60, 63, 64, 70, 72, 75, 80, 84, 90, 96, 98, 100, 105, 112, 120, 126, 128, 140, 144, 147, 150, 160, 168, 175, 180, 192, 196, 200, 210, 224, 225, 240, 245, 252, 256, 280, 288, 294, 300, 315, 320, 336, 350, 360, 384, 392, 400, 420, 441, 448, 450, 480, 490, 504, 512.

The optimal rank counts (without idled ranks) for lref dataset are:1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 12, 14, 15, 16, 18, 20, 21, 24, 25, 28, 30, 32, 35, 36, 40, 42, 45, 48, 49, 50, 56, 60, 63, 64, 70, 72, 75, 80, 84, 90, 96, 98, 100, 105, 112, 120, 126, 128, 140, 144, 147, 150, 160, 168, 175, 180, 192, 196, 200, 210, 224, 225, 240, 245, 252, 256, 280, 288, 294, 300, 315, 320, 336, 350, 360, 384, 392, 400, 420, 441, 448, 450, 480, 490, 504, 512, 525, 560, 576, 588, 600, 630, 640, 672, 700, 720, 735, 768, 784, 800, 840, 882, 896, 900, 960, 980, 1008, 1024, 1050, 1120, 1152, 1176, 1200, 1225, 1260, 1280, 1344, 1400, 1440, 1470, 1536, 1568, 1575, 1600, 1680, 1764, 1792, 1800, 1920, 1960, 2016, 2048.

Description

The physical problem solved in SPEC MPI2007 is a 3-D blastwave simulated with the presence of a uniform magnetic field along the x-direction. A Cartesian grid is used and the boundaries are "outflow."See http://lca.ucsd.edu/portal/codes/zeusmp2/examples/mhdblastwave/.

To adapt to MPI2007 suite, some modifications have been made. Number of zones in 3 dimensions, nbl in ggen1-3, have been moved to nbllarray as nbll. ntiles in mpitop, IZONES,JZONES,KZONES and MAXIJK in ARRAYCONF will be computed during run time.

The input file zmp_inp contains many parameters from which the problem is built, among them:

mpitop
The spatial arrangement of processors (irrelevant for MPI2007).
rescon
Restart control which is irrelevant in this test.
pcon
Problem control with the limits on number of steps (nlim) system time (tlim) and CPU time (cpulim).
hycon
Physical constants related to the hydrodynamical problem
iib ~ okb
Boundary conditions at the 6 boundaries.
ggen1~3
Grid information.
grvcon
Gravitation control which is irrelevant in this test.
radcon
Radiation control which is irrelevant in this test.
radexp
Radiative diffusion control which is irrelevant in this test.
eqos
Information on Equation of State.
pgen
Problem generator control information. In this test, it is a spherical blastwave with radius r=0.2 and located at the origin. The ambient density d0=1 and the ambient pressure is 0.6. The initial blastwave has density 100 times and pressure of 1 million times of the surrounding. B-field is in the x-direction (b10=140).

Output Description

Benchmark information is output on screen if the code runs interactively. It includes information about number of timesteps, number of zone-cycles of the run.

"usraa*" files contain information about the density distribution at the end of the run. These files are aggregated into one file zeusmp.val for validation.

Programming Language

Fortran 90.

Known portability issues

None

References

"Simulating Radiating and Magnetized Flows in Multiple Dimensions with ZEUS-MP," Hayes et al. 2006, Astrophysical Journal Supplement Series, Vol. 165, Issue 1, pp. 188-288.

http://lca.ucsd.edu/portal/codes/zeusmp2

Last updated: September 3, 2009