MOLECULAR DYNAMICS PERFORMANCE GUIDE - Digital Research Alliance of CANADA

BENCHMARK DETAILS

ID=283

  • Dataset: 9naw
  • Software: GROMACS.cuda.mpi (gromacs/2024.4-gofbc-2023a-avx512)
  • Resource: 2 tasks, 16 cores, 1 nodes, 2 GPUs, with NVLink
  • CPU: Xeon Gold 6448Y (Sapphire Rapids), 2.1 GHz
  • GPU: NVidia-H100-SXM5-80GB, 16 cores/GPU
  • Simulation speed: 11.399 ns/day
  • Efficiency: 29.1 %
  • Site: Rorqual
  • Date: Sept. 6, 2025, 12:53 p.m.
  • Submission script:
    #!/bin/bash
    #SBATCH --mem-per-cpu=4000 --time=1:0:0 -c16 --ntasks=2 --gpus=h100:2

    export OMP_NUM_THREADS="${SLURM_CPUS_PER_TASK:-1}"
    module load StdEnv/2023 gcc/12.3 openmpi/4.1.5 cuda/12.2 gromacs/2024.4

    gmx mdrun -ntomp ${SLURM_CPUS_PER_TASK:-1} \
    -nb gpu -pme gpu -update gpu -bonded cpu -s topol.tpr
  • Notes:
    Wait GPU state copy       1   16     252003    1619.123      54403.413  53.1
  • Simulation input file:
    title                   = benchmark 
    ; Run parameters
    integrator = md
    nsteps = 100000
    dt = 0.002
    ; Output control
    nstxout = 0
    nstvout = 0
    nstfout = 0
    nstenergy = 1000
    nstlog = 500
    nstxout-compressed = 5000
    compressed-x-grps = System
    ; Bond parameters
    continuation = yes
    constraint_algorithm = Lincs
    constraints = h-bonds

    ; Neighborsearching
    cutoff-scheme = Verlet
    ns_type = grid
    nstlist = 10
    rcoulomb = 0.8
    rvdw = 0.8
    DispCorr = Ener ; anaytic VDW correction
    ; Electrostatics
    coulombtype = PME
    pme_order = 4
    fourier-nx = 324
    fourier-ny = 324
    fourier-nz = 324
    ; Temperature coupling is on
    tcoupl = V-rescale
    tc-grps = system
    tau_t = 0.1
    ref_t = 300
    ; Pressure coupling is on
    pcoupl = Parrinello-Rahman
    pcoupltype = isotropic
    tau_p = 2.0
    ref_p = 1.0
    compressibility = 4.5e-5
    ; Periodic boundary conditions
    pbc = xyz
    ; Velocity generation
    gen_vel = no