MOLECULAR DYNAMICS PERFORMANCE GUIDE - Digital Research Alliance of CANADA

BENCHMARK DETAILS

ID=206

  • Dataset: 6n4o
  • Software: GROMACS.cuda (gromacs/2023.2-gofbfc-2020.1.403.114-avx2)
  • Resource: 1 tasks, 48 cores, nodes, 4 GPUs, with NVLink
  • CPU: EPYC 7413 (Milan), 2.65 GHz
  • GPU: NVIDIA-A100-SXM4-40GB, 12 cores/GPU
  • Simulation speed: 75.853 ns/day
  • Efficiency: 21.5 %
  • Site: Narval
  • Date: Aug. 9, 2023, 1:32 p.m.
  • Submission script:

    #!/bin/bash
    #SBATCH --mem-per-cpu 2000 --time 1:0:0
    #SBATCH -c 48 --gpus-per-node 4

    td=$SLURM_TMPDIR
    wd=$SLURM_SUBMIT_DIR
    cp topol.tpr $td && cd $td

    module load StdEnv/2020 gcc/9.3.0 cuda/11.4 openmpi/4.0.3 gromacs/2023.2

    gmx mdrun -ntomp ${SLURM_CPUS_PER_TASK:-1} \
    -nb gpu -pme gpu -update gpu -bonded cpu -s topol.tpr

    cp md.log $wd

  • Notes:

    (ns/day) (hour/ns)
    Performance: 100.895 0.238
    Performance: 100.728 0.238
    Performance: 100.686 0.238
    Performance: 100.642 0.238
    Performance: 100.456 0.239
    Performance: 99.979 0.240
    Performance: 99.038 0.242
    Performance: 99.026 0.242
    Performance: 95.015 0.253
    Performance: 93.220 0.257
    Performance: 93.208 0.257
    Performance: 91.569 0.262
    Performance: 87.618 0.274
    Performance: 86.079 0.279
    Performance: 79.256 0.303
    Performance: 72.735 0.330
    Performance: 59.810 0.401
    Performance: 53.503 0.449
    Performance: 40.154 0.598
    Performance: 33.105 0.725

  • Simulation input file:

    title = benchmark
    ; Run parameters
    integrator = md
    nsteps = 400000
    dt = 0.001
    ; Output control
    nstxout = 0
    nstvout = 0
    nstfout = 0
    nstenergy = 10000
    nstlog = 10000
    nstxout-compressed = 50000
    compressed-x-grps = System
    ; Bond parameters
    continuation = yes
    constraint_algorithm = lincs
    constraints = h-bonds

    ; Neighborsearching
    cutoff-scheme = Verlet
    ns_type = grid
    nstlist = 10
    rcoulomb = 0.8
    rvdw = 0.8
    DispCorr = Ener ; anaytic VDW correction
    ; Electrostatics
    coulombtype = PME
    pme_order = 4
    fourier-nx = 144
    fourier-ny = 144
    fourier-nz = 144
    ; Temperature coupling is on
    tcoupl = V-rescale
    tc-grps = system
    tau_t = 0.1
    ref_t = 300
    ; Pressure coupling is on
    pcoupl = Parrinello-Rahman
    pcoupltype = isotropic
    tau_p = 2.0
    ref_p = 1.0
    compressibility = 4.5e-5
    ; Periodic boundary conditions
    pbc = xyz
    ; Velocity generation
    gen_vel = no