Difference between revisions of "TARDIS3 Cluster"

From CAC Documentation wiki
Jump to navigation Jump to search
(Created page with "__TOC__ == General Information == Tardis3 cluster is a reinstallation of TARDIS Cluster using OpenHPC 2/CentOS 8. TARDIS Cluster nodes will eventually be migrated to...")
 
(9 intermediate revisions by the same user not shown)
Line 3: Line 3:
 
== General Information ==
 
== General Information ==
 
Tardis3 cluster is a reinstallation of [[TARDIS Cluster]] using OpenHPC 2/CentOS 8. [[TARDIS Cluster]] nodes will eventually be migrated to this new cluster.
 
Tardis3 cluster is a reinstallation of [[TARDIS Cluster]] using OpenHPC 2/CentOS 8. [[TARDIS Cluster]] nodes will eventually be migrated to this new cluster.
 +
 +
= Scheduler/Queues =
 +
:* The cluster scheduler is Slurm. Currently 32 new Dell R440 servers are configured to be in the "c8" partition/queue with no time limits. c1 to c7 queues will be added as the nodes are migrated from the [[TARDIS Cluster]]. See [[ slurm | Slurm documentation page ]] for details.
 +
:* Remember, hyperthreading is enabled on the cluster, so Slurm considers each physical core to consist of two logical CPUs.
 +
:* Partitions (queues):
 +
::{| border="1" cellspacing="0" cellpadding="10"
 +
! Name
 +
! Physical Cores
 +
! HT/Slurm CPUs
 +
! RAM
 +
! Infiniband
 +
! Time Limit
 +
|-
 +
| c8
 +
| 40
 +
| 80
 +
| 95
 +
| EDR (100 Gb/s)
 +
| no limit
 +
|}
  
 
== Software List ==
 
== Software List ==
Line 23: Line 43:
 
* /opt/ohpc/pub/mpi/openmpi4-intel
 
* /opt/ohpc/pub/mpi/openmpi4-intel
 
| module load openmpi4
 
| module load openmpi4
 +
|-
 +
| Quantum Espresso 6.7.0
 +
| /opt/ohpc/pub/apps/quantum-espresso/6.7.0
 +
|
 +
* module load intel/2021.1.2.266
 +
* module load openmpi4/4.0.4
 +
* module load quantum-espresso/6.7.0
 
|}
 
|}

Revision as of 22:57, 24 February 2021

General Information

Tardis3 cluster is a reinstallation of TARDIS Cluster using OpenHPC 2/CentOS 8. TARDIS Cluster nodes will eventually be migrated to this new cluster.

Scheduler/Queues

  • The cluster scheduler is Slurm. Currently 32 new Dell R440 servers are configured to be in the "c8" partition/queue with no time limits. c1 to c7 queues will be added as the nodes are migrated from the TARDIS Cluster. See Slurm documentation page for details.
  • Remember, hyperthreading is enabled on the cluster, so Slurm considers each physical core to consist of two logical CPUs.
  • Partitions (queues):
Name Physical Cores HT/Slurm CPUs RAM Infiniband Time Limit
c8 40 80 95 EDR (100 Gb/s) no limit

Software List

Software Path Notes
*GNU Compilers 9.3.0 /opt/ohpc/pub/compiler/gcc/9.3.0 module load gnu9/9.3.0
Intel Compilers 2021.1.2.266 (2021 Update 1) /opt/intel/oneapi/compiler/2021.1.2 module load intel/2021.1.2.266
*openmpi 4.0.4
  • /opt/ohpc/pub/mpi/openmpi4-gnu9
  • /opt/ohpc/pub/mpi/openmpi4-intel
module load openmpi4
Quantum Espresso 6.7.0 /opt/ohpc/pub/apps/quantum-espresso/6.7.0
  • module load intel/2021.1.2.266
  • module load openmpi4/4.0.4
  • module load quantum-espresso/6.7.0