Difference between revisions of "AIDA Cluster"

From CAC Documentation wiki
Jump to navigation Jump to search
(→‎Queues/Partitions ("Partition" is the term used by slurm): Removed redundant "Common Commands" section and instead added link to Slurm page)
Line 21: Line 21:
 
:* All nodes below have hyperthreading is turned on.  
 
:* All nodes below have hyperthreading is turned on.  
  
c00[17-22] 2x18 core Xeon Skylake 6154 CPUs with base clock 3GHz (turbo up to 3.7GHz)
+
c00[17-22]:
 +
    2x18 core Xeon Skylake 6154 CPUs with base clock 3GHz (turbo up to 3.7GHz)
  
 
c0017: x5 GPU/Nvidia Tesla V100 16GB
 
c0017: x5 GPU/Nvidia Tesla V100 16GB
Line 36: Line 37:
 
       /tmp: 100GB
 
       /tmp: 100GB
 
       /scratch: 1TB
 
       /scratch: 1TB
 +
 +
c00[71,73-76]:
 +
    2x28 core Xeon Gold 6348 CPUs with base clock 2.6GHz
 +
    x4 GPU/Nvidia Tesla A100 80GB
 +
    Memory: 1TB
 +
    swap: 187GB
 +
    /tmp: 3TB
  
 
==Queues/Partitions ("Partition" is the term used by Slurm) ==
 
==Queues/Partitions ("Partition" is the term used by Slurm) ==
Line 44: Line 52:
  
 
:*'''aida'''  
 
:*'''aida'''  
::: Number of nodes: 6 GPU servers  
+
::: Number of nodes: 6 GPU servers (Tesla V100)
 
::: Node Names: c00[17-22]
 
::: Node Names: c00[17-22]
 
::: HW: See above; c0017, c0018-c0021, c0022
 
::: HW: See above; c0017, c0018-c0021, c0022
 
::: Memory per node: see above  
 
::: Memory per node: see above  
 
::: /tmp per node: see above
 
::: /tmp per node: see above
 +
::: Default walltime: 1 hour
 +
::: Limits: walltime limit: 7 days
 +
 +
:*'''aida2'''
 +
::: Number of nodes: 5 GPU servers (Tesla A100)
 +
::: Node Names: c00[71,73-76]
 +
::: HW: See above; c0071, c0073-c0076
 +
::: Memory per node: 1TB
 +
::: /tmp per node: 3TB
 
::: Default walltime: 1 hour
 
::: Default walltime: 1 hour
 
::: Limits: walltime limit: 7 days
 
::: Limits: walltime limit: 7 days

Revision as of 12:34, 25 May 2022

AIDA General Information

  • Aida is a private queue from within the atlas2 cluster with restricted access to the rab38_0001 group.
  • The aida queue contains 6 compute nodes (c0017-c0022)
  • Head node: atlas2.cac.cornell.edu (access via ssh)
    • Full atlas2 cluster information
    • Open HPC deployment running Centos 7.4.1708
    • Cluster scheduler: slurm 17.02
    • /home (15TB) directory server (nfs exported to all cluster nodes)
    • Intel(R) Xeon(R) E5-2637 v4 @ 3.5GHz; supports vector extensions up to AVX2
  • Cluster Status: Ganglia.
  • Please send any questions and report problems to: cac-help@cornell.edu

Networking

  • All nodes have a 10GB ethernet connection for eth0 on a private net served out from the atlas2 head node.
  • All nodes have an Infiniband connection:
  • Type: MT4119 ((EDR speed, 25Gbits/sec)

Hardware in the slurm aida partition

  • All nodes below are a Xeon generations that supports vector extensions up to AVX-512
  • All nodes below have hyperthreading is turned on.

c00[17-22]:

    2x18 core Xeon Skylake 6154 CPUs with base clock 3GHz (turbo up to 3.7GHz)

c0017: x5 GPU/Nvidia Tesla V100 16GB

    Memory: 754GB
    swap: 187GB
    /tmp: 700GB

c00[18-21]: x5 GPU/Nvidia Tesla V100 16GB

     Memory: 376GB
     swap: 187GB
     /tmp: 700GB

c0022: x2 GPU/Nvidia Tesla V100 16GB

     Memory: 1.5TB 
     swap: 187GB
     /tmp: 100GB
     /scratch: 1TB

c00[71,73-76]:

    2x28 core Xeon Gold 6348 CPUs with base clock 2.6GHz
    x4 GPU/Nvidia Tesla A100 80GB
    Memory: 1TB
    swap: 187GB
    /tmp: 3TB

Queues/Partitions ("Partition" is the term used by Slurm)

For detailed information and a quick-start guide, see the Slurm page.

To access the aida nodes, one needs to first login to atlas2.cac.cornell.edu.

  • aida
Number of nodes: 6 GPU servers (Tesla V100)
Node Names: c00[17-22]
HW: See above; c0017, c0018-c0021, c0022
Memory per node: see above
/tmp per node: see above
Default walltime: 1 hour
Limits: walltime limit: 7 days
  • aida2
Number of nodes: 5 GPU servers (Tesla A100)
Node Names: c00[71,73-76]
HW: See above; c0071, c0073-c0076
Memory per node: 1TB
/tmp per node: 3TB
Default walltime: 1 hour
Limits: walltime limit: 7 days