Zeus System Configuration

Theoretical peak speed: (64 cores) * (2.7 Gcycles/s/core) * (16 DP flop/cycle) = 5.5 Tflop/s, double precision
   Assumes two AVX-512 FMA (fused multiply-add with 8 DP additions and 8 DP multiplications) every cycle
   Does not account for memory bandwidth limitations, or dynamic frequency scaling due to AVX-512 instructions
 
Timeline
 
Apr. 2025:     Purchased from Red Barn HPC with Ubuntu 24.04 LTS and some tools preinstalled
Apr.-Jul. 2025:     Initial software installations were performed on Zeus
Aug. 2025:     User and data migrations from Hermes were completed
 
Hardware Configuration
 
System/Motherboard and BIOS:     Giga Computing MS73-HB2, serial no. OG1N8500059, GIGABYTE R12 BIOS
     (Custom build - ASUS motherboards were unavailable - order no. S02610)
 
Processors:     64 cores, 2x 32-Core Intel Xeon Gold "Emerald Rapids" Processors*, 6530, 160MB L3 Cache, 2.10GHz
     *2.7 GHz all-core turbo; sockets for this processor are LGA 4677 or "Socket E"
Memory:     512GB, 16x 32GB ECC Registered DDR5 SDRAM DIMMs, 4800 MT/s*
     *Highest speed possible
Bootable Disk Drive:     3.84TB Micron 7450 PRO NVMe SSD (MTFDKBG3T8TFR), PCIe4 x4, M.2 form factor
Additional Disk Drives:     60TB RAID-5, Broadcom/LSI MegaRAID 9560-8i 12GBps Tri-mode RAID Controller + CVPM05 CacheVault,
     with 4x Seagate Exos X24 20TB HDD (ST20000NM007H), 7200RPM SAS-3 12.0Gbps, 3.5"
Chipset:     Intel C741 ("Emmitsburg"), 20 SATA3 ports (but only 8 drive bays are supported by the case)
Network Interface Controllers:     Dual Broadcom BCM57416B 10G RDMA Ethernet Controllers + Dual Intel I210 Gigabit Ethernet Controllers
Case:     InWin IW-PLG GPU Workstation Pedestal Case
 
Graphics Accelerator:     NVIDIA RTX A2000 12GB, 12GB GDDR6, 3328 CUDA cores, 1200 MHz boost clock
     Interfaces: 4x mini DisplayPort 1.4, PCIe 4.0 x16
 

Disk Structure

PropertyDrive Maker and Size
Micron SSD, 3.84TB Broadcom/LSI MegaRAID, 60TB
Partition Names /dev/nvme0n1p1 /dev/nvme0n1p2 /dev/nvme0n1p3 /dev/nvme0n1p4 /dev/sda
Mount Points in Ubuntu /boot/efi /boot (swap) /  (root) /data

 

Hardware Interrogation Commands
 
Processors:     lscpu; more /proc/cpuinfo
Memory:     lsmem; more /proc/meminfo; top; sudo dmidecode --type memory   #grep for Size or Speed
Bootable Disk Drives:     sudo fdisk -l | grep dev   #bootable drives have an EFI System partition
Additional Disk Drives:     lsblk; sudo blkid; gnome-disks (GParted is not installed on Zeus)
MegaRAID Disk Drives:     sudo /opt/MegaRAID/storcli/storcli64 /c0 show all   #can leave out /c0 for general info
Other RAID Disk Drives (N/A):     lspci | grep -i raid; dmraid -r; cat /proc/mdstat   #the last one detects software RAID
I/O Controller Hub (N/A):     lspci | grep SATA; sudo dmidecode --type 8 | grep SATA
Network Interface Controller:     lspci | grep -i ether
Motherboard and BIOS:     sudo dmidecode --type baseboard; sudo dmidecode --type bios
Graphics Accelerator:     lspci | grep VGA; nvidia-smi
Disk Drives and Controllers:     sudo lshw -class disk; sudo lshw -class storage; dmesg | grep SATA
 

Software Configuration Highlights

The links below lead to separate pages that give precise, step-by-step descriptions of what was done in each year.

Apr-Jul. 2025: Did initial installations in Ubuntu 24.04 LTS


Not yet updated below this line!


Multi-Boot Instructions
 
From GRUB Menu:     After the setup phase, when the GRUB menu appears, use the up/down arrows to select the desired OS, then hit <CR>.
     This selection is not remembered on the next boot. To make the change permanent, you have to alter the grub.cfg file.
From Boot Menu:     Scroll past the end of the page and select the option "Hard Drive BBS Priorities" that appears. (Scrolling up works too.)
     The pop-up will show all available "legacy" drives, not just one. Scroll to the desired drive and move it to the top with "+".
     (This is NOT documented in the manual, pp. 4-31 to 4-32!!) Use Esc and arrows to reach Save Configuration and Exit.
 


Last updated on 9/6/25 by Steve Lantz (steve.lantz ~at~ cornell.edu)