CATS System Configuration

Original installation, September 2007; 2 new 2TB HDDs added, May 2011; QLogic switch replaced, Aug. 2012

Theoretical peak speed, not counting the scheduler node: (35 nodes) * (4 cores/node) * (3 GHz/core) * (4 flop/s/Hz) = 1.68 Tflop/s
CATS = Computing At the TeraScale!

Compute Nodes: 36 Rack-Mounted 1U Servers, Dell PowerEdge 1950
 
Processors:     2 Dual-Core Xeon Processor 5160, 4MB Cache, 3.00GHz, 1333MHz Front-Side Bus
Memory:     8GB 667MHz (4x2GB), Dual Ranked Fully Buffered DIMMs
Hard Drive:     1 73GB 15K RPM Serial-Attach SCSI 3Gbps 3.5-in HotPlug Hard Drive
Hard Drive Controller:     SAS 5/i Integrated, No RAID
Network Interface Controller:     Dual Embedded Broadcom NetXtreme II 5708 Gigabit Ethernet NIC
Alternate NIC:     Intel PRO 1000PT Cu, Dual Port PCIe, NIC
InfiniBand Host Channel Adapter:     QLogic 7104-HCA-LPX1P (a.k.a. SilverStorm 9000), Mem-Free, PCI-Express, Single-Port
HCA Driver:     Infinihost III Lx (MT 25204) - Mellanox InfiniBand HCA for PCI Express, 2.1.2.6583, 9/26/2010
 
  CATS platform: Intel Woodcrest
 
Original High-Performance Interconnect, 2007–2012: 1 4X SDR InfiniBand Switch, QLogic SilverStorm 9040
 
Chassis:     SilverStorm 9040, Switch Chassis & Set of 2 P/Ss, Supports 4 Leaf & 1 Spine Module
Spine:     9XX0 Spine (Internal Fabric), Managed
Leaves:     3 12-Port 4X Leaf modules
Cables:     18 4X 3m Cables + 18 4X 5m Cables, QSFP-to-QSFP, SFF-8470
 
Replacement High-Performance Interconnect, 2012: 1 4X QDR InfiniBand Switch, 36 Ports, QLogic 12200-BS23-MM
 
Hardware Service Option:     Basic 2-year service agreement, 5 x 8 remote technical support, 2-business-day replacement
Subnet Management Software:     QLogic InfiniBand Fabric Suite (runs on the switch itself)
Software Maintenance Option:     Basic 2-year maintenance agreement, 7 x 24 support
Cables:     18 4X 3m Cables + 18 4X 5m Amphenol Cables, QSFP-to-CX4
 
Login Nodes: 2 Rack-Mounted 2U Servers, Dell PowerEdge 2950
 
Processors:     2 Dual Core Xeon Processor 5160, 4MB Cache, 3.00GHz, 1333MHz Front-Side Bus
Memory:     16GB 667MHz (8x2GB), Dual Ranked DIMMs
RAID Feature:     Integrated SAS/SATA RAID 5 PERC 5/i Integrated
Data Hard Drives:     4 300GB 15K RPM Serial-Attach SCSI 3Gbps 3.5-in HotPlug Hard Drives
Parity Hard Drive:     1 300GB 15K RPM Serial-Attach SCSI 3Gbps 3.5-in HotPlug Hard Drive
Non-RAID Hard Drive:     1 2TB 7200 RPM Serial ATA Hard Drive for Select Dell PowerEdge/PowerVault Servers
Hard Drive Controller:     PERC 5/i, x6 Backplane Integrated Controller Card
Network Interface Controller:     Embedded Broadcom NetXtreme II 5708 Gigabit Ethernet NIC
Alternate NIC:     Intel PRO 1000PT Cu, Dual Port PCIe, NIC
Remote Access:     Dell Remote Access Card (DRAC), 5th Generation for PowerEdge Remote Management
CD/DVD Drive:     24X IDE CD-RW/DVD ROM Drive for PowerEdge 2950
 
Other Infrastructure: 2 Racks + 1 Gigabit Ethernet Switch
 
Racks:     2 Dell 4210 Racks, 42U
Rack Console:     15FP, 1U Rack Console with RapidRails, 15" TFT LCD, 83 key mini-kybd, U.S.
KVM Switch:     16 Port Keyboard/Video/Mouse Digital Switch, 2161DS/2 PowerEdge
KVM Switch Extenders:     4 Port Expansion Modules for PE2161RCS (8in/1out)
Gigabit Ethernet Switch:     PowerConnect 6248, 48 GbE Port Managed Switch


Last updated on 9/7/12 by Steve Lantz (slantz ~at~ cac.cornell.edu)