Quarry
Quarry provides a general-purpose Unix computing environment for academic and instructional use. The Quarry cluster consists of 140 IBM HS21 Bladeservers & 230 dx340 iDataPlex servers running Red Hat Linux, with TORQUE (also called PBS) and Moab for job management and SoftEnv to simplify application and environment configuration. Quarry is a 26 teraflop system.
Each Bladesever & iDataPlex server contain two Intel Xeon 5335 quad-core processors, 8 or 16GB of memory, and gigabit Ethernet for system interconnects. The Blade servers have a 36GB locally attached SAS disk for local scratch space and the iDataPlex servers have 160GB of locally attached SAS disk. The Blade & dx340 rack mount configuration provides electrical power and cooling advantages that make Quarry much more cost effective while occupying much less space.
System Specifications
| Primary Use | |
| General purpose Unix computing environment for academic and instructional use. | |
| Server Information | ||
| Architecture | IBM HS21 BladeCenter Cluster, EMT64 | |
| TFLOPS | 8.96 | |
| Clock Speed | 2.0GHZ | |
| Nodes | 140 compute; 2 image servers; 3 management | |
| CPUs | 2 x 2.0 GHz quad-core Intel Xeon 5335 processors per compute node | |
| Memory Type | Distributed and shared | |
| Total Memory | 1536 GB |
|
| Memory per Node |
8GB or 16GB 667 MHz DDR2 ECC | |
| Local Scratch Storage |
36 or 73 GB locally attached SAS disk |
|
| GPFS |
250 TB GPFS global scratch |
|
| Data Capacitor |
340 TB Lustre global scratch |
|
| Data Capacitor - WAN |
340 TB Lustre global scratch |
|
| OS | RedHat Enterprise Linux 4.8 | |
| Architecture | iDataPlex dx340 rack-mount servers |
|
| TFLOPS | 17.1 | |
| Clock Speed | 2.0GHZ | |
| Nodes | 230 compute |
|
| CPUs | 2 x 2.0 GHz quad-core Intel Xeon 5335 processors per compute node | |
| Memory Type | Distributed and shared | |
| Total Memory | 1536 GB |
|
| Memory per Node |
16GB 667 MHz DDR2 ECC | |
| Local Scratch Storage |
160 GB locally attached SAS disk (98 GB local scratch) |
|
| GPFS |
371 TB GPFS global scratch |
|
| Data Capacitor |
360 TB Lustre global scratch |
|
| Data Capacitor - WAN |
360 TB Lustre global scratch |
|
| OS | RedHat Enterprise Linux 5.6 | |
| Further Details | ||
| Network | Each Blade chassis has a ten gigabit-Ethernet connection that connects to the other research systems. Fourteen HS21 Blades, each with gigabit-Ethernet adapters, share that connection. |
|
| Job Management Software | PBS, TORQUE Moab |
|
| Batch Jobs per User | Users can have up to 336 cores; 1 job of 336 cores or 336 jobs of 1 core | |
| Additional Scratch Storage | /N/gpfs/your_username /N/dc/scratch/your_username /N/dcwan/scratch/your_username |
|
| Applications | List of packages |
|
