Child pages
  • ROGER Technical Summary

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

ROGER is comprised of three distinct node types: traditional compute nodes, high memory nodes, and graphics nodes.

...

Batch Compute Nodes

The traditional compute nodes are Dell Power Edge (PE) R730 servers with two Intel Xeon E5-2660 v3 chips.  Each chip has 10 cores, each running at 2.6GHz, and a 25MB cache.  Each server has 256GB of physical RAM and 500GB of local storage for swap and scratch space.  There are 24 batch compute nodes. Their node names are in the format cg-cmpXX (where XX is the node number).

GPU Nodes

The GPU compute nodes are identical to the traditional compute nodes with the addition of an Nvidia Tesla K40M graphics processing unit.  There are 12 GPU compute nodes. Their node names are in the format cg-gpuXX (where XX is the node number).

High Memory Nodes

The High Memory compute nodes are identical to the traditional compute nodes, except for for being equipped with 800GB of local storage using SSDs. There are called "high memory" because before the upgrade of April 2016, they were the only nodes with 256GB of RAM. There are 16 high memory nodes. These nodes were designed to run Hadoop workloads, and can sustain an 11TB hadoop filesystem with their SSDs. However, the production Hadoop system is currently using the GPFS shared filesystem for storage, which still has excellent performance and allows much greater size: currently 175 Tb is allocated.

GPU Nodes

The GPU compute nodes are identical to the traditional compute nodes with the addition of an Nvidia Tesla K40M graphics processing unit.  There are 12 GPU compute nodes. Their node names are in the format cg-hmXX (where XX is the node number).

Compute Hardware

Node TypeNode QtyCPUCPU QtyTotal CoresRAMConnectivityStorageGPU
Compute124Intel Xeon E5-2660 v3
2.6GHz
25M Cache
10 Cores
220256 GB(1x) 10Gb/s500GB
7.2K rpm
Nearline SAS 6Gb/s 
n/a
GPU12(same)220256 GB(same)500GB
7.2K rpm
Nearline SAS 6Gb/s
Nvidia Tesla K40M
Hadoop/
High Mem2
16(same)220256 GB(same)800GB SSD
SAS 6Gb/s 
n/a
GridFTP2(same)220256 GB(1x) 40Gb/s800GB SSD
SAS 6Gb/s 
n/a

...