|
Size: 620
Comment:
|
Size: 3530
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 1: | Line 1: |
| = DoC Private Cloud Hardware Investigations = | = DoC Private Cloud: Compute Servers = |
| Line 3: | Line 3: |
| CSG are investigating the hardware that could be used to realise the DoC cloud. We have identified two basic infrastructure and server requirements; we provide details and cost estimates on this page. |
CSG are investigating the hardware that could be used to realise the DoC cloud. This page describes various commodity compute node options. |
| Line 6: | Line 6: |
| ||||||||<tablestyle="width: 80%">'''Infrastructure'''|| ||'''Item'''||'''Amount'''||'''Price'''||'''Comments'''|| ||APC Smart-UPS RT 6000VA RM 230V||6||£2200||4200 Watts / 6000 VA UPS|| ||ICT LOM switch||2||£1000||4200 Watts / 6000 VA UPS|| |
We want dense compute nodes (a large number of CPUS/cores per cubic volume) so as to make best use of rack-space - power and cooling requirements notwithstanding. We have found that Dell offer the densest server configurations in the form of the PowerEdge C6000 series. We identify two servers in particular: the AMD-based [[http://www.dell.com/uk/enterprise/p/poweredge-c6145/pd|Dell PowerEdge C6145]] and the Intel-based [[http://www.dell.com/uk/business/p/poweredge-c6220/pd|Dell PowerEdge C6220]] |
| Line 11: | Line 8: |
| We have considered a number of manufacturers for compute nodes including Dell, IBM and HP. HP have no comparable core-dense servers (the best we found had half the cores, half the memory and yet was more expensive than the Dell options below) so have been eliminated. |
|
| Line 12: | Line 11: |
| ||<rowstyle="background-color: #FFFFE0;">cell2||cell 3|| | == Dell PowerEdge C6220 == |
| Line 14: | Line 13: |
| nd give details ''storage nodes' and 'compute nodes' | This is a 4-node, 2U server, each node comprising a self-contained two-socket system with its own memory, VGA, 10GbE NIC, USB and LOM port. We have a quote from Dell of '''£19917''' for the following configuration: . 2 x Intel Xeon E5-2670 2.60GHz 8-core/16-thread CPUs per node. . 128GB RAM per node (512GB RAM total in the 2U server) . 2 x 1TB SATA 7.2k 2.5in hard-drives per node (eight in total in the 2U server) The nodes are separate systems housed in the same 2U server chassis. They are not otherwise interconnected. One of these servers has sixty-four physical CPU cores in total - 128 via hyper-threading. Given 512GB total RAM, this means 8GB of RAM per physical core or 4GB of RAM per 'thread'. Note that this server contains Intel Sandy Bridge Xeon processors. These support (amongst other things) on-board CPU energy usage monitoring. == Dell PowerEdge C6145 == This is a 2-node, 2U server, each node comprising a self-contained four-socket system with its own memory, VGA, 1GbE NIC, USB and LOM port. We have an old quote from Dell of '''£13,700.20''' for the following configuration: . 4 x AMD Opteron 6282SE 2.6GHz, 16-core CPUs per node. . 256GB RAM per node (512GB total in the 2U server) . 1 x 1TB SATA 7.2k 2.5in hard-drive per node (two in total in the 2U server). Note: 10GbE NIC *not* included in the above quote: a two-node server would require two such [[http://www.dell.com/us/enterprise/p/broadcom-netxtremeii-57711/pd|cards]] and transceivers, priced at £616.95 + VAT each. Equipping the C6145 accordingly would bring the total to '''£14,933.90'''. The nodes are separate systems housed in the same 2U server chassis. They are not otherwise interconnected. One of these servers has 128 CPU cores in total. Given 512GB total RAM, this means 4GB of RAM per physical core. == IBM System x3690 X5 == We also have a quote on an [[http://www-03.ibm.com/systems/uk/x/hardware/enterprise/x3690x5/index.html|IBM System x3690 X5]]. The configuration - courtesy of AMS - is a 4U, 1TB RAM, 40-core (80 threads) server costing '''£36,909.25'''. The department had a loan server of this configuration - again, courtesy of AMS - during February - March 2012. . 4 x ten-core Intel Xeon E7-8870 2.4Ghz CPUs (eighty threads with SMT) . 1TB DDR3 @ 1066MHz ECC RAM. . 2 x 146GB 15000RPM SAS hard-disks. Note that this server is based on the Westmere-EX architecture: there are no four-way Sandy Bridge CPUs available at the moment - only two-way. |
DoC Private Cloud: Compute Servers
CSG are investigating the hardware that could be used to realise the DoC cloud. This page describes various commodity compute node options.
We want dense compute nodes (a large number of CPUS/cores per cubic volume) so as to make best use of rack-space - power and cooling requirements notwithstanding. We have found that Dell offer the densest server configurations in the form of the PowerEdge C6000 series. We identify two servers in particular: the AMD-based Dell PowerEdge C6145 and the Intel-based Dell PowerEdge C6220
We have considered a number of manufacturers for compute nodes including Dell, IBM and HP. HP have no comparable core-dense servers (the best we found had half the cores, half the memory and yet was more expensive than the Dell options below) so have been eliminated.
Dell PowerEdge C6220
This is a 4-node, 2U server, each node comprising a self-contained two-socket system with its own memory, VGA, 10GbE NIC, USB and LOM port. We have a quote from Dell of £19917 for the following configuration:
- 2 x Intel Xeon E5-2670 2.60GHz 8-core/16-thread CPUs per node.
- 128GB RAM per node (512GB RAM total in the 2U server)
- 2 x 1TB SATA 7.2k 2.5in hard-drives per node (eight in total in the 2U server)
The nodes are separate systems housed in the same 2U server chassis. They are not otherwise interconnected.
One of these servers has sixty-four physical CPU cores in total - 128 via hyper-threading. Given 512GB total RAM, this means 8GB of RAM per physical core or 4GB of RAM per 'thread'.
Note that this server contains Intel Sandy Bridge Xeon processors. These support (amongst other things) on-board CPU energy usage monitoring.
Dell PowerEdge C6145
This is a 2-node, 2U server, each node comprising a self-contained four-socket system with its own memory, VGA, 1GbE NIC, USB and LOM port. We have an old quote from Dell of £13,700.20 for the following configuration:
- 4 x AMD Opteron 6282SE 2.6GHz, 16-core CPUs per node.
- 256GB RAM per node (512GB total in the 2U server)
- 1 x 1TB SATA 7.2k 2.5in hard-drive per node (two in total in the 2U server).
Note: 10GbE NIC *not* included in the above quote: a two-node server would require two such cards and transceivers, priced at £616.95 + VAT each. Equipping the C6145 accordingly would bring the total to £14,933.90.
The nodes are separate systems housed in the same 2U server chassis. They are not otherwise interconnected.
One of these servers has 128 CPU cores in total. Given 512GB total RAM, this means 4GB of RAM per physical core.
IBM System x3690 X5
We also have a quote on an IBM System x3690 X5. The configuration - courtesy of AMS - is a 4U, 1TB RAM, 40-core (80 threads) server costing £36,909.25. The department had a loan server of this configuration - again, courtesy of AMS - during February - March 2012.
- 4 x ten-core Intel Xeon E7-8870 2.4Ghz CPUs (eighty threads with SMT)
- 1TB DDR3 @ 1066MHz ECC RAM.
- 2 x 146GB 15000RPM SAS hard-disks.
Note that this server is based on the Westmere-EX architecture: there are no four-way Sandy Bridge CPUs available at the moment - only two-way.