UCS System Architecture

BRKCOM1005

UCS System Architecture Overview
Tommi Salli

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

Cisco Unified Computing System
LAN
Any IEEE Compliant LAN

SAN A

SAN B

Any ANSI T11 Compliant SAN

Any ANSI T11 Compliant SAN

Mgmt

One Logical Chassis
to Manage 160 Servers
LAN Connectivity
SAN Connectivity
Multiple Chassis
Blade & Rack Servers
Server Identity Management
Monitoring, Troubleshooting

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

3

Cisco UCS Architecture
APIs

UCS Manager
XML API

Standard APIs

UCS Manager

Fabric Interconnects

Fabric Extenders

Compute

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

4

Unified Management
UCS Manager

Unified Management
A Single Unified System
For Blade and Rack Servers

C-Series Rack
Optimized Servers

BRKCOM-1005

Service
Profile: HR_App1
UCS Service
Profile
VNIC1
Unified Device Management
MAC: 08:00:69:02:01:2E
HR_WEB_VLAN (ID=50)
VNIC2
Network
Policy
MAC:
08:00:69:02:01:2F
HR_DB_VLAN (ID=210)
HBA 1 and 2
WWN: 5080020000075740
Storage
Policy
WWN:
5080020000075741
VSAN ID: 12
Boot Order: SAN
BIOS Settings:
Server
Policy
Turbo
On
HyperThreading On

B-Series Blade
Servers

• Integral part of UCS system

• Open API

• Manages all aspects of the UCS

• Integrated Automation

• Single point of management for UCS

• Add capacity without complexity

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

5

UCS Benefits
Unified Management

Fabric
Interconnects

UCS C-series

Virtual
Adapters

UCS B-Series

Fabric
Extenders

Unified
Management
Industry-leading
compute without
compromise
BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

High
Performance
Virtual Networks
Highest Scale
Unified Fabric
Cisco Public

6

Building Blocks of Cisco UCS
An Integrated System Optimizes Data Center Efficiency
UCS Manager
• Embedded—manages entire UCS Domain

Fabric Interconnect
• 10GE unified fabric switch

Chassis IO Module
• Remote line card

Blade Server Chassis
• Flexible bay configurations

Blade and Rack Servers
• x86 industry standard
• Patented extended memory

I/O Adapters
• Choice of multiple adapters
BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

7

System Component Connectivity

SAN

LAN

MGMT

SAN

 Fabric Interconnect
G
A
G

S

G

S

Fabric
Interconnect

G

G

‒32 Fixed Unified Ports + 4 or 1 Expansion slots
to a maximum of 48 or 96 Unified Ports

G

Fabric
A
Interconnect

G

G

G

G

‒Upto 8 half width blades or 4 full width blades

Compute Chassis
Fabric
Extender

R
x8

I

C

C

I

x8

 Chassis

Fabric
Extender

R
x8

x8

 Fabric Extender
‒Host to uplink traffic engineering
‒Up to 160Gb Flexible bandwidth allocation

M

B

Adapter

P

P

B

Adapter

Adapter

X X

X X X X

x86 Computer

x86 Computer

 Adapter
‒Virtualized adapter for single OS and hypervisor
systems

 Compute Blade
Compute Blade
(Half slot)

BRKCOM-1005

Compute Blade
(Full slot)

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

8

Wire for Bandwidth, Not Connectivity

20G per Chassis

40G per Chassis

80G per Chassis

160G per Chassis

• Wire Once Architecture
• All links can be active all the time

• Policy-driven bandwidth allocation
• Virtual interface granularity
BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

9

Building Blocks
UCS Manager
Embedded in Fabric Interconnect
UCS Fabric Interconnects
6100
6200
UCS Fabric Extenders
Logically part of Fabric Interconnect
Inserts into Blade Enclosure
UCS Blade Server Chassis
Flexible bay configurations
Logically part of Fabric Interconnect
UCS Blade Servers
Different blade types
Mix blade types within enclosure
UCS Rack Servers
Different server types
Standalone or UCSM integrated
UCS Adapters
Three adapter options
Mix adapters within blade
BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

10

Unified Computing System Manager

•
•
•
•
BRKCOM-1005

Embedded device manager for family of UCS components
Enables stateless computing via Service Profiles
Efficient scale: Same effort for 1 to N blades
APIs for integration with new and existing data center infrastructure
© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

11

UCS Manager
 Single point of management for UCS system of
components

GUI
CLI

Custom Portal or Tools

Systems Management
Software

‒Adapters, blades, chassis, fabric extenders, fabric
interconnects

 Embedded device manager
‒Discovery, Inventory, Configuration, Monitoring,
Diagnostics, Statistics Collection

UCS Manager

‒Coordinated deployment to managed endpoints

 APIs for integration with new and existing data
center infrastructure
‒SMASH-CLP, IPMI, SNMP
‒XML-based SDK for commercial & custom
implementations

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

12

Management Protocols
SNMP

SMASH CLP

CIM XML
syslog

IPMI
Call-home

Remote KVM

UCS CLI and GUI

Serial Over LAN

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

UCS XML API

Cisco Public

13

UCS Centrale
Multi-UCS Manager

Data Center 1
UCS Manager

UCS Manager

Data Center 2
UCS Manager

• Unifies management of multi UCS
domains
• Leverages UCS Manager technology
• Simplify global operations with centralized
inventory, faults, logs, and server consoles

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Data Center 3

UCS Manager

UCS Manager

• Delivers global policies, service profiles, ID
pools, and templates
• Foundation for high availability, disaster
recovery, and workload mobility
• Model based API for large scale
automation
Cisco Public

14

Building Blocks
UCS Manager
Embedded in Fabric Interconnect
UCS Fabric Interconnects
6100
6200
UCS Fabric Extenders
Logically part of Fabric Interconnect
Inserts into Blade Enclosure
UCS Blade Server Chassis
Flexible bay configurations
Logically part of Fabric Interconnect
UCS Blade Servers
Different blade types
Mix blade types within enclosure
UCS Rack Servers
Different server types
Standalone or UCSM integrated
UCS Adapters
Three adapter options
Mix adapters within blade
BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

15

UCS 6248UP Fabric Interconnect

Feature details
• High Density 48 ports in 1RU

• 1Tbps Switching capability
• All ports can be used as uplinks or
downlinks
• All ports can be configured to support either
1Gb or 10Gb speeds
• Unified Ports
• 1 Expansion slots
• 2us Latency
• 80 PLUS Gold PSUs

• Backward and forward Compatibility

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

16

UCS 6296UP Fabric Interconnect

Feature details
• High Density 96 ports in 2RU

• 2Tbps Switching capability
• All ports can be used as uplinks or
downlinks
• All ports can be configured to support either
1Gb or 10Gb speeds
• Unified Ports
• 4 Expansion slots
• 2us Latency
• 80 PLUS Gold PSUs

• Backward and forward Compatibility

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

17

Unified Ports
Dynamic Ports Allocation: Lossless Ethernet or Fibre Channel
 Convert protocol support on the
same port dynamically

Unified Port

 All ports on UCS 6200 Series
 16-port Expansion Module for
6248UP and 6296UP

Native Fibre Channel

Lossless Ethernet:

1/10GbE, FCoE, iSCSI, NAS

Benefits

 Simplify switch purchase remove ports ratio guess work

 Flexible LAN & storage convergence
based on business needs

 Increase design flexibility

 Service can be adjusted based on the
demand for specific traffic

 Remove bandwidth
bottlenecks

BRKCOM-1005

Use-cases

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

18

UCS 6200 Expansion Module

UCS-FI-E16UP
• 16 “Unified Ports”
• Ports can be configured as either
Ethernet or Native FC Ports
• Ethernet operations at 1/10 Gigabit
Ethernet
• Fibre Channel operations at 8/4/2/1G
• Uses existing Ethernet SFP+ and
Cisco 8/4/2G and 4/2/1G FC Optics

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

19

Unified Port Management

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

20

Building Blocks
UCS Manager
Embedded in Fabric Interconnect
UCS Fabric Interconnects
6100
6200
UCS Fabric Extenders
Logically part of Fabric Interconnect
Inserts into Blade Enclosure
UCS Blade Server Chassis
Flexible bay configurations
Logically part of Fabric Interconnect
UCS Blade Servers
Different blade types
Mix blade types within enclosure
UCS Rack Servers
Different server types
Standalone or UCSM integrated
UCS Adapters
Three adapter options
Mix adapters within blade
BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

21

UCS 2204XP I/O Module
Feature details

• Increased uplink bandwidth
• 4 x 10 Gig network-facing ports
• Double the server-facing bandwidth
• 16 x 10 Gig = 4 per half width slot

• Two I/O Modules per chassis
• 40Gbps to a single half-width blade
(20Gbps left and right)
• 80Gbps to a full-width blade
• Built in chassis management
• Fully managed by UCSM

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

22

UCS 2208XP I/O Module

Feature details
• Double the uplink bandwidth

• 8 x 10 Gig network-facing ports
• Quadruple the server-facing bandwidth
• 32 x 10 Gig = 4 per half width slot
• Two I/O Modules per chassis

• 80Gbps to a single half-width blade
(40Gbps left and right)
• 160Gbps to a full-width blade
• Built in Chassis Management
• Fully Managed by UCSM

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

23

Building Blocks
UCS Manager
Embedded in Fabric Interconnect
UCS Fabric Interconnects
6100
6200
UCS Fabric Extenders
Logically part of Fabric Interconnect
Inserts into Blade Enclosure
UCS Blade Server Chassis
Flexible bay configurations
Logically part of Fabric Interconnect
UCS Blade Servers
Different blade types
Mix blade types within enclosure
UCS Rack Servers
Different server types
Standalone or UCSM integrated
UCS Adapters
Three adapter options
Mix adapters within blade
BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

24

UCS 5108 Blade Chassis

Chassis
• Up to 8 half slot blades
• Up to 4 full slot blades
• 4x power supplies, N+N grid redundant
• 8x fans included
• 2x UCS 2104 Fabric Extender
• All items hot-pluggable
BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

25

UCS 5108 Blade Chassis Parts

2 Fabric
Extenders

8 Fan Modules

4 Power
Connectors
4 to 8 Blades

4 Power
Supplies
6U, 19” Rack

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

26

UCS 5108 Blade Chassis Backplane
I/O Modules

PSU Connectors

Blade Connectors

Redundant data and management paths
BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

27

Building Blocks
UCS Manager
Embedded in Fabric Interconnect
UCS Fabric Interconnects
6100
6200
UCS Fabric Extenders
Logically part of Fabric Interconnect
Inserts into Blade Enclosure
UCS Blade Server Chassis
Flexible bay configurations
Logically part of Fabric Interconnect
UCS Blade Servers
Different blade types
Mix blade types within enclosure
UCS Rack Servers
Different server types
Standalone or UCSM integrated
UCS Adapters
Three adapter options
Mix adapters within blade
BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

28

Blade Overview

BRKCOM-1005

B22 M3

B200 M3

B250 M2

B420 M3

B230 M2

B440 M2

Slots

1

1

2

2

1

2

CPU

E5-2400

E5-2600

Xeon 5600

E5-4600

E7-2800

E7-4800

Cores

16

16

12

32

20

40

DIMMs

12

24

48

48

32

32

Max GB

192GB

768GB

384GB

1.5TB

512GB

1TB

Disk

2 x 2.5”

2 x 2.5”

2 x 2.5”

4 x 2.5

2 SSD

4 x 2.5”

Raid

0/1

0/1

0/1

0/1/5/10

0/1

0/1/5/6

mLOM

Dual 20Gb

Dual 20Gb

No

Dual 20Gb

No

No

Mezz

1

1

2

2

1

2

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

29

B22 M3 Blade

2 Socket
Intel E5-2400
12 DIMM slots
Maximum memory speed 1333MHz
2 Internal HDDs
SFF - SAS, SATA and SSD options
LSI 2002 RAID Controller
Supports RAID 0 and 1
1 Mezzanine card slot
PCIe 3.0 x16 mezzanine connector
mLOM option

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

30

B200 M3 Blade

2 Socket
Intel E5 series CPUs
24 DIMM slots
Maximum memory speed 1600MHz
2 Internal HDDs
SFF - SAS, SATA and SSD options
LSI 2004 RAID Controller
Supports RAID 0 and 1
1 Mezzanine card slot
PCIe 3.0 x16 mezzanine connector
mLOM option

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

31

B250 M2 Blade

2 Socket
Intel 55xx and 56xx series CPUs
48 DIMM slots
Maximum memory speed 1333MHz
2 Internal HDDs
SFF - SAS, SATA and SSD options
LSI 1064 RAID Controller
Supports RAID 0 and 1
2 Mezzanine card slot
PCIe 2.0 x16 mezzanine connector

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

32

B420 M3 Blade

4 Socket
Intel E5-4600 CPUs
48 DIMM slots
Maximum memory speed 1600MHz
4 Internal HDDs
SFF - SAS, SATA and SSD options
LSI 2208R RAID Controller
Supports RAID 0, 1, 5 and 10
2 Mezzanine card slot
PCIe 3.0 x16 mezzanine connector
mLOM option

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

33

B230 M2 Blade

2 Socket
Intel E7 CPUs
32 DIMM slots
Maximum memory speed 1066MHz
2 Internal HDDs
2.5 inch low profile SSD options
LSI 2108 RAID Controller
Supports RAID 0 and 1
1 Mezzanine card slot
PCIe 2.0 x16 mezzanine connector

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

34

B440 M2 Blade

4 Socket
Intel E7 CPUs
32 DIMM slots
Maximum memory speed 1066MHz
4 Internal HDDs
SFF – SAS, SATA and SSD options
LSI 2108 RAID Controller
1GB write cache
Battery Backed cache option
Supports RAID 0, 1, 5 and 6
2 Mezzanine card slot
PCIe 2.0 x16 mezzanine connector

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

35

B200 M2 and B250 M2 Blade Server CPU options

BRKCOM-1005

Cores

QPI Speed

Architecture

Support
1333Mhz
Memory
Speed

2.93GHz Xeon X5570 95W CPU/8MB cache/DDR3 1333MHz

4

6.4 GT/s

Nehalem-EP

X

N20-X00002

2.53GHz Xeon E5540 80W CPU/8MB cache/DDR3 1066MHz

4

5.86 GT/s

Nehalem-EP

N20-X00003

2.26GHz Xeon E5520 80W CPU/8MB cache/DDR3 1066MHz

4

5.86 GT/s

Nehalem-EP

N20-X00004

2.26GHz Xeon L5520 60W CPU/8MB cache/DDR3 1066MHz

4

5.86 GT/s

Nehalem-EP

N20-X00006

2.66GHz Xeon X5550 95W CPU/8MB cache/DDR3 1333MHz

4

6.4 GT/s

Nehalem-EP

N20-X00009

2.00GHz Xeon E5504 80W CPU/8MB cache/DDR3 800MHz

4

4.8 GT/s

Nehalem-EP

A01-X0100

3.33GHz Xeon X5680 130W CPU/12MB cache/DDR3 1333MHz

6

6.4 GT/s

Westmere-EP

X

A01-X0102

2.93GHz Xeon X5670 95W CPU/12MB cache/DDR3 1333MHz

6

6.4 GT/s

Westmere-EP

X

A01-X0105

2.66GHz Xeon X5650 95W CPU/12MB cache/DDR3 1333MHz

6

6.4 GT/s

Westmere-EP

X

A01-X0106

2.26GHz Xeon L5640 60W CPU/12MB cache/DDR3 1333MHz

6

5.86 GT/s

Westmere-EP

X

A01-X0107

2.13GHz Xeon L5630 40W CPU/12MB cache/DDR3 1066MHz

4

5.86 GT/s

Westmere-EP

A01-X0108

1.86GHz Xeon L5609 40W CPU/12MB cache/DDR3 1066MHz

4

4.8 GT/s

Westmere-EP

A01-X0109

2.66GHz Xeon E5640 80W CPU/12MB cache/DDR3 1066MHz

4

5.86 GT/s

Westmere-EP

A01-X0111

2.40GHz Xeon E5620 80W CPU/12MB cache/DDR3 1066MHz

4

5.86 GT/s

Westmere-EP

A01-X0113

2.13GHz Xeon E5506 80W CPU/4MB cache/DDR3 800MHz

4

4.8 GT/s

Nehalem-EP

A01-X0115

3.46GHz Xeon X5690 130W CPU/12MB cache/DDR3 1333MHz

6

6.4 GT/s

Westmere-EP

X

A01-X0117

3.06GHz Xeon X5675 95W CPU/12MB cache/DDR3 1333MHz

6

6.4 GT/s

Westmere-EP

X

A01-X0120

2.53GHz Xeon E5649 80W CPU/12MB cache/DDR3 1333MHz

6

5.86 GT/s

Westmere-EP

x

A01-X0123

2.13GHz Xeon E5606 80W CPU/8MB cache/DDR3 1066MHz

4

4.8 GT/s

Westmere-EP

PID

CPU

N20-X00001

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

X

36

B200 M3 Blade Server CPU options

BRKCOM-1005

PID

CPU

UCS-CPU-E5-2690

Cores

QPI Speed

2.90 GHz E5-2690/135W 8C/20MB Cache/DDR3 1600MHz

8

8 GT/s

Xeon E5

X

UCS-CPU-E5-2680

2.70 GHz E5-2680 130W 8C/20MB Cache/DDR3 1600MHz

8

8 GT/s

Xeon E5

x

UCS-CPU-E5-2665

2.40 GHz E5-2665/115W 8C/20MB Cache/DDR3 1600MHz

8

8 GT/s

Xeon E5

x

UCS-CPU-E5-2650

2.00 GHz E5-2650/95W 8C/20MB Cache/DDR3 1600MHz

8

8 GT/s

Xeon E5

x

UCS-CPU-E5-2640

2.50 GHz E5-2640/95W 6C/15MB Cache/DDR3 1333MHz

6

7.2 GT/s

Xeon E5

UCS-CPU-E5-2620

2.00 GHz E5-2620/95W 6C/15MB Cache/DDR3 1333MHz

6

7.2 GT/s

Xeon E5

UCS-CPU-E5-2643

3.30 GHz E5-2643/130W 4C/10MB Cache/DDR3 1600MHz

4

8 GT/s

Xeon E5

X

UCS-CPU-E5-2660

2.20 GHz E5-2660/95W 8C/20MB Cache/DDR3 1600MHz

8

8 GT/s

Xeon E5

X

© 2013 Cisco and/or its affiliates. All rights reserved.

Architecture

Support
1600Mhz
Memory
Speed

Cisco Public

37

B230 and B440 Blade Server CPU options
PID

CPU

B230M1

B440M1

B230M2

B440M2

A01-X0308

2.00GHz Xeon X6550 130W CPU/18MB cache

8

6.4 GT/s

Nehalem-EX 2S

Yes

No

No

No

A01-X0304

2.00GHz Xeon E6540 105W CPU/18MB cache

6

6.4 GT/s

Nehalem-EX 2S

Yes

No

No

No

A01-X0302

1.73GHz Xeon E6510 105W CPU/12MB cache

4

4.8 GT/s

Nehalem-EX 2S

Yes

No

No

No

A01-X0200

2.26GHz Xeon X7560 130W CPU/24MB cache

8

6.4 GT/s

Nehalem-EX

Yes

Yes

No

No

A01-X0201

2.00GHz Xeon X7550 130W CPU/18MB cache

8

6.4 GT/s

Nehalem-EX

No

Yes

No

No

A01-X0206

1.86GHz Xeon L7555 95W CPU/24MB cache

8

5.8 GT/s

Nehalem-EX

Yes

Yes

No

No

A01-X0202

2.67GHz Xeon X7542 130W CPU/18MB cache

8

5.8 GT/s

Nehalem-EX

No

No

No

No

A01-X0203

2.00GHz Xeon E7540 105W CPU/18MB cache

6

6.4 GT/s

Nehalem-EX

No

Yes

No

No

A01-X0209

1.86GHz Xeon E7520 95W CPU/18MB cache

4

4.8 GT/s

Nehalem-EX

No

Yes

No

No

2.4 GHz E7-4870 130W 10C CPU / 30M Cache

10

6.4 GT/s

Westmere EX

No

No

No

Yes

2.26 GHZ E7-4860 130W 10C CPU / 24M Cache

10

6.4 GT/s

Westmere EX

No

No

No

Yes

2 GHz E7-4850 130W 10C CPU / 24M Cache

10

6.4 GT/s

Westmere EX

No

No

No

Yes

2.13 GHz E7-4830 105W 8C CPU / 24M Cache

8

6.4 GT/s

Westmere EX

No

No

No

Yes

1.86 GHz E7-4807 95W 6c CPU / 18m Cache

6

4.8 GT/s

Westmere EX

No

No

No

Yes

UCS-CPU-E72870

2.4 GHz E7-2870 130W 10C / 30M Cache

10

6.4 GT/s

Westmere EX

No

No

Yes

No

UCS-CPU-E72860

2.26 GHz E7-2860 130W 10C / 24M Cache

10

6.4 GT/s

Westmere EX

No

No

Yes

No

UCS-CPU-E72850

2 GHz E7-2850 130W 10C /24M Cache

10

6.4 GT/s

Westmere EX

No

No

Yes

No

UCS-CPU-E72830

2.13 GHz E7-2830 105W 8C / 24M Cache

8

6.4 GT/s

Westmere EX

No

No

Yes

No

UCS-CPU-E72803

1.73 GHz E7-2803 105W 6C / 18M Cache

6

4.8 GT/s

Westmere EX

No

No

Yes

No

UCS-CPU-E78867L

2.13 GHz E7-8867L 105W 10C / 30M Cache

10

6.4 GT/s

Westmere EX

No

No

Yes

Yes

UCS-CPU-E74870
UCS-CPU-E74860
UCS-CPU-E74850
UCS-CPU-E74830
UCS-CPU-E74807

BRKCOM-1005

Cores

QPI Speed Architecture

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

38

Drives Supported

BRKCOM-1005

B200

B250

B230

146GB 6Gb SAS 15K

X

X

X

300GB 6Gb SAS 15k

X

X

X

300GB 6Gb SAS 10k

X

X

X

600GB 6Gb SAS 10k

X

X

X

900GB 6Gb SAS 10k

X

X

X

500GB SATA 7.2k

X

1TB SATA 7.2k

X

100GB SATA SSD

X

X

X

200GB SATA SSD

X

100GB Low Height 7mm
SATA SSD

X

200GB Low Height 7mm SATA
SSD

X

300GB Low Height 7mm SATA
SSD

X

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

B440

39

Building Blocks
UCS Manager
Embedded in Fabric Interconnect
UCS Fabric Interconnects
6100
6200
UCS Fabric Extenders
Logically part of Fabric Interconnect
Inserts into Blade Enclosure
UCS Blade Server Chassis
Flexible bay configurations
Logically part of Fabric Interconnect
UCS Blade Servers
Different blade types
Mix blade types within enclosure
UCS Rack Servers
Different server types
Standalone or UCSM integrated
UCS Adapters
Three adapter options
Mix adapters within blade
BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

40

C22 M3

C24 M3

C220 M3

C240 M3

C260 M2

C420 M3

C460 M2

RU

1

2

1

2

2

2

4

Cores

16

16

16

16

20

32

40

DIMMs

12

12

16

24

64

48

64

Max GB

192GB*

192GB*

512GB

768GB

1TB

1,5TB

512GB

Disk

8 x 2.5” or
4 x 3.5”

24 x 2.5” or
12 x 3.5”

8 x 2.5” or
4 x 3.5”

24 x 2.5” or
12 x 3.5”

16 x 2.5” or 32 x
SSD

16 x 2.5”

16 x 2.5”

LoM

2 x 1Gb

2 x 1Gb

2 x 1Gb

4 x 1Gb

2 x 1Gb + 2 x
10Gb

2 x 10Gb

2 x 1Gb +
2 x 10Gb

PCIe Slots

2 x PCIe
3.0

5 x PCIe
3.0

2 x PCIe
3.0

5 x PCIe
3.0

6 x PCIe 2.0

6 x PCIe 3.0

10 x PCIe 2.0

Internal
Storage

USB Port

USB Port

USB Port
FlexFlash

USB Port
FlexFlash

USB Port
FlexFlash

USB Port
FlexFlash

eUSB

*384GB w/ 32GB DIMMs
BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

41

Rack Mount Server Overview

C22 M3

C24 M3

C220 M3

C240 M3

C260 M2

C420 M3

C460 M2

RU

1

2

1

2

2

2

4

Cores

16

16

16

16

20

32

40

DIMMs

12

12

16

24

64

48

64

Max GB

192GB*

192GB*

512GB

768GB

1TB

1,5TB

512GB

Disk

8 x 2.5” or
4 x 3.5”

24 x 2.5” or
12 x 3.5”

8 x 2.5” or
4 x 3.5”

24 x 2.5” or
12 x 3.5”

16 x 2.5” or 32 x
SSD

16 x 2.5”

16 x 2.5”

LoM

2 x 1Gb

2 x 1Gb

2 x 1Gb

4 x 1Gb

2 x 1Gb + 2 x
10Gb

2 x 10Gb

2 x 1Gb +
2 x 10Gb

PCIe
Slots

2 x PCIe
3.0

5 x PCIe
3.0

2 x PCIe
3.0

5 x PCIe
3.0

6 x PCIe 2.0

6 x PCIe 3.0

10 x PCIe 2.0

Internal
Storage

USB Port

USB Port

USB Port
FlexFlash

USB Port
FlexFlash

USB Port
FlexFlash

USB Port
FlexFlash

eUSB

*384GB w/ 32GB DIMMs
BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

42

C200 M2 Rack Server

2 Socket
Intel 55xx and 56xx CPUs
12 DIMM slots
Maximum memory speed 1333MHz
4 3.5” or 8 2.5” Internal HDDs
SFF – SAS, SATA and SSD options
Battery Backed cache option
Built in Intel ICH10 SW Raid
Supports RAID 0, 1, 5 and 10
650W PSUs
2 PCIe slots
Height 1RU
Integrated CIMC and KVM

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

43

UCS C200 M2

PSUs

VGA, Serial, USB and
Management LAN

Internal LAN

Power button, Status LEDs and KVM connector

DVD

Internal HDDs

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

44

UCS C200 M2

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

45

UCS C200 M2

X8

Slot A

½ Height
½ Length

Slot B

Full Height
½ Length

IOH
X16

SLOT
A
BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

SLOT
B
Cisco Public

46

C210 M2 Rack Server

2 Socket

Intel 55xx and 56xx CPUs
12 DIMM slots
Maximum memory speed 1333MHz
16 Internal HDDs
SFF – SAS, SATA and SSD options
Battery Backed cache option
Built in Intel ICH10 SW Raid
Supports RAID 0, 1, 5 and 10
650W PSUs
5 PCIe slots
Height 2RU
Integrated CIMC and KVM

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

47

UCS C210 M2

PSUs

BRKCOM-1005

VGA, Serial, USB and
Management LAN

© 2013 Cisco and/or its affiliates. All rights reserved.

Internal LAN

Cisco Public

48

UCS C210 M2

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

49

UCS C210 M2
X8

x8
X8

PCIe
Switch

x8

Slot A

Full Height
½ Length

Slot B

Full Height
½ Length

Slot C

Full Height
½ Length

Slot D

Full Height
Full Length

Slot E

Full Height
Full Length

IOH
x8

x8

SLOT D

SLOT A

SLOT E

SLOT B
SLOT C

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

50

C220 M3 Rack Server

2 Socket
Intel E5-2600
16 DIMM slots
Maximum memory speed 1600MHz
8 or 4 Internal HDDs
SFF and 3.5” – SAS, SATA and SSD options
Battery Backed cache option
650W PSUs – Platinum Rated
2 PCIe slots
Height 1RU
Integrated CIMC and KVM

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

51

C220 M3

PSUs

BRKCOM-1005

VGA Serial and CIMC
interfaces

© 2013 Cisco and/or its affiliates. All rights reserved.

Integrated 1Gb LOM
Intel i350

Cisco Public

USB

52

C220 M3

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

53

C220 M3

CPU
#1

PCIe 3.0 x16 Slot A – Full height, ½ length

PCIe 3.0 x8 Slot B – ½ height, ½ length
CPU
#2

PCIe 3.0 x8 RAID Mezz

SLOT B

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

SLOT A

Cisco Public

54

C240 M3 Rack Server

2 Socket
Intel E5-2600
24 DIMM slots
Maximum memory speed 1600MHz
24 or 12 Internal HDDs
SFF and 3.5” – SAS, SATA and SSD options
Battery Backed cache option
650W and 1200W PSUs – Platinum Rated
5 PCIe slots – GPU ready
Height 2RU
Integrated CIMC and KVM

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

55

C240 M3

PSUs

BRKCOM-1005

VGA, Serial, USB and
Management LAN

© 2013 Cisco and/or its affiliates. All rights reserved.

Integrated 1Gb LOM
Intel i350

Cisco Public

56

C240 M3

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

57

C240 M3
PCIe 3.0 x8 Slot A – Full height, ½ Length
CPU
#1

PCIe 3.0 x16 Slot B – Full height, ½ Length
PCIe 3.0 x8 Slot C – Full height, ½ Length

PCIe 3.0 x8 Slot D – ½ height, ¾ length
CPU
#2

PCIe 3.0 x16 Slot E – Full height, ¾ length, GPU ready

PCIe 3.0 x8 RAID Mezz

SLOT A
SLOT E

SLOT D

SLOT B
SLOT C

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

58

C250 M2 Rack Server

2 Socket
Intel 55xx and 56xx CPUs
48 DIMM slots
Maximum memory speed 1333MHz
8 Internal HDDs
SFF – SAS, SATA and SSD options
Battery Backed cache option
850W PSUs
5 PCIe slots
Height 2RU
Integrated CIMC and KVM

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

59

UCS C250 M2

PSUs

VGA, Serial and USB

Internal LAN

Management
ports

Hot Pluggable FANs
BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

60

UCS C250 M2

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

61

UCS C250 M2
x16

x16
x8

PCIe
Switch

x8

Slot D

Full Height
½ Length

Slot E

Full Height
½ Length

Slot A

½ Height
½ Length

Slot B

½ Height
½ Length

Slot C

½ Height
½ Length

IOH
x8
x8

Slot C

Slot E

Slot B

Slot D

PCIe
Switch

x8

Slot A

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

62

C260 M2 Rack Server

2 Socket
Intel E7 CPUs
32 or 64 DIMM slots
Maximum memory speed 1066MHz
16 Internal HDDs
SFF – SAS, SATA and SSD options
Battery Backed cache option
1200W PSUs
Internal Flash Storage
6 PCIe slots
Height 2RU
Integrated CIMC and KVM

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

63

UCS C260 M2

Internal LAN

BRKCOM-1005

Flex LOM

© 2013 Cisco and/or its affiliates. All rights reserved.

Management ports

Cisco Public

64

UCS C260 M2

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

65

UCS C260 M2
x16

CPU
#1

CPU
#2

Raiser A

Full Height
½ Length

Slot A

½ Height
½ Length

x8

Slot B

x8

Flex LOM

½ Height
½ Length

x8

Slot C

x8

IOH
#1

IOH
#2

x4

Slot D

x16

Raiser B

½ Height
½ Length
½ Height
½ Length
Full Height
½ Length

RAISER B

BRKCOM-1005

RAISER A
S
L
O
T

S
L
O
T

D

C

F
L
E
X
L
O
M

© 2013 Cisco and/or its affiliates. All rights reserved.

S
L
O
T

S
L
O
T

B

A

Cisco Public

66

C460 M2 Rack Server

4 Socket
Intel E7 CPUs
64 DIMM slots
Maximum memory speed 1066MHz
12 Internal HDDs
SFF – SAS, SATA and SSD options
Battery Backed cache option
850W PSUs
Internal Flash Storage
10 PCIe slots
Height 4RU
Integrated CIMC and KVM

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

67

UCS C460 M2

Internal LAN
Management ports
Internal 10GbE LAN Base-T and SFP

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

68

UCS C460 M2

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

69

UCS C460 M2
Gen1 x4

ICH 10
(shared)

Gen2 x8 lanes

QPI Link

IOH
#1
CPU
#2

CPU
#1

CPU
#3

Gen2 x8 lanes

Slot #2#2
(Hot Swap)
Slot
Slot
#2
¾ length
x8 physical

Gen2 x4 lanes

Slot #3#3
Slot
Slot
#3
½ length

x8 physical

Slot #4#4
Slot
Slot
#4
½ length

x8 physical

Slot #5
Slot
#5
¾ length

x16 physical

Gen2 x8 lanes

Slot #6 (Hot Swap)
Slot
#6 x8 physical
¾ length

Gen2 x8 lanes

Slot #7 (Hot Swap)
Slot
#7 x8 physical
¾ length

Gen2 x4 lanes

Slot #8
Slot
#8
¾ length

x8 physical

Slot #9
½ length

x8 physical

Gen1 x4 lanes

BRKCOM-1005

SAS Riser (occupied)

Slot #1#1
(Hot Swap)
Slot
Slot
#1
¾ length
x8 physical

Gen2 x16 lanes

IOH
#2

x8 physical

Gen2 x8 lanes

Gen2 x4 lanes

CPU
#4

Gen1 x4

Slot #10
½ length

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

70

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

Slot #10

Slot #9

Slot #8

Slot #7

Slot #6

Slot #5

Slot #4

Slot #3

Slot #2

Slot #1

SAS Riser

UCS C460 M2

71

C200, C210 and C250 Rack Server CPU options

Cores

QPI Speed

Architecture

Support
1333Mhz
Memory
Speed

2.93GHz Xeon X5570 95W CPU/8MB cache/DDR3 1333MHz

4

6.4 GT/s

Nehalem-EP

X

N20-X00002

2.53GHz Xeon E5540 80W CPU/8MB cache/DDR3 1066MHz

4

5.86 GT/s

Nehalem-EP

Yes

Yes

Yes

N20-X00003

2.26GHz Xeon E5520 80W CPU/8MB cache/DDR3 1066MHz

4

5.86 GT/s

Nehalem-EP

Yes

Yes

No

N20-X00004

2.26GHz Xeon L5520 60W CPU/8MB cache/DDR3 1066MHz

4

5.86 GT/s

Nehalem-EP

Yes

Yes

No

N20-X00006

2.66GHz Xeon X5550 95W CPU/8MB cache/DDR3 1333MHz

4

6.4 GT/s

Nehalem-EP

Yes

Yes

Yes

N20-X00009

2.00GHz Xeon E5504 80W CPU/8MB cache/DDR3 800MHz

4

4.8 GT/s

Nehalem-EP

Yes

Yes

No

A01-X0100

3.33GHz Xeon X5680 130W CPU/12MB cache/DDR3 1333MHz

6

6.4 GT/s

Westmere-EP

X

No

No

Yes

A01-X0102

2.93GHz Xeon X5670 95W CPU/12MB cache/DDR3 1333MHz

6

6.4 GT/s

Westmere-EP

X

Yes

Yes

Yes

A01-X0105

2.66GHz Xeon X5650 95W CPU/12MB cache/DDR3 1333MHz

6

6.4 GT/s

Westmere-EP

X

Yes

Yes

Yes

A01-X0106

2.26GHz Xeon L5640 60W CPU/12MB cache/DDR3 1333MHz

6

5.86 GT/s

Westmere-EP

X

Yes

Yes

No

A01-X0107

2.13GHz Xeon L5630 40W CPU/12MB cache/DDR3 1066MHz

4

5.86 GT/s

Westmere-EP

Yes

Yes

No

A01-X0108

1.86GHz Xeon L5609 40W CPU/12MB cache/DDR3 1066MHz

4

4.8 GT/s

Westmere-EP

Yes

Yes

No

A01-X0109

2.66GHz Xeon E5640 80W CPU/12MB cache/DDR3 1066MHz

4

5.86 GT/s

Westmere-EP

Yes

Yes

Yes

A01-X0111

2.40GHz Xeon E5620 80W CPU/12MB cache/DDR3 1066MHz

4

5.86 GT/s

Westmere-EP

Yes

Yes

Yes

A01-X0113

2.13GHz Xeon E5506 80W CPU/4MB cache/DDR3 800MHz

4

4.8 GT/s

Nehalem-EP

Yes

Yes

No

A01-X0115

3.46GHz Xeon X5690 130W CPU/12MB cache/DDR3 1333MHz

6

6.4 GT/s

Westmere-EP

X

No

No

Yes

A01-X0117

3.06GHz Xeon X5675 95W CPU/12MB cache/DDR3 1333MHz

6

6.4 GT/s

Westmere-EP

X

Yes

Yes

Yes

A01-X0120

2.53GHz Xeon E5649 80W CPU/12MB cache/DDR3 1333MHz

6

5.86 GT/s

Westmere-EP

x

Yes

Yes

Yes

A01-X0123

2.13GHz Xeon E5606 80W CPU/8MB cache/DDR3 1066MHz

4

4.8 GT/s

Westmere-EP

Yes

Yes

No

PID

CPU

N20-X00001

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

X

Cisco Public

C200

C210

C250

Yes

Yes

Yes

72

C220 and C240 Rack Server CPU Options

PID

CPU

UCS-CPU-E5-2690

C220

C240

Cores

QPI Speed

2.90 GHz E5-2690/135W 8C/20MB Cache/DDR3 1600MHz

8

8 GT/s

Xeon E5

X

Yes

Yes

UCS-CPU-E5-2680

2.70 GHz E5-2680 130W 8C/20MB Cache/DDR3 1600MHz

8

8 GT/s

Xeon E5

x

Yes

Yes

UCS-CPU-E5-2665

2.40 GHz E5-2665/115W 8C/20MB Cache/DDR3 1600MHz

8

8 GT/s

Xeon E5

x

Yes

Yes

UCS-CPU-E5-2650

2.00 GHz E5-2650/95W 8C/20MB Cache/DDR3 1600MHz

8

8 GT/s

Xeon E5

x

Yes

Yes

UCS-CPU-E5-2640

2.50 GHz E5-2640/95W 6C/15MB Cache/DDR3 1333MHz

6

6.4 GT/s

Xeon E5

Yes

Yes

UCS-CPU-E5-2630

2.30 GHz E5-2630/95W 6C/15MB Cache/DDR3 1333MHz

6

4.8 GT/s

Xeon E5

Yes

Yes

UCS-CPU-E5-2620

2.00 GHz E5-2620/95W 6C/15MB Cache/DDR3 1333MHz

6

Xeon E5

Yes

Yes

UCS-CPU-E5-2609

2.4 GHz E5-2609/80W 4C/10MB Cache/DDR3 1066MHz

4

Xeon E5

Yes

Yes

UCS-CPU-E5-2643

3.30 GHz E5-2643/130W 4C/10MB Cache/DDR3 1600MHz

4

8 GT/s

Xeon E5

X

Yes

Yes

UCS-CPU-E5-2650L

1.8GHz E5-2650L/70W 8C/20MB Cache/DDR3 1600MHz

8

8 GT/s

Xeon E5

X

Yes

Yes

UCS-CPU-E5-2630L

2.00 GHz E5-2630L/60W 6C/15MB Cache/DDR3 1333MHz

6

Yes

Yes

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Architecture

Support
1600Mhz
Memory
Speed

Xeon E5

Cisco Public

73

C260 and C460 Rack Server CPU options
PID

CPU

B440M1

C260M2

C460M2

A01-X0200

2.26GHz Xeon X7560 130W CPU/24MB cache

8

6.4 GT/s

Nehalem-EX

Yes

No

No

A01-X0201

2.00GHz Xeon X7550 130W CPU/18MB cache

8

6.4 GT/s

Nehalem-EX

Yes

No

No

A01-X0206

1.86GHz Xeon L7555 95W CPU/24MB cache

8

5.8 GT/s

Nehalem-EX

Yes

No

No

A01-X0202

2.67GHz Xeon X7542 130W CPU/18MB cache

8

5.8 GT/s

Nehalem-EX

Yes

No

No

A01-X0203

2.00GHz Xeon E7540 105W CPU/18MB cache

6

6.4 GT/s

Nehalem-EX

Yes

No

No

A01-X0209

1.86GHz Xeon E7520 95W CPU/18MB cache

4

4.8 GT/s

Nehalem-EX

Yes

No

No

2.4 GHz E7-4870 130W 10C CPU / 30M Cache

10

6.4 GT/s

Westmere EX

No

No

Yes

2.26 GHZ E7-4860 130W 10C CPU / 24M Cache

10

6.4 GT/s

Westmere EX

No

No

Yes

2 GHz E7-4850 130W 10C CPU / 24M Cache

10

6.4 GT/s

Westmere EX

No

No

Yes

2.13 GHz E7-4830 105W 8C CPU / 24M Cache

8

6.4 GT/s

Westmere EX

No

No

Yes

1.86 GHz E7-4807 95W 6c CPU / 18m Cache

6

4.8 GT/s

Westmere EX

No

No

Yes

UCS-CPU-E72870

2.4 GHz E7-2870 130W 10C / 30M Cache

10

6.4 GT/s

Westmere EX

No

Yes

No

UCS-CPU-E72860

2.26 GHz E7-2860 130W 10C / 24M Cache

10

6.4 GT/s

Westmere EX

No

Yes

No

UCS-CPU-E72850

2 GHz E7-2850 130W 10C /24M Cache

10

6.4 GT/s

Westmere EX

No

Yes

No

UCS-CPU-E72830

2.13 GHz E7-2830 105W 8C / 24M Cache

8

6.4 GT/s

Westmere EX

No

Yes

No

UCS-CPU-E72803

1.73 GHz E7-2803 105W 6C / 18M Cache

6

4.8 GT/s

Westmere EX

No

Yes

No

UCS-CPU-E78867L

2.13 GHz E7-8867L 105W 10C / 30M Cache

10

6.4 GT/s

Westmere EX

No

Yes

Yes

UCS-CPU-E78837

2.67 GHz E7-8837 130W 8C / 30M Cache

8

6.4 GT/s

Westmere EX

No

No

Yes

UCS-CPU-E74870
UCS-CPU-E74860
UCS-CPU-E74850
UCS-CPU-E74830
UCS-CPU-E74807

BRKCOM-1005

Cores

QPI Speed Architecture

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

74

Rack Mount RAID Controllers

Max # drives
ICH10
4
LSI 1064
4
LSI 3081E
8
LSI 9240-8i
8
LSI 9260-8i
8
LSI 9261-8i
8
LSI 9280-4i4e
4
8
LSI 2008-8i
8
LSI 9266-8i

BRKCOM-1005

SAS or
SATA
SATA
SAS/SATA
SAS/SATA
SAS/SATA
SAS/SATA
SAS/SATA
SAS/SATA
SAS/SATA
SAS/SATA

RAID
SW 0 and 1
HW 0 and 1
HW 0 and 1
HW 0, 1, 5, 6, 10, 50 and 60
HW 0, 1, 5, 6, 10, 50 and 60
HW 0, 1, 5, 6, 10, 50 and 60
HW 0, 1, 5, 6, 10, 50 and 60
HW 0, 1, 5, 10 and 50
HW 0, 1, 5, 6, 10, 50 and 60

© 2013 Cisco and/or its affiliates. All rights reserved.

BBC C200 C210 C220 C240 C250 C260 C460
x
x
x
x
x
x
x
x
x
x
x
x
x
x
x
X
X
x
X
X

Cisco Public

75

Building Blocks
UCS Manager
Embedded in Fabric Interconnect
UCS Fabric Interconnects
6100
6200
UCS Fabric Extenders
Logically part of Fabric Interconnect
Inserts into Blade Enclosure
UCS Blade Server Chassis
Flexible bay configurations
Logically part of Fabric Interconnect
UCS Blade Servers
Different blade types
Mix blade types within enclosure
UCS Rack Servers
Different server types
Standalone or UCSM integrated
UCS Adapters
Three adapter options
Mix adapters within blade
BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

76

Adapters for B-Series M72KR-Q
 High Performance 10Gbps per port
maximum throughput for high bandwidth
SAN and LAN traffic
 Full hardware offload for FCoE protocol
processing
 250,000 IOPS per port deliver high I/O
 Up to 8Gb FC throughput
 Full support for TCP/IP and Ethernet
with enhancements
 Priority-based Flow Control (802.1Qbb)
 Jumbo frames
 Checksum offloads
 Segmentation offloads

 Common driver for CNAs and HBAs
 Low power ~ 5W

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

77

I/O Adapters for B-Series M72KR-E
 Full 10Gbps network performance
with support both LAN and SAN traffic
 Full hardware offload for FCoE
protocol processing
 PCIe Express 2.0 (x8, 5GT/s), MSI-X
support
 Integrated data buffer and code space
memory
 Theoretical 10Gb FC throughput
 Common driver for UCNAs and HBAs
 Support for Jumbo frames
 Cannot do per priority pause on
Ethernet traffic.

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

78

I/O Adapters for B-Series M61KR-I

 Interface Type PCIe v2.0 (5.0GT/s)
 Intel® VT-dVMDq, SR-IOV
 Full support for TCP/IP and Ethernet
with enhancements:
 Priority-based Flow Control (802.1Qbb)
 Jumbo frames
 Checksum offloads
 Segmentation offloads

 Low power ~7W

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

79

I/O Adapters for B-Series M51KR-B

 Broadcom NetXtreme II 57711 DualPort 10 Gigabit Ethernet PCIe Adapter

 x8 PCI Express base specifications
v2.0 and v1.1
 iSCSI offload
 Virtual LANs (VLANs), IEEE 802.1q
 IEEE 802.3x flow control
 TCP, IP, UDP checksum offload - TCP
segmentation
 iSCSI Boot capable

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

80

UCS 1280 VIC
Customer benefits


80 Gb I/O connectivity per adapter



VM-FEX scale to 116 VM

Feature details
• Dual 4x10 Gbps port-channel to a single slot
• Host connectivity PCIe Gen2 x6
• HW Capable of 256 PCIe devices
• OS restriction apply
• PCIe virtualization OS independent

• Single OS driver image for both VICs
• FabricFailover supported
• No user configuration required for 4x10Gb port
channel
• Not limited to 10Gig bandwidth per vNIC
• Flows from each vNIC can be load balanced

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

81

3rd Party Adapters for UCS C-Series
I/0 Adapters:

BRKCOM-1005

N2XX-ABPCI02
N2XX-ABPCI03
N2XX-ABPCI01
UCSC-PCIE-BSFP

- Broadcom BCM57711, 10 GbE Dual Port NIC (TwinAx Cable Only)
- Broadcom BCM5709, GbE Quad Port GE NIC
- Broadcom BCM5709, GbE Dual Port GE NIC
- Broadcom BCM57712, 10GbE Dual Port NIC

N2XX-AEPCI01
N2XX-AEPCI03
N2XX-AEPCI05

- Emulex OneConnect OCe10102-F FCoE CNA (TwinAx Cable Only)
- Emulex LPE 11002 4Gb Dual Channel FC HBA
- Emulex Lpe 12002 8Gb Dual Port FC HBA

N2XX-AIPCI01
N2XX-AIPCI02

- Intel Ethernet X520 10GbE Dual Port Server Adapter (TwinAx Cable Only)
- Intel Quad Port GE NIC

N2XX-AQPCI01
N2XX-AQPCI03

- Qlogic QLE 8152 (FCoE) 10 Gb 2-port CNA (TwinAx Cable Only)
- Qlogic 2462 4Gb Dual-Channel FC HBA

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

82

Connectivity

UCS FI Operating Modes
End Host

•

External LAN sees UCS 6100 as an end-host

Switch

•

External LAN sees UCS 6100 as a traditional
Ethernet switch (STP = PVST+)

with multiple adapters (no STP)
•

Active/Active use of uplinks by pinning

•

Some uplinks blocked by STP (no pinning)

•

Single upstream L2 domain

•

Single or disjoint L2 domains

•

More scalable than switch mode

•

MAC learning on uplink/server interfaces

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

84

UCS Ethernet Connectivity
IP Storage

FCoE Storage

LAN

uplinks

appliance
UCS 6100

storage target
UCS 6100

monitor
Nexus 2248

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Nexus 2248

Cisco Public

85

Port Types Vs. FI Operating Mode

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

86

From Chassis to Fabric Interconnect

Fabric
Interconnects
(UCS 61XX)

SFP+

Module

SFP+

Module

IO Module to 61XX
Blades pinned to uplink based
On Slot number

IO Modules
UCS 2104

UCS 2104

Midplane

Mezz
10Gb Mezz
x16 Gen 2
x16 Gen 2

Server Blade

IOH

CPU

CPU

Blade Chassis
BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

87

From Chassis to Fabric Interconnect - New

Fabric
Interconnects
(UCS 6248)

16x
SFP+

16x
SFP+

Module

16x
SFP+

16x
SFP+

Module

IO Module to 6248 links user
configuration Ether channel
IO Modules
(UCS 2208)

UCS 2208

UCS 2208

Midplane

Mezz
(UCS 1280)

UCS 1280
x16 Gen 2
x16 Gen 2

Server Blade

IOH

CPU

 4x10 Gbps Ether channel from VIC-2 to 2208 IO Modules
 No user configuration required
 vNIC flows are 5-tuple LB across links
 Each individual flow limited to 10Gb
 Fabric Failover available

CPU

Blade Chassis
BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

88

UCS Connectivity Summary
LAN
CLOUD

FC STORAGE

SAN Switch
Upstream Switch in NPIV Mode

LAN Switch
UCS Ethernet in EHM

UCS FC in NPV Mode

UCS Fabric Interconnect

NAS STORAGE

Access Layer LAN & SAN
Unified Fabric (FCoE)

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

89

FC Switch Mode
SAN Fabric

Storage Arrays
Fibre Channel

Fabric A

Fabric B

Ethernet

Core

Direct Attach

Unified I/O
FCoE

FC Storage
FCoE Storage
SAN Edge B

SAN Edge A

 Must have connection to
MDS FC Switch or N5K

UCS 6100

UCS 6100

 Data traffic doesn’t have to go through
FC switch or N5K

 Only works with Cisco
FC Switches or N5K

UCS B-Series
BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

90

UCS C-Series Integration to UCSM

UCS 6100 or 6200

Nexus
2232

UCS 6100 or 6200

Nexus
2232

GE LOM

PCIe Adapter

Mgmt Traffic
Data Traffic

BRKCOM-1005

CIMC

OS or Hypervisor

© 2013 Cisco and/or its affiliates. All rights reserved.

• Reduce cost of deployment
• Scale and performance
• Choose from 5 servers
• Scale to 160 C-Series per domain

Cisco Public

91

VM-FEX and Adapter FEX

Different FEX technologies

VM FEX

Features:
•

Adapter FEX split a physical NIC into
multiple logical NICs

•

VM-FEX extends Adapter FEX
technology to virtual machine

•

Based on open Standards

Benefits:
•

Same functionality in Physical and Virtual
environments

•

Increased bandwidth utilization by sharing physical
interface to multiple Applications and/or VMs

•

Improved Performance and dynamic network &
security policy mobility during VM migration with
VM-FEX
Adapter FEX

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

93

Modes of VM-FEX
VMDirectPath

Emulated Mode

Standard Mode

High Performance Mode

 12%-15% CPU performance
improvement



Co-exists with Standard mode



Bypasses Hypervisor layer



30% improvement in I/O performance



vMotion supported with ESX 5.0

 vMotion supported

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

94

VM-FEX with VMware
I/O profiles defined in UCS & applied in vCenter

Server
VM
#1

VM
#2

VM
#3

Server
VM
#4

VM
#5

VM
#6

VM
#7

VM
#8

UCS DVS (PTS)
VMW ESX

VMW ESX

UCS

Port Profiles
Defined in UCS
WEB Apps

VC Deploys VMs
with UCS policies
vCenter

BRKCOM-1005

HR

UCS exports Port
Profiles to VC

© 2013 Cisco and/or its affiliates. All rights reserved.

DB
Compliance
Cisco Public

95

VM-FEX with VMware
Integrated Mobility with VMotion

Server
VM
#1

VM
#2

VM
#3

Server
VM
VM#1
#5

VM
#4

VM
VM#2
#6

VM
VM#3
#7

VM
VM#4
#8

UCS DVS (PTS)
VMW ESX

VMW ESX

UCS

VN-Link Property Mobility
• VMotion for the network
• Ensures VM security
• Maintains connection state

vCenter

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

96

VMDirectPath: How is Works
VM
Vmxnet3 Driver

Emulation <-> PT transitions
Vmxnet3

Port Events

Cisco vDS

OS PCI
subsystem

Data Path

Ethernet Device Driver

PCIe events

Control Path

Config:
Used by
PCI mgmt
layer

Mgmt Bar:
Used by
Vmkernel
and PTS

Data Bar :
Vmxnet3
compliant
Rings and
Registers

Dynamic VIC device
BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

97

VM-FEX with KVM Architecture

User

Management
Tools

Guest 1

Guest 2

Application

Application

Guest
OS
virtio-net

Libvirt
Netlink
Socket

Kernel

vhost-net
Macvtap 1
eth0

Cisco VIC

Port Profile1:
Qos1, vlan1

Guest
OS
virtio-net

Port Profile2:
Qos2, vlan2

vhost-net
Macvtap
Interface

Macvtap 2
eth2…… ethn

eth1

PF

KVM

VF1

……

VF2

Netdev
Interface

VFn

Adapter Port
Switch Port

Veth 1
Port Profile1: UCS Switch
Qos1, vlan1
BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Veth 2
Port Profile2:
Qos2, vlan2
Cisco Public

98

Recommended Reading for BRKCOM-1005

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

99

Call to Action

• Visit the Cisco Campus at the World of Solutions
to experience Cisco innovations in action

• Get hands-on experience attending one of the Walk-in Labs
• Schedule face to face meeting with one of Cisco’s engineers
at the Meet the Engineer center
• Discuss your project’s challenges at the Technical Solutions Clinics

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

100

BRKCOM-1005

© 2013 Cisco and/or its affiliates. All rights reserved.

Cisco Public

101