An Overview of Cloud Computing
Content
An Overview of
Cloud Computing
1
Agenda
• What is cloud computing?
• The definition from the industry
• How does it come about? Revolution?
Evolution?
• How many types of Cloud?
• What is the nature of Cloud?
• Why do we use Cloud?
• What kind of paradigm?
2
3
Courtesy of Dilbert.com
Courtesy of Techs24x7.com
Courtesy of Migrating your Applications and Processes to the Cloud: Practical Checklist
The physical Cloud
8
9
10
11
12
13
14
15
16
17
Cloud Computing from Carnegie-Mellon University
“A large-scale distributed computing paradigm that is
driven by economies of scale, in which a pool of
abstracted, virtualized, dynamically-scalable, managed
computing power, storage, platforms, and services are
delivered on demand to external customers over the
Internet.”
Cloud Computing is a distributed computing
paradigm that focuses on providing a wide range of
users with distributed access to virtualized hardware
and/or software infrastructure over the Internet.
18
Gartner Top 10 Strategic Technologies from 2005 t0 2009
19
Rank
1
2
2010
Cloud
Computing
Advanced
Analytics
3
Client
Computing
4
IT for Green
5
Reshaping
the
Datacenter
Social
Computing
6
7
8
9
10
2012
2011
Cloud Computing Media Tablets and
Beyond
Mobile-Centric
Mobile
Applications and
Applications &
Interfaces
Media Tablets
Contextual and Social
Social
Communications & User Experience
Collaboration
Internet of Things
Video
Next Generations App Stores and
Marketplaces
Anaytics
Social Analytics
SecurityContext-Aware
Activity
Computing
Monitoring
Flash Memory Storage Class
Memory
Virtualisation Ubiquitous
for availability Computing
Mobile
Application
2013
2014
Mobile Device Battles Web-Scale IT
Mobile Applications
and HTML5
Smart Machines
Personal Cloud
3D Printing
Enterprise App Stores The Era of Personal
Cloud
The Internet of Things Software-Defined
Anything
Next-Generation
Analytics
Hybrid IT and Cloud
Computing
Big Data
Strategic Big Data
Mobile Device
Diversity and
Management
Mobile Apps and
Applications
In-Memory Computing Actionable Analytics
The Internet of
Everything
Extreme Low-Energy In Memory Computing Hybrid Cloud & IT as a
Servers
Service Broker
Cloud Computing
Fabric-Based
Infrastructure and
Computers
Integrated Ecosystems Cloud/Client
Architecture
20
User Centric
• Data stored in the “Cloud”
• Data follows you & your devices
• Data accessible anywhere
• Data can be shared with others
messages
preferences
news
contacts
calendar
investments
maps
photo
mailing lists
music
e-mails
phone numbers
21
What is Cloud Computing
The Problem Statement
Scalability of Enterprise Applications – An Issue
Disaster – Failure due to un-planned demand
Increasing Capital Investment on IT Infrastructure
iPhone Launch
The Solution
Cloud Computing
Festival Season
Sports Event
What is Cloud Computing
Definition
“A pool of abstracted, highly scalable, and
managed compute infrastructure capable of
hosting end-customer applications and billed by
consumption”
In Simple Terms, Cloud offers…
Pay-per-use for computation power
Virtually infinite computation resources
Automatic on-demand scalability
Where does the term “Cloud” come from ?
“Cloud” is widely used as a metaphor for the Internet
Internet is the foundation of Cloud computing
Internet
What is Cloud Computing
An Analogy - Electricity
“Computation Power” is now available like Electricity
You pay for what you use.
You rely on a trusted third-party providers
Variants
Grid Computing
Grid computing is a collection of servers that
are clustered together to attack a single
problem. For a period of time, the entire
resources of the grid are available to an user to
tackle a particularly difficult compute problem.
- Rich Wolski, University of California
Utility Computing
Metered use of computational resources
Origin from utility services (Electricity)
Development of Computer
Data Processing
Cloud Computing
Grid Computing
Cluster Computing
Parallel Computing
25
Grid vs. Cloud
26
Grid
Cloud
Underlying concept
Utility Computing
Utility Computing
Main benefit
Solve computationally
complex problems
Provide a scalable
standard environment for
network-centric
application development,
testing and deployment
Resource distribution /
allocation
Negotiate and manage
resource sharing;
schedulers
Simple user <-> provider
model; pay-per-use
Domains
Multiple domains
Single domain
Character / history
Non-commercial, publicly Commercial
funded
Focus
Application Oriented
Absraction
Non-virtualisation of Host Virtualisation of Host
Service Oriented
Handy Tools We Use over
Evolutional Periods In History
Is it safe to play with your computer
when you are naked and vulnerable ?
27
Basic Concept of an
Internet Cloud
Paid Services
User
Software
Hardware
Storage
Submit
Requests
Internet
Cloud
Service
28
Network
Virtualized Datacenter is The Computer :
A Cost-Effective Computing Paradigm
• Cloud Computing
– Buy & Own
• Hardware, System
Software, Applications
often to meet peak
needs.
– Install, Configure, Test,
Verify, Evaluate
– Manage
– ..
– Finally, use it
– $$$$$....$(High Cost)
29
• Subscribe
• Use
Pay as you Go
Every 18 months?
• Classical Computing
Saving about 80-95 %
of the total cost
• $ - pay for what you use,
based on QoS
Cost Comparison
Cloud vs Traditional IT:
estimated by IBM 2009
Traditional
Current IT Expenses
100%
Cloud
Computing
Software &
Other
Expenses
Operation &
Maintenance
Deploy (One-time)
Depreciati
on
Sw & other
Exp (- 20%)
Labour Cost
( - 80.7%)
Depreciation
( - 91.6%)
30
Annual
OpEx
(21%)
Web 2.0, Clouds, and Internet of Things
HPC: High-Performance Computing, HTC: High-Throughput Computing,
P2P: Peer to Peer, MPP: Massively Parallel Processors
31
Convergence of Technologies
for Cloud Computing
Hardware
Hardware
Virtualization
Multi-core chips
Distributed
Computing
Utility &
Grid
Computing
Cloud
Computing
Autonomic Computing
Datacenter automation
Systems
Management
32
SOA
Web 2.0
Web Services
Mashups
Internet
Technology
Clouds: relation with other paradigms
33
Recent Advances in Virtualisation
vMotion & Storage vMotion
1 Multiplexing of VMs
3 Provision (Resume) of VMs
2 Suspension (Storage) of VMs
35
4 Live Migration of VMs
Global Server Usages and
Breakdown of Datacenter Cost
Datacenter Cost
($Billion)
Total Number of Servers
(Million)
Electricity and Cooling Cost
300
50
Server Management and Maintenance Cost
Server Equipment Cost
250
40
Total Number of Servers
200
30
150
20
100
10
50
96
97
98
99
00
01
02
03
36
04
05
06
07
08
09 10
Modular Datacenters
in Chilled Truck Containers
37
Interconnection of Modular Datacenters
38
Public, Private and Hybrid Clouds
39
Public vs. Private Cloud
Cloud Choices
Public Cloud
On-demand resources, scalability
Private Cloud
Hybrid Cloud
Public + Private cloud
Shared environment
Exclusive environment
Limited on-demand capabilities
On-Premise Private Cloud
Externally Hosted Private Cloud
Requires Initial Capital Investment
Exclusive, but hosted by a third party
Cloud setup within Org’s data center
Limited on-demand scaling
Control on security and audit
Expensive than public cloud
Based on basic virtualization
Cheaper than on-premise private cloud
Limited on-demand scaling
Possibility of co-location
41
42
The Three aaS’s in Cloud
IT Cloud Services
Cloud
Applications
(Apps-as-a-service)
App Dev/Test
Cloud
(Application)
App Deploy
Platforms
(Platform-as-a-Service)
Cloud
Infrastructure
(Infrastructure-as-a-Service)
43
44
Cloud Service Layers
Service
Providers
Service Users
Cloud End-User Services
(SaaS)
Cloud Providers
Cloud Platform Services (PaaS)
Cloud Infrastructure Services (IaaS)
Physical
Infrastructure
45
46
Cloud Providers – A Birds Eye View
Infrastructure
as a Service
Platform
as a Service
Software
as a Service
Cloud Computing as A Service
[9]
48
Inside a Cloud
Software as a Service
(SaaS)
Corporate Email
CRM, ERP, HR
Business Processes
The Cloud Platform
Platform as a
Service (PaaS)
Java Runtime
Web 2.0 Runtime
LAMP / WAMP
Software Platform
Infrastructure as a
Service (IaaS)
Virtual Servers
Virtual Storage
Virtualized CPUs and Storage
Virtual Network
Physical Servers
Physical Servers across the Globe
Inside a Cloud
The ‘Nuts and Bolts’ of a Public Cloud
Registration, Authentication
and Authorization
Replicates
Application on
demand
The face of the
Cloud
Facilitates
Pay-per-use
Statistics,
Deployment,
Start/Stop
Enforces
Security
Cloud
Applications
The Cloud Platform
Self Service Portal
Metering, Billing
and Rating System
Identity
Management
Dynamic Provisioning
Engine
Monitoring and
Management
Security Subsystem
Virtualized Runtime Environment (Infrastructure & Platform)
Network of Physical Servers controlled by the Cloud Operating System
The heart of the
“Cloud”
Amazon EC2 – A Detailed Insight
EC2 – Elastic Compute Cloud
S3 – Simple Storage Service
Create a virtual server instance
File System Storage of Arbitrary Data
Concept of AMI – Amazon Machine Image
Each file can be 5 GB
Choose your operating system and/or s/w
Secure storage with ACLs
SSH and SFTP to your virtual server
Used by SmugMug Photo Service
Web Service interface for admin tasks
SQS – Simple Queue Service
Elastic Map Reduce
Message Queue Infrastructure
Infrastructure for data-intensive tasks
Reliable delivery`
Web indexing, data mining, log file analysis
Simple DB
Elastic Cloud Front
Core Database Functions
Infrastructure for content delivery
Fast Indexing, Querying and retrieval
Based on closest geographical location
52
From On-Premise to Cloud Platforms
Application runs
on-premises
Buy my own
hardware, and
manage my own
data center
Application runs
at a hoster
Co-location
or
Managed
servers
Application
runs using
cloud services
“cloud fabric”
(elastic,
infini-scale)
53
Buy
Build vs. Buy
Build
“Packaged”
Application
Hosted
“Packaged”
“Software as a
Service”
An application that I buy
“off the shelf” and run
myself
An application that I buy
“off the shelf” and then
run at a hoster
A hosted application
that I buy from a
vendor
Self Hosted
“Home Built”
Hosted
“Home Built”
An application that I
develop and run myself
An application that I
develop myself, but run
at a hoster
On premises
On premises vs. Cloud
54
Cloud Platform
An application that I
develop myself, but
run in the cloud
Cloud
Build
Build vs. Buy
Buy
All acceptable options (trade off)
“Packaged”
Application
Hosted
“Packaged”
An application that I buy
“off the shelf” and run
myself
An application that I buy
“off the shelf” and then
run at a hoster
“Software as a Service”
A hosted application that
I buy from a vendor
Maximum Control
Self Hosted
“Home Built”
An application that I
develop and run myself
On premises
Hosted
“Home Built”
Cloud Platform
An application that I
develop myself, but
Maximumrun in the cloud
An application that I
develop myself, but run
at a hoster
Economy
On premises vs. Cloud
55
of Scale
Cloud
Buy
“Packaged”
ERP
Application
Build
Build vs. Buy
Issue Tracking
An application that I buy
“off the shelf” and run
Email
myself
Self Hosted
HR System
“Home
Built”
Molecule Research
An application that I
develop and run myself
Clinical Trial
On premises
Hosted
“Packaged”
“Software as a
Service”
“Too costly to run this myself,A hosted application
An application that I buy
but I’ve
too
“off themade
shelf” and
thenmany
that I buy from a
run at a hoster
vendor
customizations”
Hosted
“Home Built”
An application that I
develop myself, but run
at a hoster
On premises vs. Cloud
56
Cloud Platform
An application that I
develop myself, but
run in the cloud
Cloud
Buy
“Packaged”
Application
Build
Build vs. Buy
Issue Tracking
An application that I buy
“off the shelf” and run
Email
myself
Self Hosted
HR System
“Home
Built”
Molecule Research
An application that I
develop and run myself
Clinical Trial
On premises
Hosted
ERP
“Packaged”
“Software as a Service”
An application that I buy
“off the shelf” and then
run at a hoster
A hosted application that
I buy from a vendor
“CRM and Email are commodity
services – They have no
customizations, and it’s cheaper for
someone else to run these”
Cloud Platform
Hosted
“Home Built”
An application that I
develop myself, but run
at a hoster
On premises vs. Cloud
57
An application that I
develop myself, but
run in the cloud
Cloud
Buy
Build vs. Buy
Build
“Packaged”
Application
Hosted
ERP
“Packaged”
“Software as a
Service”
An application that I buy
“off the shelf” and run
myself
An application that I buy
“off the shelf” and then
run at a hoster
Issue Tracking
A hosted
pplication
that I buy from a
Email
vendor
Self Hosted
HR System
“Home
Built”
Molecule Research
An application that I
develop and run myself
Clinical Trial
On premises
“I can’t afford to maintain
this old HR application
writtenHosted
in VB – it’s driving
me “Home
mad!” Built”
An application that I
develop myself, but run
at a hoster
Cloud Platform
An application that I
develop myself, but
run in the cloud
“…but due to privacy issues, I
prefer keeping my HR data
On premises vs. Cloud
on-premises”
58
Cloud
Buy
Build vs. Buy
Build
“Packaged”
Application
Hosted
ERP
“Packaged”
“Software as a
Service”
An application that I buy
“off the shelf” and run
HRmyself
System
An application that I buy
“off the shelf” and then
run at a hoster
Issue Tracking
A hosted
pplication
that I buy from a
Email
vendor
Self Hosted
“Home Built”
Hosted
“Home Built”
Molecule Research
An application that I
develop and run myself
Clinical Trial
On premises
“I wish I had access to
An application that I
cheaper
compute
develop myself,
but run and
a hoster
storageatwhen
I need it”
On premises vs. Cloud
59
Cloud Platform
An application that I
develop myself, but
run in the cloud
Cloud
Buy
Build vs. Buy
Build
“Packaged”
Application
Hosted
ERP
“Packaged”
“Software as a
Service”
An application that I buy
“off the shelf” and run
HRmyself
System
An application that I buy
“off the shelf” and then
run at a hoster
Issue Tracking
A hosted
pplication
that I buy from a
Email
vendor
Self Hosted
“Home Built”
Hosted
“Home Built”
An application that I
develop and run myself
An application that I
develop myself, but run
at a hoster
Clinical Trial
On premises
On premises vs. Cloud
60
Cloud Platform
An application that I
Molecule Research
develop myself, but
run in the cloud
Cloud
Buy
Build vs. Buy
Build
“Packaged”
Application
Hosted
ERP
“Packaged”
“Software as a
Service”
An application that I buy
“off the shelf” and run
HRmyself
System
An application that I buy
“off the shelf” and then
run at a hoster
Issue Tracking
A hosted
pplication
that I buy from a
Email
vendor
Self Hosted
“Home Built”
Hosted
“Home Built”
An application that I
develop and run myself
Clinical Trial
On premises
Cloud Platform
An application that I
“THIS is where I want to
Molecule Research
develop
myself, but
An
application
that
I
spend my IT resources – I’m
develop myself, but run
run in the cloud
going to double
at a hoster down on this
application!”
On premises vs. Cloud
61
Cloud
Buy
Bild vs. Buy
Build
“Packaged”
Application
Hosted
ERP
“Packaged”
“Software as a
Service”
An application that I buy
“off the shelf” and run
HRmyself
System
An application that I buy
“off the shelf” and then
run at a hoster
Issue Tracking
A hosted
pplication
that I buy from a
Email
vendor
Self Hosted
“Home Built”
Hosted
“Home Built”
An application that I
develop and run myself
An application that I
develop myself, but run
at a hoster
Clinical Trial
On premises
On premises vs. Cloud
62
Cloud Platform
An application that I
Molecule Research
develop myself, but
run in the cloud
Cloud
SOA (Service Oriented Architecture)
implemented through Web Service
63
64
Cloud
Provider #1
Cloud Computing: Models
Printing
Service
Office
Apps
User
On Demand
CPUs
CRM
Service
Data
Storage
Service
…
Cloud
Provider #2
Enterprise
Backup
Service
ILM
Service
Service
Employee
Service
Service 3
Service
Business
Apps/Service
…
…
Internal Cloud
…
65
The
Internet
Cloud Resource Management Systems
VMWare
Nimbus
OpenNebula
Eucalyptus
66
Demand-Driven Resource Provisioning
• Utilized a lot in Grid Computing
• When a resource has surpassed a threshold for a
certain amount of time, increase that resource
• When a resource is below a threshold for a certain
amount of time, decrease that resource
• Amazon implements such an “AutoScale” feature
Picture courtesy of Intel Corp.
67
Amazon Virtual Private Cloud VPC
(http://aws.amazon.com/vpc/ )
68
vSphere 5.1 : An OS for Cloud Platform
69
Cloud Services Stack
Application
Cloud Services
Platform
Cloud Services
Compute & Storage
Cloud Services
Co-Location
Cloud Services
Network
Cloud Services
70
71
Service-Oriented Architecture (SoA)
Data
S
S
S
S
fs
fs
Filter
Service
S
S
S
S
fs
S
S
Compute
Cloud
Database
fs
fs
fs
S
S
S
S
fs
Filter
Service
fs
fs
Filter
Service
fs
SS
SS
Filter
Cloud
fs
fs
Filter
Cloud
Another
Grid
fs
Filter
Cloud
fs
SS
Discovery
Cloud
fs
fs
fs
SS
fs
fs
SS
fs
fs
Filter
Service
fs
Filter
Cloud
SS
Wisdom Decisions
Another
Grid
SS
Another
Service
Knowledge
S
S
Another
Grid
Information
S
S
Raw Data
S
S
fs
Filter
Cloud
S
S
Discovery
Cloud
fs
Traditional Grid
with exposed
services
Filter
Cloud
S
S
S
S
Storage
Cloud
S
S
Sensor or Data
Interchange
Service
Geoffrey Fox: Grid of various clouds -- from Raw Data to Wisdom.
SS = Sensor service, fs = filter services
72
Data Security and Copyright Protection
Demands in A Trusted Cloud Platform
73
Trusted Zones for VM Insulation
Identity
federation
Virtual
network
security
Insulate
infrastructure from
Malware, Trojans
and cybercriminals
Federate
identities with
public clouds
Control and
isolate VM in
the virtual
infrastructure
APP
APP
OS
OS
APP
OS
OS
Tenant
#1
Virtual Infrastructure
Access
Mgmt
Segregate and
control user
access
Cloud Provider
Insulate
information
from other
tenants
Insulate
information
from cloud
providers’
employees
PhysicalPhysical
Infrastructure
Infrastructure
Security Info. &
Event Mgmt
Cybercrime
intelligence
Strong
authentication
Tenant
#2
Virtual Infrastructure
APP
Anti-malware
Enable end to end view of security events and
compliance across 74
infrastructures
GRC
Data loss
prevention
Encryption &
key mgmt
Tokenization
Cloud Service Models and Their Security Demands
Cloud computing will not be accepted by common users unless
the trust and dependability issues are resolved satisfactorily
75
The Internet of Things
Smart
Earth
Internet of
Things (IOT)
Smart Earth
76
Architecture of The Internet of Things
Application
Layer
Merchandise
Tracking
Environment
Protection
Intelligent
Search
Telemedicine
Intelligent
Traffic
Cloud Computing
Platform
Network
Layer
Mobile
Telecom
Network
The
Internet
Information
Network
RFID
Sensor Network
GPS
RFID Label
Sensor Nodes
Road Mapper
Sensing
Layer
77
Smart
Home
Supply Chain Management
supported by the Internet of Things.
( http://www.igd.com)
78
Smart Power Grid
79
Opportunities of IOT in 3 Dimensions
80
Conclusions of Quick Overview
Virtualised clouds are changing the whole IT and service industry,
simply trying to make computing a pay-as-you-go public utility
service like water, gas, and electricity.
Cloud computing will become a common practice in business,
government, education, and entertainment leveraging millions
of servers globally installed at thousands of datacenters today.
Virtualisation support is needed in developing business clouds as
heavily pursued by IBM, Google, Microsoft, Yahoo, Amazon, SGI,
AT&T, HP, VMWare, Saleforce.com, etc.
Private clouds will become widespread in addition to using a few
public clouds, that are under heavy competition among Google, MS,
Amazon, Intel, EMC, IBM, SGI, VMWare, Saleforce.com, etc.
Effective trust management, guaranteed security, protection of
user privacy, data integrity, mobility support and copyright
protection are crucial to the universal acceptance of the cloud as a
81
dependable ubiquitous service
九霄云外
According to the terminology used by the
U.S. Weather Bureau, clouds are divided into
classes and each class is divided into nine
types. 'Cloud nine' is the cumulonimbus
cloud that you often see building up in the
sky in a hot summer afternoon. It may reach
30,000 to 40,000 feet
82
83
84
Cloud Computing
1
Agenda
• What is cloud computing?
• The definition from the industry
• How does it come about? Revolution?
Evolution?
• How many types of Cloud?
• What is the nature of Cloud?
• Why do we use Cloud?
• What kind of paradigm?
2
3
Courtesy of Dilbert.com
Courtesy of Techs24x7.com
Courtesy of Migrating your Applications and Processes to the Cloud: Practical Checklist
The physical Cloud
8
9
10
11
12
13
14
15
16
17
Cloud Computing from Carnegie-Mellon University
“A large-scale distributed computing paradigm that is
driven by economies of scale, in which a pool of
abstracted, virtualized, dynamically-scalable, managed
computing power, storage, platforms, and services are
delivered on demand to external customers over the
Internet.”
Cloud Computing is a distributed computing
paradigm that focuses on providing a wide range of
users with distributed access to virtualized hardware
and/or software infrastructure over the Internet.
18
Gartner Top 10 Strategic Technologies from 2005 t0 2009
19
Rank
1
2
2010
Cloud
Computing
Advanced
Analytics
3
Client
Computing
4
IT for Green
5
Reshaping
the
Datacenter
Social
Computing
6
7
8
9
10
2012
2011
Cloud Computing Media Tablets and
Beyond
Mobile-Centric
Mobile
Applications and
Applications &
Interfaces
Media Tablets
Contextual and Social
Social
Communications & User Experience
Collaboration
Internet of Things
Video
Next Generations App Stores and
Marketplaces
Anaytics
Social Analytics
SecurityContext-Aware
Activity
Computing
Monitoring
Flash Memory Storage Class
Memory
Virtualisation Ubiquitous
for availability Computing
Mobile
Application
2013
2014
Mobile Device Battles Web-Scale IT
Mobile Applications
and HTML5
Smart Machines
Personal Cloud
3D Printing
Enterprise App Stores The Era of Personal
Cloud
The Internet of Things Software-Defined
Anything
Next-Generation
Analytics
Hybrid IT and Cloud
Computing
Big Data
Strategic Big Data
Mobile Device
Diversity and
Management
Mobile Apps and
Applications
In-Memory Computing Actionable Analytics
The Internet of
Everything
Extreme Low-Energy In Memory Computing Hybrid Cloud & IT as a
Servers
Service Broker
Cloud Computing
Fabric-Based
Infrastructure and
Computers
Integrated Ecosystems Cloud/Client
Architecture
20
User Centric
• Data stored in the “Cloud”
• Data follows you & your devices
• Data accessible anywhere
• Data can be shared with others
messages
preferences
news
contacts
calendar
investments
maps
photo
mailing lists
music
e-mails
phone numbers
21
What is Cloud Computing
The Problem Statement
Scalability of Enterprise Applications – An Issue
Disaster – Failure due to un-planned demand
Increasing Capital Investment on IT Infrastructure
iPhone Launch
The Solution
Cloud Computing
Festival Season
Sports Event
What is Cloud Computing
Definition
“A pool of abstracted, highly scalable, and
managed compute infrastructure capable of
hosting end-customer applications and billed by
consumption”
In Simple Terms, Cloud offers…
Pay-per-use for computation power
Virtually infinite computation resources
Automatic on-demand scalability
Where does the term “Cloud” come from ?
“Cloud” is widely used as a metaphor for the Internet
Internet is the foundation of Cloud computing
Internet
What is Cloud Computing
An Analogy - Electricity
“Computation Power” is now available like Electricity
You pay for what you use.
You rely on a trusted third-party providers
Variants
Grid Computing
Grid computing is a collection of servers that
are clustered together to attack a single
problem. For a period of time, the entire
resources of the grid are available to an user to
tackle a particularly difficult compute problem.
- Rich Wolski, University of California
Utility Computing
Metered use of computational resources
Origin from utility services (Electricity)
Development of Computer
Data Processing
Cloud Computing
Grid Computing
Cluster Computing
Parallel Computing
25
Grid vs. Cloud
26
Grid
Cloud
Underlying concept
Utility Computing
Utility Computing
Main benefit
Solve computationally
complex problems
Provide a scalable
standard environment for
network-centric
application development,
testing and deployment
Resource distribution /
allocation
Negotiate and manage
resource sharing;
schedulers
Simple user <-> provider
model; pay-per-use
Domains
Multiple domains
Single domain
Character / history
Non-commercial, publicly Commercial
funded
Focus
Application Oriented
Absraction
Non-virtualisation of Host Virtualisation of Host
Service Oriented
Handy Tools We Use over
Evolutional Periods In History
Is it safe to play with your computer
when you are naked and vulnerable ?
27
Basic Concept of an
Internet Cloud
Paid Services
User
Software
Hardware
Storage
Submit
Requests
Internet
Cloud
Service
28
Network
Virtualized Datacenter is The Computer :
A Cost-Effective Computing Paradigm
• Cloud Computing
– Buy & Own
• Hardware, System
Software, Applications
often to meet peak
needs.
– Install, Configure, Test,
Verify, Evaluate
– Manage
– ..
– Finally, use it
– $$$$$....$(High Cost)
29
• Subscribe
• Use
Pay as you Go
Every 18 months?
• Classical Computing
Saving about 80-95 %
of the total cost
• $ - pay for what you use,
based on QoS
Cost Comparison
Cloud vs Traditional IT:
estimated by IBM 2009
Traditional
Current IT Expenses
100%
Cloud
Computing
Software &
Other
Expenses
Operation &
Maintenance
Deploy (One-time)
Depreciati
on
Sw & other
Exp (- 20%)
Labour Cost
( - 80.7%)
Depreciation
( - 91.6%)
30
Annual
OpEx
(21%)
Web 2.0, Clouds, and Internet of Things
HPC: High-Performance Computing, HTC: High-Throughput Computing,
P2P: Peer to Peer, MPP: Massively Parallel Processors
31
Convergence of Technologies
for Cloud Computing
Hardware
Hardware
Virtualization
Multi-core chips
Distributed
Computing
Utility &
Grid
Computing
Cloud
Computing
Autonomic Computing
Datacenter automation
Systems
Management
32
SOA
Web 2.0
Web Services
Mashups
Internet
Technology
Clouds: relation with other paradigms
33
Recent Advances in Virtualisation
vMotion & Storage vMotion
1 Multiplexing of VMs
3 Provision (Resume) of VMs
2 Suspension (Storage) of VMs
35
4 Live Migration of VMs
Global Server Usages and
Breakdown of Datacenter Cost
Datacenter Cost
($Billion)
Total Number of Servers
(Million)
Electricity and Cooling Cost
300
50
Server Management and Maintenance Cost
Server Equipment Cost
250
40
Total Number of Servers
200
30
150
20
100
10
50
96
97
98
99
00
01
02
03
36
04
05
06
07
08
09 10
Modular Datacenters
in Chilled Truck Containers
37
Interconnection of Modular Datacenters
38
Public, Private and Hybrid Clouds
39
Public vs. Private Cloud
Cloud Choices
Public Cloud
On-demand resources, scalability
Private Cloud
Hybrid Cloud
Public + Private cloud
Shared environment
Exclusive environment
Limited on-demand capabilities
On-Premise Private Cloud
Externally Hosted Private Cloud
Requires Initial Capital Investment
Exclusive, but hosted by a third party
Cloud setup within Org’s data center
Limited on-demand scaling
Control on security and audit
Expensive than public cloud
Based on basic virtualization
Cheaper than on-premise private cloud
Limited on-demand scaling
Possibility of co-location
41
42
The Three aaS’s in Cloud
IT Cloud Services
Cloud
Applications
(Apps-as-a-service)
App Dev/Test
Cloud
(Application)
App Deploy
Platforms
(Platform-as-a-Service)
Cloud
Infrastructure
(Infrastructure-as-a-Service)
43
44
Cloud Service Layers
Service
Providers
Service Users
Cloud End-User Services
(SaaS)
Cloud Providers
Cloud Platform Services (PaaS)
Cloud Infrastructure Services (IaaS)
Physical
Infrastructure
45
46
Cloud Providers – A Birds Eye View
Infrastructure
as a Service
Platform
as a Service
Software
as a Service
Cloud Computing as A Service
[9]
48
Inside a Cloud
Software as a Service
(SaaS)
Corporate Email
CRM, ERP, HR
Business Processes
The Cloud Platform
Platform as a
Service (PaaS)
Java Runtime
Web 2.0 Runtime
LAMP / WAMP
Software Platform
Infrastructure as a
Service (IaaS)
Virtual Servers
Virtual Storage
Virtualized CPUs and Storage
Virtual Network
Physical Servers
Physical Servers across the Globe
Inside a Cloud
The ‘Nuts and Bolts’ of a Public Cloud
Registration, Authentication
and Authorization
Replicates
Application on
demand
The face of the
Cloud
Facilitates
Pay-per-use
Statistics,
Deployment,
Start/Stop
Enforces
Security
Cloud
Applications
The Cloud Platform
Self Service Portal
Metering, Billing
and Rating System
Identity
Management
Dynamic Provisioning
Engine
Monitoring and
Management
Security Subsystem
Virtualized Runtime Environment (Infrastructure & Platform)
Network of Physical Servers controlled by the Cloud Operating System
The heart of the
“Cloud”
Amazon EC2 – A Detailed Insight
EC2 – Elastic Compute Cloud
S3 – Simple Storage Service
Create a virtual server instance
File System Storage of Arbitrary Data
Concept of AMI – Amazon Machine Image
Each file can be 5 GB
Choose your operating system and/or s/w
Secure storage with ACLs
SSH and SFTP to your virtual server
Used by SmugMug Photo Service
Web Service interface for admin tasks
SQS – Simple Queue Service
Elastic Map Reduce
Message Queue Infrastructure
Infrastructure for data-intensive tasks
Reliable delivery`
Web indexing, data mining, log file analysis
Simple DB
Elastic Cloud Front
Core Database Functions
Infrastructure for content delivery
Fast Indexing, Querying and retrieval
Based on closest geographical location
52
From On-Premise to Cloud Platforms
Application runs
on-premises
Buy my own
hardware, and
manage my own
data center
Application runs
at a hoster
Co-location
or
Managed
servers
Application
runs using
cloud services
“cloud fabric”
(elastic,
infini-scale)
53
Buy
Build vs. Buy
Build
“Packaged”
Application
Hosted
“Packaged”
“Software as a
Service”
An application that I buy
“off the shelf” and run
myself
An application that I buy
“off the shelf” and then
run at a hoster
A hosted application
that I buy from a
vendor
Self Hosted
“Home Built”
Hosted
“Home Built”
An application that I
develop and run myself
An application that I
develop myself, but run
at a hoster
On premises
On premises vs. Cloud
54
Cloud Platform
An application that I
develop myself, but
run in the cloud
Cloud
Build
Build vs. Buy
Buy
All acceptable options (trade off)
“Packaged”
Application
Hosted
“Packaged”
An application that I buy
“off the shelf” and run
myself
An application that I buy
“off the shelf” and then
run at a hoster
“Software as a Service”
A hosted application that
I buy from a vendor
Maximum Control
Self Hosted
“Home Built”
An application that I
develop and run myself
On premises
Hosted
“Home Built”
Cloud Platform
An application that I
develop myself, but
Maximumrun in the cloud
An application that I
develop myself, but run
at a hoster
Economy
On premises vs. Cloud
55
of Scale
Cloud
Buy
“Packaged”
ERP
Application
Build
Build vs. Buy
Issue Tracking
An application that I buy
“off the shelf” and run
myself
Self Hosted
HR System
“Home
Built”
Molecule Research
An application that I
develop and run myself
Clinical Trial
On premises
Hosted
“Packaged”
“Software as a
Service”
“Too costly to run this myself,A hosted application
An application that I buy
but I’ve
too
“off themade
shelf” and
thenmany
that I buy from a
run at a hoster
vendor
customizations”
Hosted
“Home Built”
An application that I
develop myself, but run
at a hoster
On premises vs. Cloud
56
Cloud Platform
An application that I
develop myself, but
run in the cloud
Cloud
Buy
“Packaged”
Application
Build
Build vs. Buy
Issue Tracking
An application that I buy
“off the shelf” and run
myself
Self Hosted
HR System
“Home
Built”
Molecule Research
An application that I
develop and run myself
Clinical Trial
On premises
Hosted
ERP
“Packaged”
“Software as a Service”
An application that I buy
“off the shelf” and then
run at a hoster
A hosted application that
I buy from a vendor
“CRM and Email are commodity
services – They have no
customizations, and it’s cheaper for
someone else to run these”
Cloud Platform
Hosted
“Home Built”
An application that I
develop myself, but run
at a hoster
On premises vs. Cloud
57
An application that I
develop myself, but
run in the cloud
Cloud
Buy
Build vs. Buy
Build
“Packaged”
Application
Hosted
ERP
“Packaged”
“Software as a
Service”
An application that I buy
“off the shelf” and run
myself
An application that I buy
“off the shelf” and then
run at a hoster
Issue Tracking
A hosted
pplication
that I buy from a
vendor
Self Hosted
HR System
“Home
Built”
Molecule Research
An application that I
develop and run myself
Clinical Trial
On premises
“I can’t afford to maintain
this old HR application
writtenHosted
in VB – it’s driving
me “Home
mad!” Built”
An application that I
develop myself, but run
at a hoster
Cloud Platform
An application that I
develop myself, but
run in the cloud
“…but due to privacy issues, I
prefer keeping my HR data
On premises vs. Cloud
on-premises”
58
Cloud
Buy
Build vs. Buy
Build
“Packaged”
Application
Hosted
ERP
“Packaged”
“Software as a
Service”
An application that I buy
“off the shelf” and run
HRmyself
System
An application that I buy
“off the shelf” and then
run at a hoster
Issue Tracking
A hosted
pplication
that I buy from a
vendor
Self Hosted
“Home Built”
Hosted
“Home Built”
Molecule Research
An application that I
develop and run myself
Clinical Trial
On premises
“I wish I had access to
An application that I
cheaper
compute
develop myself,
but run and
a hoster
storageatwhen
I need it”
On premises vs. Cloud
59
Cloud Platform
An application that I
develop myself, but
run in the cloud
Cloud
Buy
Build vs. Buy
Build
“Packaged”
Application
Hosted
ERP
“Packaged”
“Software as a
Service”
An application that I buy
“off the shelf” and run
HRmyself
System
An application that I buy
“off the shelf” and then
run at a hoster
Issue Tracking
A hosted
pplication
that I buy from a
vendor
Self Hosted
“Home Built”
Hosted
“Home Built”
An application that I
develop and run myself
An application that I
develop myself, but run
at a hoster
Clinical Trial
On premises
On premises vs. Cloud
60
Cloud Platform
An application that I
Molecule Research
develop myself, but
run in the cloud
Cloud
Buy
Build vs. Buy
Build
“Packaged”
Application
Hosted
ERP
“Packaged”
“Software as a
Service”
An application that I buy
“off the shelf” and run
HRmyself
System
An application that I buy
“off the shelf” and then
run at a hoster
Issue Tracking
A hosted
pplication
that I buy from a
vendor
Self Hosted
“Home Built”
Hosted
“Home Built”
An application that I
develop and run myself
Clinical Trial
On premises
Cloud Platform
An application that I
“THIS is where I want to
Molecule Research
develop
myself, but
An
application
that
I
spend my IT resources – I’m
develop myself, but run
run in the cloud
going to double
at a hoster down on this
application!”
On premises vs. Cloud
61
Cloud
Buy
Bild vs. Buy
Build
“Packaged”
Application
Hosted
ERP
“Packaged”
“Software as a
Service”
An application that I buy
“off the shelf” and run
HRmyself
System
An application that I buy
“off the shelf” and then
run at a hoster
Issue Tracking
A hosted
pplication
that I buy from a
vendor
Self Hosted
“Home Built”
Hosted
“Home Built”
An application that I
develop and run myself
An application that I
develop myself, but run
at a hoster
Clinical Trial
On premises
On premises vs. Cloud
62
Cloud Platform
An application that I
Molecule Research
develop myself, but
run in the cloud
Cloud
SOA (Service Oriented Architecture)
implemented through Web Service
63
64
Cloud
Provider #1
Cloud Computing: Models
Printing
Service
Office
Apps
User
On Demand
CPUs
CRM
Service
Data
Storage
Service
…
Cloud
Provider #2
Enterprise
Backup
Service
ILM
Service
Service
Employee
Service
Service 3
Service
Business
Apps/Service
…
…
Internal Cloud
…
65
The
Internet
Cloud Resource Management Systems
VMWare
Nimbus
OpenNebula
Eucalyptus
66
Demand-Driven Resource Provisioning
• Utilized a lot in Grid Computing
• When a resource has surpassed a threshold for a
certain amount of time, increase that resource
• When a resource is below a threshold for a certain
amount of time, decrease that resource
• Amazon implements such an “AutoScale” feature
Picture courtesy of Intel Corp.
67
Amazon Virtual Private Cloud VPC
(http://aws.amazon.com/vpc/ )
68
vSphere 5.1 : An OS for Cloud Platform
69
Cloud Services Stack
Application
Cloud Services
Platform
Cloud Services
Compute & Storage
Cloud Services
Co-Location
Cloud Services
Network
Cloud Services
70
71
Service-Oriented Architecture (SoA)
Data
S
S
S
S
fs
fs
Filter
Service
S
S
S
S
fs
S
S
Compute
Cloud
Database
fs
fs
fs
S
S
S
S
fs
Filter
Service
fs
fs
Filter
Service
fs
SS
SS
Filter
Cloud
fs
fs
Filter
Cloud
Another
Grid
fs
Filter
Cloud
fs
SS
Discovery
Cloud
fs
fs
fs
SS
fs
fs
SS
fs
fs
Filter
Service
fs
Filter
Cloud
SS
Wisdom Decisions
Another
Grid
SS
Another
Service
Knowledge
S
S
Another
Grid
Information
S
S
Raw Data
S
S
fs
Filter
Cloud
S
S
Discovery
Cloud
fs
Traditional Grid
with exposed
services
Filter
Cloud
S
S
S
S
Storage
Cloud
S
S
Sensor or Data
Interchange
Service
Geoffrey Fox: Grid of various clouds -- from Raw Data to Wisdom.
SS = Sensor service, fs = filter services
72
Data Security and Copyright Protection
Demands in A Trusted Cloud Platform
73
Trusted Zones for VM Insulation
Identity
federation
Virtual
network
security
Insulate
infrastructure from
Malware, Trojans
and cybercriminals
Federate
identities with
public clouds
Control and
isolate VM in
the virtual
infrastructure
APP
APP
OS
OS
APP
OS
OS
Tenant
#1
Virtual Infrastructure
Access
Mgmt
Segregate and
control user
access
Cloud Provider
Insulate
information
from other
tenants
Insulate
information
from cloud
providers’
employees
PhysicalPhysical
Infrastructure
Infrastructure
Security Info. &
Event Mgmt
Cybercrime
intelligence
Strong
authentication
Tenant
#2
Virtual Infrastructure
APP
Anti-malware
Enable end to end view of security events and
compliance across 74
infrastructures
GRC
Data loss
prevention
Encryption &
key mgmt
Tokenization
Cloud Service Models and Their Security Demands
Cloud computing will not be accepted by common users unless
the trust and dependability issues are resolved satisfactorily
75
The Internet of Things
Smart
Earth
Internet of
Things (IOT)
Smart Earth
76
Architecture of The Internet of Things
Application
Layer
Merchandise
Tracking
Environment
Protection
Intelligent
Search
Telemedicine
Intelligent
Traffic
Cloud Computing
Platform
Network
Layer
Mobile
Telecom
Network
The
Internet
Information
Network
RFID
Sensor Network
GPS
RFID Label
Sensor Nodes
Road Mapper
Sensing
Layer
77
Smart
Home
Supply Chain Management
supported by the Internet of Things.
( http://www.igd.com)
78
Smart Power Grid
79
Opportunities of IOT in 3 Dimensions
80
Conclusions of Quick Overview
Virtualised clouds are changing the whole IT and service industry,
simply trying to make computing a pay-as-you-go public utility
service like water, gas, and electricity.
Cloud computing will become a common practice in business,
government, education, and entertainment leveraging millions
of servers globally installed at thousands of datacenters today.
Virtualisation support is needed in developing business clouds as
heavily pursued by IBM, Google, Microsoft, Yahoo, Amazon, SGI,
AT&T, HP, VMWare, Saleforce.com, etc.
Private clouds will become widespread in addition to using a few
public clouds, that are under heavy competition among Google, MS,
Amazon, Intel, EMC, IBM, SGI, VMWare, Saleforce.com, etc.
Effective trust management, guaranteed security, protection of
user privacy, data integrity, mobility support and copyright
protection are crucial to the universal acceptance of the cloud as a
81
dependable ubiquitous service
九霄云外
According to the terminology used by the
U.S. Weather Bureau, clouds are divided into
classes and each class is divided into nine
types. 'Cloud nine' is the cumulonimbus
cloud that you often see building up in the
sky in a hot summer afternoon. It may reach
30,000 to 40,000 feet
82
83
84
