00 00 AWS - Fundamentals Instructor Guide
00 00 AWS - Fundamentals Instructor Guide
00 00 AWS - Fundamentals Instructor Guide
of Cloud Computing
Key Takeaways
• Fundamental understanding of what Cloud Computing is
• Understanding of the key advantages of Cloud
• Understanding of Cloud Segments
• Understanding of Cloud Deployment Models
• Knowledge of some key Cloud companies
• Knowledge of some Cloud services
• Cloud Security
• Cloud use cases
www.cloudthat.in
Roadmap
• What is Cloud Computing, why it matters
• Traditional IT Infrastructure
• Cloud Infrastructure and Cloud Advantage
• Examples of Cloud Advantage
• Cloud Companies
• Examples of Cloud Services
• Use Cases
• Cloud Segments: IaaS, PaaS, SaaS
• Cloud Deployment Models
• Cloud Security
www.cloudthat.in
Growth Predictions
• Gartner: Worldwide Public Cloud Revenue to Grow 21.4 Percent in 2018
• Gartner: Infrastructure as a Service (IaaS) forecast to grow 35.9 percent
in 2018 to reach $40.8 billion
• IDC: By 2020, public cloud services spending is expected to reach more
than $162 billion
• IDC: By 2018 Cloud-based spending to be 60% of all IT infrastructure,
and 60–70% of all Software
• Wikibon: Enterprise cloud spending is growing at a 16% (CAGR)
between 2016 and 2026
• BDO Survey: 74% of Tech CFOs say cloud computing will have the most
measurable impact on their business
www.cloudthat.in
Job Predictions
• Forbes: Cloud Computing to create 18 million Jobs
• US Market - Amazon, EMC and VMWare aggressive hirers on cloud
computing jobs in the last 12 months
• Certifications in cloud computing pay an average salary of $112,955 per
year
• Global Market - The global public cloud market is expected to grow at a
CAGR of 22 %, its size expected to be 178 billion in 2018
• More than 3,800 cloud-related jobs are listed on a daily basis
www.cloudthat.in
What is Cloud Computing
www.cloudthat.in
1975 312 T Model
495 bhp
Red Bull RB9
750 bhp
In 40 years we improved roughly 50% in Horse Power
Altari 8800, the first commercially available computer launched in 1975. 2
MHz CPU, 256 bytes memory, blinkenlights & toggle switches for input-
output
iPhone X
Quad-core 2.39 GHz CPU, 256 GB of storage. That’s 140,000% faster and over 2
billion times more storage. Consumes a fraction of the electricity.
Evolution of Software
Mainframe PC Post-PC
Networking
Datacenter Machines
Equipment
www.cloudthat.in
IT Infrastructure - Issues
Tightly coupled to
geographic
location
Application Layer
Upfront licensing
Needs good Low Level Software
software
cost
maintenance team Resources
Very hard to
estimate need in
Becomes cheaper
every month
Low Level Hardware
advance
Resources
www.cloudthat.in
IT Infrastructure - Issues
Application Layer
www.cloudthat.in
IT Infrastructure – Pyramid of Effort
Application Layer
www.cloudthat.in
Use Case Study
• Microsoft Office to Office 365
www.cloudthat.in
Hardware Requirement
• Infrastructure
– Application and storage on Company Data Centers
– Thousands of machines required
– Huge upfront costs for this infrastructure
– Huge operations/deployment team
– Huge hardware installation and maintenance team
– Lot of Network engineers
– Network Operations Center (NOC): 24/7 monitoring of the service
www.cloudthat.in
Software Development
www.cloudthat.in
Software Testing
www.cloudthat.in
Marketing/Business Model
www.cloudthat.in
Project Management
www.cloudthat.in
• Many other things change…
• Overall its not easy to develop and maintain hosted
applications
www.cloudthat.in
Roadmap
• What is Cloud Computing, why it matters
• Traditional IT Infrastructure
• Cloud Infrastructure and Cloud Advantage
• Examples of Cloud Advantage
• Cloud Companies
• Examples of Cloud Services
• Use Cases
• Cloud Segments: IaaS, PaaS, SaaS
• Cloud Deployment Models
• Cloud Security
www.cloudthat.in
Cloud Infrastructure
Amazon Elastic
Google
Azure VM Compute Cloud Networking
Datacenter Machines Compute Engine
(EC2) Equipment
www.cloudthat.in
Cloud Infrastructure
Amazon Simple
Azure Blob
Amazon Elastic Low Level Hardware
Storage Service Load Balancer
(S3)
Storage
(ELB) Resources
Amazon Elastic
Google
Azure VM Compute Cloud
Compute Engine
(EC2)
www.cloudthat.in
Cloud Infrastructure
Needs good
Upfront
software
licensing maintenance
cost team
Amazon
Azure SQL
Relational Google App Low Level Software
Database Engine
Service Resources
Amazon Simple
Azure Blob
Amazon Elastic Low Level Hardware
Storage Service Load Balancer
(S3)
Storage
(ELB) Resources
Amazon Elastic
Google
Azure VM Compute Cloud
Compute Engine
(EC2)
www.cloudthat.in
Cloud Infrastructure
Tightly
coupled to
geographic
location
Google Apps
Microsoft Million other
(Mail, Calender,
Exchange Online apps Application Layer
etc.)
Amazon
Azure SQL
Relational Google App Low Level Software
Database Engine
Service Resources
www.cloudthat.in
IT Infrastructure – Cloud Advantage
Application Layer
www.cloudthat.in
Key Attributes of Cloud Computing
• Self-service
• Pay-per-use/Utility model
• Elasticity
• High Scalability
• Fully virtualized/automated
• Uses Internet Protocols and Technologies (HTTP,
REST, SOAP, etc.)
www.cloudthat.in
Roadmap
• What is Cloud Computing, why it matters
• Traditional IT Infrastructure
• Cloud Infrastructure and Cloud Advantage
• Examples of Cloud Advantage
• Cloud Companies
• Examples of Cloud Services
• Use Cases
• Cloud Segments: IaaS, PaaS, SaaS
• Cloud Deployment Models
• Cloud Security
www.cloudthat.in
Examples of Cloud Advantage
• RedBus.in • Zynga.com
– Started in 2006 – Started in 2007 now a $6.6 billion
– Today has 1.2 million page company
views every day. – Zynga has > 250m monthly active
– Now uses Cloud to scale. users globally
– Owns 7 of top 10 games on
Facebook.com
www.cloudthat.in
Zynga Story
www.cloudthat.in
Failed to Scale
• Friendster:
– Had three million users within the first few months
– “We didn’t solve the first basic problem: our site didn’t work”, Kent
Lindstrom, Ex-CEO, Friendster
– “All they had to do was keep the damned servers up and running,” Matt
Cohler, Ex-Facebook executive
Soundtrack
Video
www.cloudthat.in
Adapted to Scale: Animoto
CPU
Good
bandwidth
www.cloudthat.in
Adapted to Scale: Animoto
CPU
Good
bandwidth
www.cloudthat.in
40
Cloud Advantage: Redundancy (AWS Regions)
EU
US-
West-
1
US-
Japan
US- East-1
West- China
2
Singapor
e
SA
Australi
a
www.cloudthat.in
AWS Data Centers
A B
A B C
C
A B
A B
A B
C A B
C
C
C
A B
A B
C A B
www.cloudthat.in
Revisit: Hosting Applications using Cloud
www.cloudthat.in
Things to Watch Out For
Microsoft
Million other apps
Exchange Online
Google App
Amazon Elastic
Platform as a Service (PaaS) Engine
Beanstalk
www.cloudthat.in
IaaS
Data Center
Load Balancer
Execution Machines
Machine 1 Machine 2
Webserver Webserver
Backend Backend
Database
www.cloudthat.in
PaaS
Load Balancer
Execution Machines
www.cloudthat.in
Key Benefits - IaaS
www.cloudthat.in
Cloud Deployment Models
• Public
• Private
• Community
• Hybrid
www.cloudthat.in
Cloud Deployment -
Public Internet
Organization 2 Organization 1
Cloud Deployment -
Private
Organizational
Boundary
• Private cloud -- The cloud
infrastructure is operated
solely for an organization.
It may be managed by
the organization or a Private Cloud
third party and may exist
on premise or off
premise.
Cloud Deployment -
Private
Organizational Boundary
Private Cloud Layer
Organization - 1
Boundary
• Community cloud -- The
cloud infrastructure is
shared by several
organizations and
Community
supports a specific Cloud
community that has
shared goals
Organization-2
Boundary
Cloud Deployment -
Organizational
Hybrid
Boundary
Private
Cloud
IBM SmartCloud
Provides Hardware
HP Cloud EMC
and Software
www.cloudthat.in
IaaS Gartner Magic Quadrant - 2017
www.cloudthat.in
Roadmap
• What is Cloud Computing, why it matters
• Traditional IT Infrastructure
• Cloud Infrastructure and Cloud Advantage
• Examples of Cloud Advantage
• Cloud Companies
• Examples of Cloud Services
• Use Cases
• Cloud Segments: IaaS, PaaS, SaaS
• Cloud Deployment Models
• Cloud Security
www.cloudthat.in
Cloud Storage Services
Data Center 2
Mypic.jpg
Report.doc
Data Center 1
Store Mypic.jpg
Mypic.jpg
Store Report.doc
Report.doc
My App List
Data Center 3
Mypic.jpg
Get Mypic.jpg
List Report.doc
Result
……….
Delete Mypic.jpg
……….
www.cloudthat.in
AWS S3: Availability and Durability
www.cloudthat.in
Cloud Compute Services
Give me 10 machines
My App
I only need 5 machines
Done
www.cloudthat.in
AWS Elastic Cloud Compute Features
www.cloudthat.in
Microsoft SQL Azure
• Extends SQL Server capabilities to the cloud
• Provision in minutes
• Self-managing, automatic failover
• High Availability
• Auto Scaling; service scales as your data grows
• Pay as you go
• Easy replication across geographic locations
• Geographic redundancy
• Spend time on your database design; Not on physical
implementation
www.cloudthat.in
Azure SQL
www.cloudthat.in
Google Application Engine (GAE)
www.cloudthat.in
Roadmap
• What is Cloud Computing, why it matters
• Traditional IT Infrastructure
• Cloud Infrastructure and Cloud Advantage
• Examples of Cloud Advantage
• Cloud Companies
• Examples of Cloud Services
• Use Cases
• Cloud Segments: IaaS, PaaS, SaaS
• Cloud Deployment Models
• Cloud Security
www.cloudthat.in
Use Case: My Exchange is Down Again
• Solution: Move to Google Apps or Microsoft Exchange
Online
• Reduced deployment and maintenance cost
• Simplified high availability and disaster recovery (99.99%
availability, auto backup and recovery)
• Greater mobility and flexible access
• Mailbox duplicated in multiple datacenters – No need for
backups
• Unlimited mailbox size (or 25 GB) and archiving
• Auto spam and virus protection
• Cons: Migration of existing user accounts requires some
cloud knowledge
www.cloudthat.in
Price Comparison
• Microsoft
• In-house Google Apps Exchange
Online
Exchange
Server One • Rs 2500 per
Time/Per 3 Years • Rs 3000
Month Aggregate user per year per user
Two Servers 150,000 150,000 • 100 users = per year
Backup Device 10,000 10,000 Rs 7,50,000 • 100 uses =
Good 16 Rs
Bandwidth 5,000 1,80,000 14 9,00,000
Power 2,000 72,000 12
IT person 20,000 7,20,000 10
UPS 20,000 20,000 8
6
100 users
license 4
2,00,000 2,00,000
2
Total 13,52,000 0
Inhouse Google Apps Microsoft
Exchange Server Exchange Online
www.cloudthat.in
Cloud Migration
www.cloudthat.in
Cloud Migration
Includes:
• Financial Assessment (TCO/ROI
Analysis)
• How much will it cost to run?
• Security and Compliance
Assessment
• Technical Assessment
– Choosing the right
candidate
– Migrating Licensed
products
– Identifying tools you can
reuse
– Functional/Architectural
assessment
www.cloudthat.in
Cloud Migration
Includes:
• Get your feet wet with Amazon
Web Services
– Learning AWS
– Build reference architecture
– Be aware of the security
features
• Build a Prototype/Pilot
– Build support in your
organization
– Validate the technology
– Test legacy software in the
cloud
– Perform benchmarks
www.cloudthat.in
Cloud Migration
Includes:
• Learning about different
database storage options
available today
• Uploading/Moving your data in
Batches
• Analyzing your
database/datasets
• Build necessary tools and scripts
to migrate data
• Security of your data
(Encryption)
www.cloudthat.in
Cloud Migration
Includes:
• Decide a strategy
(Forklift/Hybrid)
• Automate your processes
by creating AMIs
• Build “cloud-aware” layers
of code for tightly coupled
apps
www.cloudthat.in
Cloud Migration
Includes:
• Leveraging other AWS
services
• Implementing “Elasticity”
• Automating in-cloud
software development and
deployment lifecycle
• Increasing high availability
by leveraging multiple
Availability Zones
• Hardening Security
www.cloudthat.in
Cloud Migration
Includes:
• Understanding your usage patterns
and managing cloud resources more
effectively
• Optimizing to increase Performance,
improve efficiency and save further
costs
• Advanced Monitoring and telemetry
• Ensuring enhanced security
• Refactoring applications as
necessary
• Leverage AWS Best Practices
www.cloudthat.in
Roadmap
• What is Cloud Computing, why it matters
• Traditional IT Infrastructure
• Cloud Infrastructure and Cloud Advantage
• Examples of Cloud Advantage
• Cloud Companies
• Examples of Cloud Services
• Use Cases
• Cloud Segments: IaaS, PaaS, SaaS
• Cloud Deployment Models
• Cloud Security
www.cloudthat.in
Deployment Models
• Hybrid
• Inter Geographic
• Intra Geographic
www.cloudthat.in
Roadmap
• What is Cloud Computing, why it matters
• Traditional IT Infrastructure
• Cloud Infrastructure and Cloud Advantage
• Examples of Cloud Advantage
• Cloud Companies
• Examples of Cloud Services
• Use Cases
• Cloud Segments: IaaS, PaaS, SaaS
• Cloud Deployment Models
• Cloud Security
www.cloudthat.in
Cloud Security
www.cloudthat.in
Questions?
www.cloudthat.in
AWS Certification Track
SysOps
Solutions Architect Developer
Administrator
www.cloudthat.in
Azure Certification Track
www.cloudthat.in
Amazon S3
Amazon Simple Storage Service
www.cloudthat.in
Amazon S3 Basic Operations
Data Center 2
Mypic.jpg
Report.doc
Store Mypic.jpg
Data Center 1
Report.doc
My App List
Data Center 3
Mypic.jpg
List
Get Mypic.jpg Report.doc
Mypic.jpg
Report.doc
Delete Mypic.jpg
www.cloudthat.in
Consistency Model for Distributed Storage
Eventual Consistency
Data Center 2
Mypic.jpg
Store Mypic.jpg
Data Center 1
Mypic.jpg
Response (OK)
My App
Data Center 3
Get Mypic.jpg
Eventual Consistency
Data Center 2
Mypic.jpg
Delete Mypic.jpg
Data Center 1
Mypic.jpg
Response (OK)
My App
Data Center 3
www.cloudthat.in
Amazon S3: Namespace
cloudthat.in/courses/level-1
Global part Custom Part
bucketname.s3.amazonaws.com/objectName
Global Part Custom Part
OR
s3-ap-southeast-1.amazonaws.com/bucketname/objectName
www.cloudthat.in
S3 Keys and Objects
www.cloudthat.in
Object ACL
• Read Object
Object ACL
• Write Object
• Read Object Permissions
• Edit Object Permissions
www.cloudthat.in
ACL: GRANTS
• Owner
• Everyone (Public)
• Other AWS account/email ID
www.cloudthat.in
ACL Pros and Cons
Pros Cons
• Easy to implement • Very limiting in scope
• Secure by default • Not-hierarchical
• Mistakes take changing
ACL to all objects
www.cloudthat.in
Bucket Policies
www.cloudthat.in
Bucket Policy
{ Allows full access to
"Version": "2008-10-17",
"Id": "S3PolicyId1",
"Statement": [ • Two given users ONLY
{
"Sid": "IPAllow", when
"Effect": "Allow",
"Principal": {
"AWS":[”8975-2909", ”2091-0929"] • IP-addresses in the given
},
"Action": "s3:*", range
"Resource": "arn:aws:s3:::bucket/*",
"Condition" : {
"IpAddress" : { • CIDR notation for ip-
}
"aws:SourceIp": “50.50.50.0/24"
address range described
}
}
] in RFC 2632
www.cloudthat.in
Pre Signed URLs
www.cloudthat.in
Reduced Redundancy Storage
www.cloudthat.in
Infrequent Access Storage Option
www.cloudthat.in
S3 Multipart upload
www.cloudthat.in
S3 Data Encryption
• Uses AES-256
• PUT an object and
request encryption (in an
HTTP header)
• GET remains the same.
Response contains extra
header
• Bucket policies to allow,
mandate, or forbid
Source: http://aws.typepad.com/aws/2011/10/new-amazon-s3-server-side-encryption.html
encryption at the bucket www.cloudthat.in
S3 Versioning
www.cloudthat.in
Object Lifecycle Management
• Actions include:
• Transition actions – transition to another storage
(Infrequent access storage or Glacier)
• Expiration actions – expiration of objects
www.cloudthat.in
Static Website Hosting
www.cloudthat.in
S3 Pricing
Asia Pacific (Singapore)
• Pay for storage in • $0.025 Per GB
GB/month
• $0.120 per GB (first GB free)
• Pay for bandwidth out
of AWS in GB • PUT, COPY, POST, or LIST
Requests $0.01 per 1000 requests
• GET and all other Requests -
• Pay for requests $0.01 per 10,000 requests
aws.amazon.com/pricing/s3/
www.cloudthat.in
Requester Pays Buckets
www.cloudthat.in
Cross-Region Replication
www.cloudthat.in
Transfer Acceleration
www.cloudthat.in
Questions?
www.cloudthat.in
Amazon EC2
EC2 Overview
Give me 10 machines
Done
www.cloudthat.in
Questions?
www.cloudthat.in
Virtual Servers
Physical Server
www.cloudthat.in
Instance Types
www.cloudthat.in
EC2 Instance Types
Family Description
Standard General purpose CPU – Memory.
Micro Very low CPU, allows small bursts. Only good for websites and
applications that doesn’t need sizeable amount of CPU/memory.
High-CPU Higher CPU than RAM.
High- Higher Memory than CPU.
Memory
Cluster Very large amount of CPU coupled with increased networking
Compute performance. Ideal for High Performance Compute (HPC)
applications and other demanding network-bound applications.
Cluster GPU Graphics processing units (GPUs), with high CPU and increased
network performance. Ideal for applications that needs high
rendering power as well as HPC applications
www.cloudthat.in
EC2 Instance Types
Linux Windows
Name Memory Compute Units Storage Platform I/O Perf API Name
cost cost
Standard Small 1.7 GB 1 (1 core x 1 unit) 160 GB 32/64- Moderate m1.small $0.08 $0.115
bit per hour per hour
Standard 3.75 GB 2 (1 core x 2 410 GB 32/64- Moderate m1.medium $0.16 $0.23 per
Medium units) bit per hour hour
Standard Large 7.5 GB 4 (2 cores x 2 850 GB 64-bit High m1.large $0.32 $0.46
units) per hour per hour
Standard Extra 15 GB 8 (4 cores x 2 1690 64-bit High m1.xlarge $0.64 $0.92 per
Large units) GB per hour hour
Micro 0.6 GB 2 (only for short EBS 32/64- Low t1.micro $0.02 $0.03
bursts) only bit per hour per hour
High-Memory 17.1 GB 6.5 (2 cores x 420 GB 64-bit Moderate m2.xlarge $0.45 $0.57 per
Extra Large 3.25 units) per hour hour
High-Memory 34.2 GB 13 (4 cores x 3.25 850 GB 64-bit High m2.2xlarge $0.90 $1.14 per
Double Extra units) per hour hour
Large
http://www.ec2instances.info/
www.cloudthat.in
EC2: Where is my DATA?
Machine
Failure
My
EC2
EC2 EC2 EC2 EC2 My
EC2
EC2 EC2
Instance Instance Instance Instance Instance Instance
www.cloudthat.in
EC2: Where is my DATA?
EBS EBS
Machine
Failure
My
EC2
EC2 EC2 EC2 EC2 EC2 EC2
Instance Instance Instance Instance Instance Instance
www.cloudthat.in
Customer A
EBS Architecture
Single Availability Zone
EC2 Instance
EBS Storage EBS Storage
Volume A1 Machine n1 Machine m1
Customer B
EC2 Instance
Volume B3
Volume A3 VolumeA 3
www.cloudthat.in
Provisioned IOPS
www.cloudthat.in
Persistence of Data
10x durability of a single hard drive
No durability of
local drive
EBSEBS
EBS
Snapsho
Snapsho
Snapshot
t t
S3-like storage
EBS Amazon S3
Paradigm Simulates File Object Store
System
Durability 10x hard-disk 99.999999999%
Access ONLY from EC2 Web-based access
Consistency Similar to hard-disk Eventually
consistency
Availability/Redunda Replicated inside a Replicated across
ncy data-center data-centers
Pricing Per Allocated Size of Per stored GB
Volume Bandwidth
IO operations Access operations
www.cloudthat.in
EBS Pricing
• Snapshots
– $0.05 per GB-month of data stored
www.cloudthat.in
Amazon Machine Image (AMI)
Suse Amazon RedHat Windows
Linux Linux Linux Server
Custom
Custom
AMI
AMI
Root Drive Root Drive
Apache MySQL Apache MySQL
PHP PHP
Custom Custom
Application Application
www.cloudthat.in
Local drive Instance Store AMI (legacy style)
EC2 Instance
Instance Store
Amazon
Local Drive Linux AMI
Apache MySQL
PHP
Custom
Application 2) Image stored in Instance Store
loaded
3) Install custom software
5) On machine failure, all stored data is lost
www.cloudthat.in
EBS Backed AMI (newer style)
EC2 Instance
EBS Drive
Root Drive Failure Behavior Data NOT persisted Data persists failures
www.cloudthat.in
EC2 States
Launch
Pending
Reboot
Running
Stop Terminate
Stopped Terminated
Start
www.cloudthat.in
Security Groups
Internet
Security Group
www.cloudthat.in
Security Groups
Internet
Web Web
Server Server
Port 80
Web
Server
www.cloudthat.in
Security Groups
Database
Security Group
Database Internet
Port 3306:
Only
Webserver Web server Security Group
SG
Web Web
Server Server
Port 80:
Web Everyone
Server
www.cloudthat.in
Security Groups
www.cloudthat.in
Key-Pair Security Credentials
1) Generate public-private
key pair.
EC2 Instance
2) Keep the private key
safely
3) At instance creation
time, EC2 installs the
public key into new Local Drive
instances
4) After instance is
created, login using
private key
Local Machine
www.cloudthat.in
EC2 Pricing
www.cloudthat.in
Instance Purchasing Options
• On-demand Instances
• Reserved Instances
• Spot Instances
www.cloudthat.in
Elastic IP Addresses
www.cloudthat.in
Elastic IP Address - Pricing
www.cloudthat.in
Instance Elastic IP and Public-IP
www.cloudthat.in
CloudWatch
www.cloudthat.in
CloudWatch Pricing
Amazon CloudWatch Detailed Monitoring for Amazon
EC2 instances (at one-minute frequency)
– $3.50 per instance per month (the per metric price below x 7 pre-defined
metrics per instance)
Amazon CloudWatch Custom Metrics
– $0.50 per metric per month
Amazon CloudWatch Alarms
– $0.10 per alarm per month
Amazon CloudWatch API Requests
– $0.01 per 1,000 Get, List, or Put requests
www.cloudthat.in
Questions?
www.cloudthat.in
Thank You