AWS Innovation in the Datacenter

Werner Vogels
VP & CTO, amazon.com

@werner
 What sets AWS apart from other providers?

Breadth and Depth of Services

 Foundation Security
Storage
Services & Access

Infrastructure Regions Availability Zones Edge POPs

 Foundation Security Networking &
Compute Storage
Services & Access Content Delivery

Infrastructure Regions Availability Zones Edge POPs

 Databases

Relational

Platform NoSQL
Services

Columnar

Caching

Foundation Security Networking &

Compute Storage
Services & Access Content Delivery

Infrastructure Regions Availability Zones Edge POPs

 Databases Analytics

Relational
Hadoop

Platform NoSQL
Services
Real time

Columnar

Data
warehous
Caching e

Foundation Security Networking &

Compute Storage
Services & Access Content Delivery

Infrastructure Regions Availability Zones Edge POPs

 Databases Analytics App Services

Relational Queuing
Hadoop
Orchestration
Platform NoSQL
Services App streaming
Real time
Transcoding
Columnar

Data Email
warehous
Caching e
Search

Foundation Security Networking &

Compute Storage
Services & Access Content Delivery

Infrastructure Regions Availability Zones Edge POPs

 Databases Analytics App Services Deployment & Management

Relational Queuing
Hadoop Containers
Orchestration
Platform NoSQL
Services App streaming
Real time Dev/ops
Transcoding
Columnar

Data Email
warehous Templates
Caching e
Search

Foundation Security Networking &

Compute Storage
Services & Access Content Delivery

Infrastructure Regions Availability Zones Edge POPs

 Databases Analytics App Services Deployment & Management Mobile & Devices

Relational Queuing
Identity
Hadoop Containers
Orchestration
Platform NoSQL Sync
Services App streaming
Real time Dev/ops
Transcoding
Columnar Analytics

Data Email
warehous Templates
Caching e Notifications
Search

Foundation Security Networking &

Compute Storage
Services & Access Content Delivery

Infrastructure Regions Availability Zones Edge POPs

Amazon WorkSpaces

Delivering on the promise

of desktop virtualization

Infrastructure & admin tools

End user desktop and mobile apps

Most successful preview, ever

 Amazon WorkDocs
Fully managed, secure document storage
and sharing service for the Enterprise

Simple document Access from

Easy sharing
feedback any device

Integrate your
Secure Low cost
corporate directory
 Amazon WorkMail
Is secure email and calendaring made easy

Managed email and Integrates with Always available,

calendaring solution Amazon WorkDocs anytime, anywhere.
 Applications Virtual Desktops Collaboration and Sharing

Databases Analytics App Services Deployment & Management Mobile & Devices

Relational Queuing Containers

Hadoop Identity

Orchestration
Dev/ops Tools
Platform NoSQL Real-time Sync
Services App streaming Resource
Templates
Data Transcoding Mobile
Columnar warehouse Usage Analytics
Email Tracking
Data
Caching Workflows Monitoring Notifications
Search and Logs

Foundation Compute Storage Security &

Networking
Services (VMs, Auto-scaling and Load Balancing) (Object, Block and Archive) Access Control

Infrastructure Regions Availability Zones CDN Points of Presence

 What sets AWS apart from other providers?

Breadth and Depth of Services

 What sets AWS apart from other providers?

Breadth and Depth of Services

Relentless Focus on Cost Reduction
 The AWS Price Reduction Philosophy
49 Price Reductions Since 2006
Ecosystem
Global Footprint
Infrastructure New Features
innovation New Services
AWS Trusted Advisor
Four reports available to all
 What sets AWS apart from other providers?

Breadth and Depth of Services

Relentless Focus on Cost Reduction
Customer Driven Innovation
Iterate Based on Customer Feedback

Small, “Two Pizza” Get Core Functionality in the

Teams Hands of Customers, Quickly
Small, autonomous teams Operational stability
Roadmap ownership High scale
Decoupled launch schedules Limited initial feature set
Amazon Amazon Amazon
Redshift Glacier Workspaces
+
EPIC
= COLLABORATION
 Rapid pace of Innovation 516

280

159

82
61
48
24
2008 2009 2010 2011 2012 2013 2014
 What sets AWS apart from other providers?

Breadth and Depth of Services

Relentless Focus on Cost Reduction
Customer Driven Innovation
Innovation at every level of the stack
 Every day, AWS adds enough new server capacity to
support all of Amazon’s global infrastructure when it was
a $7B annual revenue enterprise
Get Networks Out of the Way
Relative cost of networking increasing quickly
Monthly Costs
• Server & storage prices falling fast
• Network costs trending to dominate 4%
Servers
13%

Networking frozen in time Networking Equipment

• Vertically integrated ecosystem

18% Power Distribution & Cooling
• Indefensible profit margins 57%

AWS solution: Power

8%
• Custom net H/W & protocol stack Other Infrastructure

• Private long haul links

3yr server & 10 yr infrastructure amortization
Redundant paths to transit centers
Transit centers connect to:
• Private links to other AWS regions
• Private links to AWS Direct Connect customers
• Internet through peering & paid transit
Redundant paths to transit centers
Transit centers connect to:
• Private links to other AWS regions
• Private links to AWS Direct Connect customers
• Internet through peering & paid transit

82, 864 fiber strands in region

AZs <2ms apart & usually <1ms
25Tbps peak inter-AZs traffic
Why Does AWS Offer AZs?
Asynchronous replication between
distant data centers
• Committing to an SSD order 1 to 2ms
• But, LA to New York is 74ms round trip
• You can’t wait 74ms to commit a transaction
On failure, difficult & high skill decision:
• Fail-over & lose transactions, or
• Or don’t fail-over & lose availability
• Difficult choice
74ms
• Use AZs for no-admin failover
• Sync works when <2ms
• Can be combined with regional replication for very
high availability
Data centers & Availability zones
1 of 28 availability zones world-wide
All regions have 2 or more AZs
Each AZ is 1 or more DC
- No data center is in two AZs
- Some AZs have as many as 6 DCs
DCs in AZ less than ¼ ms apart
Single DC typically over 50,000
servers & often over 80,000
• Larger DCs undesirable (blast
radius)
• Diminishing returns on scale

Up to 102Tbps provisioned in to
a single DC

AWS custom network equipment:

• Multi-ODM sourced
• Amazon custom network protocol
stack
Remove the “virtualization tax”

NIC supports Supports Single

Root I/O Virtualization
Much lower latency & less latency jitter
 Previous Current
generation generation

>10x latency
variability
improvement
>2x average
latency
reduction
Logarithmic Scale

tp0 tp50 tp99 tp99.9 tp00

 OEM servers
• Very general designs able to run wide variety of workloads
• Vast, expensive, world-wide distribution network (30% of cost)

AWS custom servers & storage

• Specialized servers optimized for a specific workload
• Move hot software kernels to hardware implementations
• Custom Intel processors beyond commercially available clock rates
• DCs, servers, networking, storage designed to integrated specs

Example Storage Rack

864 disks, 2,350lb
 Power Infrastructure
Some DCs with custom power
sub-stations
• Lower power cost & build more quickly

• Negotiated power purchasing

agreements

Custom switchgear firmware

3 100% carbon neutral regions:
• US West (Oregon)
• AWS GovCloud (US)
• EU (Frankfurt)
 Thank you

werner@amazon.com