OpenStack

OpenStack

Stable release	Mitaka (2016.4.0) / 7 April 2016 (2016-04-07)
Written in	Python
Operating system	Cross-platform
Type	Cloud computing
License	Apache License 2.0
Website	openstack.org

OpenStack is a free and open-source software platform for cloud computing, mostly deployed as an infrastructure-as-a-service (IaaS). The software platform consists of interrelated components that control hardware pools of processing, storage, and networking resources throughout a data center. Users either manage it through a web-based dashboard, through command-line tools, or through a RESTful API. OpenStack.org released it under the terms of the Apache License.

OpenStack began in 2010 as a joint project of Rackspace Hosting and NASA. As of 2016, it is managed by the OpenStack Foundation, a non-profit corporate entity established in September 2012 to promote OpenStack software and its community. More than 500 companies have joined the project.

The OpenStack community collaborates around a six-month, time-based release cycle with frequent development milestones. During the planning phase of each release, the community gathers for an OpenStack Design Summit to facilitate developer working sessions and to assemble plans.

Recent OpenStack Summits have taken place in Tokyo, Japan, in October 2015, Vancouver, British Columbia, Canada, in May 2015, and Paris, France, in November 2014. The summit in May 2014 in Atlanta, Georgia, drew 4,500 attendees — a 50% increase from the Hong Kong, China, Summit six months earlier.

An OpenStack Summit took take place in Austin, Texas, on 25–29 April 2016, and will be followed by one in Barcelona, Spain, on 25–28 October 2016.

History

NASA's Nebula platform

In July 2010, Rackspace Hosting and NASA jointly launched an open-source cloud-software initiative known as OpenStack. The OpenStack project intended to help organizations offer cloud-computing services running on standard hardware. The community's first official release, code-named Austin, appeared four months later, with plans to release regular updates of the software every few months. The early code came from NASA's Nebula platform as well as from Rackspace's Cloud Files platform.

In 2011, developers of the Ubuntu Linux distribution adopted OpenStack with an unsupported technology preview of the OpenStack "Bexar" release for Ubuntu 11.04 "Natty Narwhal". Ubuntu's sponsor Canonical then introduced full support for OpenStack clouds, starting with OpenStack's Cactus release.

OpenStack became available in Debian Sid from the Openstack "Cactus" release in 2011, and the first release of Debian including OpenStack was Debian 7.0 (code name "Wheezy"), including OpenStack 2012.1 (code name: "Essex").

In October 2011, SUSE announced the public preview of the industry's first fully configured OpenStack powered appliance based on the "Diablo" OpenStack release. In August 2012, SUSE announced its first commercially supported enterprise OpenStack distribution based on the "Essex" release.

Cisco Cloud Computing CTO, Cloud Computing on OpenStack and network-as-a-Service

In 2012, Red Hat announced a preview of their OpenStack distribution, beginning with the "Essex" release. After another preview release, Red Hat introduced commercial support for OpenStack with the "Grizzly" release, in July 2013.

In July 2013, NASA released an internal audit citing lack of technical progress and other factors as the agency's primary reason for dropping out as an active developer of the project and instead focus on the use of public clouds. This report is contradicted in part by remarks made by Ames Research Center CIO, Ray Obrien.

In December 2013, Oracle announced it had joined OpenStack as a Sponsor and planned to bring OpenStack to Oracle Solaris, Oracle Linux, and many of its products. It followed by announcing Oracle OpenStack distributions for Oracle Solaris and for Oracle Linux using Icehouse on 24 September 2014.

In May 2014, HP announced HP Helion and released a preview of HP Helion OpenStack Community, beginning with the IceHouse release. HP has operated HP Helion Public Cloud on OpenStack since 2012.

At the 2014 Interop and Tech Field Day, software-defined networking was demonstrated by Avaya using Shortest path bridging and OpenStack as an automated campus, extending automation from the data center to the end device, removing manual provisioning from service delivery.

As of March 2015, NASA still makes use of OpenStack private cloud and has RFPs out for OpenStack public cloud support.

In August 2015, Platform9 announced that its OpenStack distribution was fully interoperable with VMware vSphere.

Components

File:OpenStack main services.svg

OpenStack main services

OpenStack has a modular architecture with various code names for its components.

Compute (Nova)

OpenStack Compute (Nova) is a cloud computing fabric controller, which is the main part of an IaaS system. It is designed to manage and automate pools of computer resources and can work with widely available virtualization technologies, as well as bare metal and high-performance computing (HPC) configurations. KVM, VMware, and Xen are available choices for hypervisor technology (virtual machine monitor), together with Hyper-V and Linux container technology such as LXC.

It is written in Python and uses many external libraries such as Eventlet (for concurrent programming), Kombu (for AMQP communication), and SQLAlchemy (for database access). Compute's architecture is designed to scale horizontally on standard hardware with no proprietary hardware or software requirements and provide the ability to integrate with legacy systems and third-party technologies.

Networking (Neutron)

OpenStack Networking (Neutron) is a system for managing networks and IP addresses. OpenStack Networking ensures the network is not a bottleneck or limiting factor in a cloud deployment, and gives users self-service ability, even over network configurations.

OpenStack Networking provides networking models for different applications or user groups. Standard models include flat networks or VLANs that separate servers and traffic. OpenStack Networking manages IP addresses, allowing for dedicated static IP addresses or DHCP. Floating IP addresses let traffic be dynamically rerouted to any resources in the IT infrastructure, so users can redirect traffic during maintenance or in case of a failure.

Users can create their own networks, control traffic, and connect servers and devices to one or more networks. Administrators can use software-defined networking (SDN) technologies like OpenFlow to support high levels of multi-tenancy and massive scale. OpenStack networking provides an extension framework that can deploy and manage additional network services—such as intrusion detection systems (IDS), load balancing, firewalls, and virtual private networks (VPN).

Block Storage (Cinder)

OpenStack Block Storage (Cinder) provides persistent block-level storage devices for use with OpenStack compute instances. The block storage system manages the creation, attaching and detaching of the block devices to servers. Block storage volumes are fully integrated into OpenStack Compute and the Dashboard allowing for cloud users to manage their own storage needs. In addition to local Linux server storage, it can use storage platforms including Ceph, CloudByte, Coraid, EMC (ScaleIO, VMAX and VNX), GlusterFS, Hitachi Data Systems, IBM Storage (IBM DS8000, Storwize family, SAN Volume Controller, XIV Storage System, and GPFS), Linux LIO, NetApp, Nexenta, Nimble Storage, Scality, SolidFire, HP (StoreVirtual and 3PAR StoreServ families) and Pure Storage. Block storage is appropriate for performance sensitive scenarios such as database storage, expandable file systems, or providing a server with access to raw block level storage. Snapshot management provides powerful functionality for backing up data stored on block storage volumes. Snapshots can be restored or used to create a new block storage volume.

Identity (Keystone)

OpenStack Identity (Keystone) provides a central directory of users mapped to the OpenStack services they can access. It acts as a common authentication system across the cloud operating system and can integrate with existing backend directory services like LDAP. It supports multiple forms of authentication including standard username and password credentials, token-based systems and AWS-style (i.e. Amazon Web Services) logins. Additionally, the catalog provides a queryable list of all of the services deployed in an OpenStack cloud in a single registry. Users and third-party tools can programmatically determine which resources they can access.

Image (Glance)

OpenStack Image (Glance) provides discovery, registration, and delivery services for disk and server images. Stored images can be used as a template. It can also be used to store and catalog an unlimited number of backups. The Image Service can store disk and server images in a variety of back-ends, including Swift. The Image Service API provides a standard REST interface for querying information about disk images and lets clients stream the images to new servers.

Glance adds many enhancements to existing legacy infrastructures. For example, if integrated with VMware, Glance introduces advanced features to the vSphere family such as vMotion, high availability and dynamic resource scheduling (DRS). vMotion is the live migration of a running VM, from one physical server to another, without service interruption. Thus, it enables a dynamic and automated self-optimizing datacenter, allowing hardware maintenance for the underperforming servers without downtimes.

Other OpenStack modules that need to interact with Images, for example Heat, must communicate with the images metadata through Glance. Also, Nova can present information about the images, and configure a variation on an image to produce an instance. However, Glance is the only module that can add, delete, share, or duplicate images.

Object Storage (Swift)

OpenStack Object Storage (Swift) is a scalable redundant storage system. Objects and files are written to multiple disk drives spread throughout servers in the data center, with the OpenStack software responsible for ensuring data replication and integrity across the cluster. Storage clusters scale horizontally simply by adding new servers. Should a server or hard drive fail, OpenStack replicates its content from other active nodes to new locations in the cluster. Because OpenStack uses software logic to ensure data replication and distribution across different devices, inexpensive commodity hard drives and servers can be used.

In August 2009, Rackspace started the development of the precursor to OpenStack Object Storage, as a complete replacement for the Cloud Files product. The initial development team consisted of nine developers. SwiftStack, an object storage software company, is currently the leading developer for Swift with significant contributions from HP, Red Hat, NTT, NEC, IBM and more.

Dashboard (Horizon)

OpenStack Dashboard (Horizon) provides administrators and users a graphical interface to access, provision, and automate cloud-based resources. The design accommodates third party products and services, such as billing, monitoring, and additional management tools. The dashboard is also brandable for service providers and other commercial vendors who want to make use of it. The dashboard is one of several ways users can interact with OpenStack resources. Developers can automate access or build tools to manage resources using the native OpenStack API or the EC2 compatibility API.

Orchestration (Heat)

Main article: OpenStack Heat

Heat is a service to orchestrate multiple composite cloud applications using templates, through both an OpenStack-native REST API and a CloudFormation-compatible Query API.

Telemetry (Ceilometer)

OpenStack Telemetry (Ceilometer) provides a Single Point Of Contact for billing systems, providing all the counters they need to establish customer billing, across all current and future OpenStack components. The delivery of counters is traceable and auditable, the counters must be easily extensible to support new projects, and agents doing data collections should be independent of the overall system.

Database (Trove)

Trove is a database-as-a-service provisioning relational and non-relational database engine.

Elastic Map Reduce (Sahara)

Sahara is a component to easily and rapidly provision Hadoop clusters. Users will specify several parameters like the Hadoop version number, the cluster topology type, node flavor details (defining disk space, CPU and RAM settings), and others. After a user provides all of the parameters, Sahara deploys the cluster in a few minutes. Sahara also provides means to scale a preexisting Hadoop cluster by adding and removing worker nodes on demand.

Bare Metal (Ironic)

Ironic is an OpenStack project that provisions bare metal machines instead of virtual machines. It was initially forked from the Nova Baremetal driver and has evolved into a separate project. It is best thought of as a bare-metal hypervisor API and a set of plugins that interact with the bare-metal hypervisors. By default, it will use PXE and IPMI in concert to provision and turn on and off machines, but Ironic supports and can be extended with vendor-specific plugins to implement additional functionality.

Messaging (Zaqar)

Zaqar is a multi-tenant cloud messaging service for Web developers. The service features a fully RESTful API, which developers can use to send messages between various components of their SaaS and mobile applications by using a variety of communication patterns. Underlying this API is an efficient messaging engine designed with scalability and security in mind. Other OpenStack components can integrate with Zaqar to surface events to end users and to communicate with guest agents that run in the "over-cloud" layer.

Shared File System (Manila)

OpenStack Shared File System (Manila) provides an open API to manage shares in a vendor agnostic framework. Standard primitives include ability to create, delete, and give/deny access to a share and can be used standalone or in a variety of different network environments. Commercial storage appliances from EMC, NetApp, HP, IBM, Oracle, Quobyte, and Hitachi Data Systems are supported as well as filesystem technologies such as Red Hat GlusterFS.

DNS (Designate)

DNS as a Service

Search (Searchlight)

Searchlight provides advanced and consistent search capabilities across various OpenStack cloud services. It accomplishes this by offloading user search queries from other OpenStack API servers by indexing their data into ElasticSearch. Searchlight is being integrated into Horizon and also provides a Command-line interface.

Key Manager (Barbican)

Barbican is a REST API designed for the secure storage, provisioning and management of secrets. It is aimed at being useful for all environments, including large ephemeral Clouds.

Historical Names

Several of the OpenStack projects have needed to change their names due to Trademark issues.

• Neutron was formerly known as Quantum.
• Sahara used to be called Savanna.
• Designate was previously known as Moniker.
• Trove was formerly known as RedDwarf.
• Zaqar was formerly known as Marconi.

Compatibility with other Cloud APIs

OpenStack does not strive for compatibility with other clouds APIs. However, there is some amount of compatibility driven by various members of the OpenStack community for whom such things are important.

• The EC2 API project aims to provide compatibility with Amazon EC2
• The GCE API project aims to provide compatibility with Google Compute Engine
• The Swift3 project is middleware to add Amazon S3 support to Swift

Governance

OpenStack is governed by a non-profit foundation and its board of directors, a technical committee and a user committee. The board of directors is made up of eight members from each of the eight platinum sponsors, eight members from the 24 defined maximum allowed Gold sponsors, and eight members elected by the Foundation individual members.

The current sitting board of directors is:

• Platinum directors:
  • Alan Clark, SUSE, Chairman of the Board
  • Eileen Evans, Hewlett Packard Enterprise
  • Van Lindberg, Rackspace
  • Mark McLoughlin, Red Hat
  • Toby Ford, AT&T
  • Todd Moore, IBM
  • Imad Sousou, Intel
  • Mark Baker, Canonical

• Gold directors:
  • Robert Esker, NetApp
  • Roland Chan, Aptira
  • Steven Hallett, Symantec
  • Alex Freedland, Mirantis
  • Lew Tucker, Cisco
  • Ann Lai, Huawei
  • Kenji Kaneshige, Fujitsu
  • Manju Ramanathpura, Hitachi

• Individual directors:
  • Tim Bell, CERN
  • Russell Bryant, Red Hat
  • Kavit Munshi, Aptira
  • Allison Randal, Hewlett Packard Enterprise
  • Boris Renski, Mirantis
  • Egle Sigler, Rackspace
  • Shane Wang, Intel
  • Monty Taylor, IBM

• The current technical committee is:
  • Russell Bryant, Red Hat
  • Thierry Carrez, OpenStack Foundation
  • Sean Dague, Hewlett Packard Enterprise
  • Anne Gentle, Rackspace
  • Doug Hellmann, Red Hat
  • Kyle Mestery, IBM
  • Davanum Srinivas, Mirantis
  • Flavio Percoco, Red Hat
  • Monty Taylor, IBM
  • John Garbutt, Rackspace
  • Matthew Treinish, Hewlett Packard Enterprise
  • Mike Perez, OpenStack Foundation
  • Morgan Fainberg, Red Hat

• The current user committee is:
  • Edgar Magana, Workday, Inc.
  • Jon Proulx, MIT
  • Shilla Saebi, Comcast

The Foundation's stated mission is "[by] providing shared resources to help achieve the OpenStack Mission by Protecting, Empowering, and Promoting OpenStack software and the community around it, including users, developers and the entire ecosystem." Though, it has little to do with the development of the software, which is managed by the technical committee - "an elected group that represents the contributors to the project, and has oversight on all technical matters."

Users

OpenStack has a wide variety of users, from a number of different sectors. Notable users include:

• AT&T – joined OpenStack in January 2012
• BBVA
• Bhabha Atomic Research Centre has a private cloud to cater to in house employees' requirements.
• BMW
• Box
• CERN
• Comcast
• Deutsche Telekom has created a "Business Marketplace", whose functionality is based on OpenStack
• DreamHost - offers public cloud computing.
• eBay
• HP Converged Cloud, which combines software and cloud services into a unified set of packages and under a single unified architecture.
• Intel
• Internap
• iQIYI
• KT (formerly Korea Telecom) - for object storage only
• MercadoLibre.com – MercadoLibre has over 6,000 VMs managed by OpenStack
• NASA
• Nokia Networks (formerly Alcatel-Lucent)
• NSA
• OVH/RunAbove
• PayPal
• Rackspace Cloud
• Sony - online games for PlayStation 4
• Spil Games
• SUSE Cloud solution. See SUSE Cloud product description.
• Walmart
• Wikimedia Labs
• Yahoo!

Deployment models

As the OpenStack project has matured, vendors have pioneered multiple ways for customers to deploy OpenStack:

• OpenStack-based Public Cloud: A vendor provides a public cloud computing system based on the OpenStack project.
• On-premises distribution: In this model, a customer downloads and installs an OpenStack distribution within their internal network. See Distributions.
• Hosted OpenStack Private Cloud: A vendor hosts an OpenStack-based private cloud: including the underlying hardware and the OpenStack software.
• OpenStack-as-a-Service: A vendor hosts OpenStack management software (without any hardware) as a service. Customers sign up for the service and pair it with their internal servers, storage and networks to get a fully operational private cloud.
• Appliance based OpenStack: Nebula was a vendor that sold appliances that could be plugged into a network which spawned an OpenStack deployment.

Distributions

• Bright Computing
• Canonical
• HP
• IBM
• Mirantis
• Oracle OpenStack for Oracle Linux, or O3L
• Oracle OpenStack for Oracle Solaris
• Platform9 Managed OpenStack
• Red Hat
• SUSE

Release history

Release name	Release date	Included Component code names
Austin	21 October 2010	Nova, Swift
Bexar	3 February 2011	Nova, Glance, Swift
Cactus	15 April 2011	Nova, Glance, Swift
Diablo	22 September 2011	Nova, Glance, Swift
Essex	5 April 2012	Nova, Glance, Swift, Horizon, Keystone
Folsom	27 September 2012	Nova, Glance, Swift, Horizon, Keystone, Quantum, Cinder
Grizzly	4 April 2013	Nova, Glance, Swift, Horizon, Keystone, Quantum, Cinder
Havana	17 October 2013	Nova, Glance, Swift, Horizon, Keystone, Neutron, Cinder, Heat, Ceilometer
Icehouse	17 April 2014	Nova, Glance, Swift, Horizon, Keystone, Neutron, Cinder, Heat, Ceilometer, Trove
Juno	16 October 2014	Nova, Glance, Swift, Horizon, Keystone, Neutron, Cinder, Heat, Ceilometer, Trove, Sahara
Kilo	30 April 2015	Nova, Glance, Swift, Horizon, Keystone, Neutron, Cinder, Heat, Ceilometer, Trove, Sahara, Ironic
Liberty	16 October 2015	Nova, Glance, Swift, Horizon, Keystone, Neutron, Cinder, Heat, Ceilometer, Trove, Sahara, Ironic, Zaqar, Manila, Designate, Barbican, Searchlight
Mitaka	7 April 2016	Nova, Glance, Swift, Horizon, Keystone, Neutron, Cinder, Heat, Ceilometer, Trove, Sahara, Ironic, Zaqar, Manila, Designate, Barbican, Searchlight
Newton	Scheduled 6 October 2016

See also

• Cloud computing comparison
• OpenShift
• Openstack Appliances

External links

• Official website