OpenStack Cookbook: Freedom in the Cloud...

TheREALChrisAnderson.com

Chris Anderson

12/17/12

OpenStack CookBook



Freedom in the Cloud…

By Chris Anderson Christopher J. Anderson

Page 1 Page 1

9/11/12


Chris Anderson

12/17/12

OpenStack CookBook Freedom in the Cloud… --------------------------------------------------------------------------------

o

Who is behind OpenStack? Who can use OpenStack? Why make it open source? The Mission 4 Founding Principles Open Source Open Design Open Development Open Community • • •

 

• • • •

o    

Control & Flexibility Industry Standard Proven Software Compatible & connected

o     

Austin Bexar Cactus Diablo Essex

o   

COMPUTE (aka Nova) OBJECT STORAGE (aka Swift) IMAGE SERVICE (aka Glance)

o  

Christopher J. Anderson

Page 2 Page 2

9/11/12


Chris Anderson

12/17/12

OpenStack CookBook Freedom in the Cloud… -------------------------------------------------------------------------------- o                

http://wiki.openstack.org/ http://docs.openstack.org/ http://nova.openstack.org/ http://swift.openstack.org/ http://glance.openstack.org/ https://launchpad.net/nova Christopher J. Anderson

Page 3 Page 3

9/11/12


Chris Anderson

12/17/12

OpenStack CookBook Freedom in the Cloud… -------------------------------------------------------------------------------- OpenStack is a global collaboration of developers and cloud computing technologists producing the ubiquitous open source cloud computing platform for public and private clouds. The project aims to deliver solutions for all types of clouds by being simple to implement, massively scalable, and feature rich. The technology consists of a series of interrelated projects delivering various components for a cloud infrastructure solution.

-

Founded by Rackspace Hosting and NASA, OpenStack has grown to be a global software community of developers collaborating on a standard and massively scalable open source cloud operating system. Our mission is to enable any organization to create and offer cloud computing services running on standard hardware.

-

Corporations, service providers, VARS, SMBs, researchers, and global data centers looking to deploy large-scale cloud deployments for private or public clouds leveraging the support and resulting technology of a global open source community.

-

All of the code for OpenStack is freely available under the Apache 2.0 license. Anyone can run it, build on it, or submit changes back to the project. We strongly believe that an open development model is the only way to foster badly-needed cloud standards, remove the fear of proprietary lock-in for cloud customers, and create a large ecosystem that spans cloud providers.


Page 4 Page 4

9/11/12


Chris Anderson

12/17/12


"To produce the ubiquitous Open Source cloud computing platform that will meet the needs of public and private cloud providers regardless of size, by being simple to implement and massively scalable." ------------------------------------------------------------------------------------------------------------

- No licensed (pay for) versions. All code is released under the Apache 2.0 License allowing the community to use it freely.

- Every 6 months the development community will hold a design summit to gather requirements and write specifications for the upcoming release.

- Publicly available source code repository is available on LAUNCHPAD & GITHUB throughout the development process.

- Our core goal is to produce a healthy, vibrant development and user community. All processes will always be documented, open, & transparent.


Page 5 Page 5

9/11/12


Chris Anderson

12/17/12


Control and Flexibility Open source platform means you’re never locked to a proprietary vendor, and modular design means you can integrate with legacy or third-party technologies to meet your business needs. - Hypervisor support for Microsoft Hyper-V, Citrix XenServer, Xen, KVM, VMWare ESX, LXC, QEMU, and UML.

-

Industry Standard -

More than 60 leading companies from over a dozen countries are participating in OpenStack, including Cisco, Citrix, Dell, Intel and Microsoft, and new OpenStack clouds are coming online across the globe.

Proven Software -

Running of OpenStack cloud means running the same software that today powers some of the largest public and private clouds in the world.

Compatible and Connected -

Compatibility with public OpenStack clouds means enterprises are prepared for the future—making it easy to migrate data and applications to public clouds when conditions are right—based on security policies, economics, and other key business criteria.


Page 6 Page 6

9/11/12


Chris Anderson

12/17/12

OpenStack CookBook Freedom in the Cloud… -------------------------------------------------------------------------------- Starting with the Diablo release, the OpenStack release cycle abandoned its 3-month time-based cycle for a coordinated 6-month release cycle with frequent development milestones. These codenames are chosen after a city or county near where the corresponding OpenStack design summit took place:

o

o o

o

o o

o

o o o o

o

o

Hypervisor Support: Xen, KVM, QEMU, User Mode Linux Support Security Groups Implementation Rescue Mode Experimental - Glance (Image Store as a Service) OpenStack Compute ready for enterprise private cloud deployments and mid-size service provider deployments Enhanced documentation Easier to install and deploy OpenStack Compute ready for large service provider scale deployments Planning (Design, Discuss & Target) Implementation (Milestone iterations) QA (The road to full release) Intended to be ‘Rackspace ready’ release Focuses on quality, usability & extensibility across Enterprise, service providers & (HPC) high performance computing deployments. Leverage pools of on-demand, self-managed compute, storage & networking resources to build efficient, automated private & public cloud infrastructure.


Page 7 Page 7

9/11/12


Chris Anderson

12/17/12


OpenStack is a collaborative software project designed to create freely available code, badly needed standards, and common ground for the benefit of both cloud providers and cloud customers. OpenStack is currently three projects: ------------------------------------------------------------------------------------------------------------ Open source software and standards for large-scale deployments of automatically provisioned virtual compute instances. OpenStack Compute is open source software designed to provision and manage large networks of virtual machines, creating a redundant and scalable cloud computing platform. It gives you the software, control panels, and APIs required to orchestrate a cloud, including running instances, managing networks, and controlling access through users and projects. OpenStack Compute strives to be both hardware and hypervisor agnostic, currently supporting a variety of standard hardware configurations and seven major hypervisors. http://www.openstack.org/software/openstack-compute/ •

•

•

•

•

•

•

Component based architecture: Quickly add new roles. Highly available: Scale to very serious workloads Fault-Tolerant: Isolated processes avoid cascading failures Recoverable: Failures should be easy to diagnose, debug, and rectify. But no centralized logging. Open Standards: Be a reference implementation for a community-driven api API Compatibility: Nova strives to provide API- compatible with popular systems like Amazon EC2 Advancement of OpenStack API as industry standard.


Page 8 Page 8

9/11/12


Chris Anderson

12/17/12

OpenStack CookBook Freedom in the Cloud… -------------------------------------------------------------------------------- Open source software and standards for large-scale, redundant storage of static objects. Swift is open source software for creating redundant, scalable object storage using clusters of standardized servers to store petabytes of accessible data. It is not a file system or real-time data storage system, but rather a long-term storage system for a more permanent type of static data that can be retrieved, leveraged, and then updated if necessary. Primary examples of data that best fit this type of storage model are virtual machine images, photo storage, email storage and backup archiving. Having no central "brain" or master point of control provides greater scalability, redundancy and permanence. http://www.openstack.org/software/openstack-storage/

------------------------------------------------------------------------------------------------------------ Christopher J. Anderson

Page 9 Page 9

9/11/12


Chris Anderson

12/17/12

OpenStack CookBook Freedom in the Cloud… -------------------------------------------------------------------------------- Provides discovery, registration, and delivery services for virtual disk images. The Glance project provides services for discovering, registering, and retrieving virtual machine images. Glance has a RESTful API that allows querying of VM image metadata as well as retrieval of the actual image. Similar to Amazon’s AMI Marketplace. Virtual disk images can be stored in a variety of back-end stores, including OpenStack Object Storage, as well as local disks. Clients can register new virtual disk images with the Image Service, query for information on publicly available disk images, and use the Image Service's client library for streaming virtual disk images.


Page 10 Page 10

9/11/12


Chris Anderson

12/17/12


In addition to the three existing core projects above, two new projects were incubated with the Diablo release and will be promoted to ‘core’ for the forthcoming Essex version. ------------------------------------------------------------------------------------------------------------ http://www.openstack.org/software/openstack-shared-services/

Code-named Keystone, the OpenStack Identity Service provides unified authentication across all OpenStack projects and integrates with existing authentication systems. ------------------------------------------------------------------------------------------------------------ http://www.openstack.org/software/openstack-dashboard/

Code-named Horizon, the OpenStack Dashboard enables administrators and users to access and provision cloud- based resources through a self-service portal.


Page 11 Page 11

9/11/12


Chris Anderson

12/17/12


These projects are provided by the wider community and have no official endorsement. They are projects that are related to one of more OpenStack projects and may extend the functionality or usability of the core OpenStack projects. ------------------------------------------------------------------------------------------------------------ Project Leads: Youcef Laribi and Uma Goring Overview: The Atlas project will provide Load Balancing as a Service or LBaaS for short. The goal is for load balancing vendors to be able to write adapters to this service for their technology. ----------------------------------------------------- Project Lead: Eric Day Overview: A messaging queue system for multi-tenant cloud use. Burrow has a simple API and modular design. ----------------------------------------------------- Project Lead: Yas Naoi Overview: Cloud management tool based on Drupal moduls for supporting multiple clouds. Supported cloud functionalities include server templates, clusters, monitoring, billing, resource allocation, reliability, scalability and more. -----------------------------------------------------


Page 12 Page 12

9/11/12


Chris Anderson

12/17/12

OpenStack CookBook Freedom in the Cloud… -------------------------------------------------------------------------------- Project Lead: Shivan Bindal Overview: A common interface used to manage multiple clouds based on the RightScale gateway. Ultimately, the Cloud Gateway should evolve into an interoperable cloud standard. ----------------------------------------------------- Project Lead: Rob Hirschfeld ( https://github.com/dellcloudedge/crowbar ) Overview: A DevOps inspired cloud installation and maintenance system that allows users to quickly deploy a fully functioning OpenStack cloud. The code design is modular so that operators can choose which components, infrastructure, and vendors they want to include in their system; however, modules are also system aware and cross reference each other to build an integrated operating environment. Crowbar is a wrapper for the open source Opscode Chef Server (which is installed as part of package) with the addition of PXE/DHCP based node discovery, an orchestration state machine, and system level deployment semantics. Crowbar provides a foundation for adapting to software changes while creating scalable and repeatable cloud deployments. ----------------------------------------------------- Project Lead: Shigetoshi Yokoyama; ( https://github.com/nii-cloud/dodai ) Overview: "Cluster as a Service" Managing multiple clusters for openstack clouds, Hadoop, and other diverse frameworks. Clusters of commodity servers are used for a variety of distributed applications like simulation, data


Page 13 Page 13

9/11/12


Chris Anderson

12/17/12

OpenStack CookBook Freedom in the Cloud… -------------------------------------------------------------------------------- analysis, web services, and so on. No single framework can fit every distributed application. Users can get clusters just by specifying the configuration of them. Dodai has sub- projects like Dodai-deploy and Dodai-compute . -----------------------------------------------------

Project Lead: Rick Clark Overview: Donabe is a container service, a group of resources created and/or managed as one unit, with an initial focus on network containers. -----------------------------------------------------

Project Lead: Gustavo Niemeyer ( http://juju.ubuntu.com )

Overview: Juju focuses on managing the service units you need to deliver a single solution, above simply configuring the machines or cloud instances needed to run them. Charms developed, tested, and deployed on your own hardware will operate the same in OpenStack, or any other EC2 API compatible cloud. Furthermore, juju allows you to test your deployments locally via LXC containers, providing an inexpensive and fast way to test your OpenStack deployment or any other scale-out, multi-node solution. Through the use of charms, juju provides you with shareable, re-usable, and repeatable expressions of DevOps best practices. You can use them unmodified, or easily change and connect them to fit your needs. Deploying a charm is similar to installing a package on Ubuntu: ask for it and it’s there, remove it and it’s completely gone. -----------------------------------------------------


Page 14 Page 14

9/11/12


Chris Anderson

12/17/12


Project Lead: Chuck Thier Overview: An open commodity storage platform that will integrate with the Nova Volume service. -----------------------------------------------------

Project Lead: Troy Toman Overview: Melange will provide network information services with a focus on IP address management and address discovery. Melange will be a standalone service with its own API but fully integrate-able with Nova. -----------------------------------------------------

Project Lead: Sandy Walsh Overview: A Nova deployment is called a Zone. Internal deployment nuances, such as hostnames and service information, are hidden to users outside of a Zone. Zones may be joined together to form a hierarchy of OpenStack services. This may be used to partition OpenStack into geographical regions or business units. A Zone may have the full suite of Nova services or can be as simple as the API & Scheduler services. The Distributed Scheduler provisions servers across Zones. -----------------------------------------------------


Page 15 Page 15

9/11/12


Chris Anderson

12/17/12

OpenStack CookBook Freedom in the Cloud… -------------------------------------------------------------------------------- Project Lead: Dave Walker ( http://wiki.ubuntu.com/Orchestra ) Overview: A collection of what Ubuntu feels are the best free software services for provisioning, deploying, hosting, managing, and orchestrating enterprise data center infrastructure services, by, with, and for Ubuntu Server. Orchestra, via Juju, enables users to quickly deploy an OpenStack cloud solution across any x86/x86_64 (and soon ARM!) hardware in the datacentre. Using other leading tools, Orchestra also monitors server activity centrally and provisions new server resources rapidly as and when they are needed. In short, Orchestra allows organisations to provision clouds in minutes, and manage and maintain it using commonly accepted and leading opensource tools. ----------------------------------------------------- Project Lead: Dan Wendlandt Overview: A service providing network connectivity-as-a- service for devices managed by other OpenStack services. It exposes a generic and extensible API, allowing users to build and manage their networks, and uses a pluggable architecture, thus enabling different technologies to implement the logical abstractions exposed by the API. ----------------------------------------------------- Project Lead: Michael Basnight Overview: A scalable relational database service that allows users to quickly and easily utilize the features of a relational database without the burden of handling complex administrative tasks. Cloud users and database administrators can provision and manage multiple database


Page 16 Page 16

9/11/12


Chris Anderson

12/17/12

OpenStack CookBook Freedom in the Cloud… -------------------------------------------------------------------------------- instances as needed. Initially, the service will focus on providing resource isolation at high performance while automating complex administrative tasks including deployment, configuration, patching, backups, restores, and monitoring. ----------------------------------------------------- Project Lead: Eldar Nugaev Overview: A topology service which is being augmented by a number of adapters as a primary way to provide a solution for failure zones centered IaaS deployment. ----------------------------------------------------- Project Lead: Ante Karamati ć ( https://launchpad.net/cloud- live ) Overview: The project uses components of OpenStack to deliver a fully functional development/demo cloud for use on your laptop or desktop. By leveraging an Ubuntu live ISO image, you can safely use the cloud without harm to your own machine configuration. By providing the desktop, you even have direct access to the OpenStack Dashboard (Horizon). ----------------------------------------------------- Project Lead: Sandy Walsh Overview: A Nova deployment is called a Zone. Internal deployment nuances, such as hostnames and service ------------------------------------------------------------------------------------------------------------


Page 17 Page 17

9/11/12

OpenStack Cookbook: Freedom in the Cloud...

Recommend Documents