Scribd Logo
Upload

Welcome to Scribd!

  • 182 views

    Resource Allocation For Linux With Cgroups Presentation

    Uploaded by

    myslef1234
    CGroups (control groups) allow processes to be organized into hierarchical groups whose access to resources can then be limited, accounted, and isolated. CGroups were originally developed in 2006 and merged into the Linux kernel in 2009. They provide controllers for limiting and tracking CPU, memory, disk I/O, network bandwidth, and other resources for process groups. System administrators can use CGroups to guarantee quality of service levels, improve consolidation of virtual machines, and perform cost accounting of resource usage across groups.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PDF, TXT or read online from Scribd

    Resource Allocation For Linux With Cgroups Presentation

    Uploaded by

    myslef1234
    182 views25 pages
    CGroups (control groups) allow processes to be organized into hierarchical groups whose access to resources can then be limited, accounted, and isolated. CGroups were originally developed in 2006 and merged into the Linux kernel in 2009. They provide controllers for limiting and tracking CPU, memory, disk I/O, network bandwidth, and other resources for process groups. System administrators can use CGroups to guarantee quality of service levels, improve consolidation of virtual machines, and perform cost accounting of resource usage across groups.

    Original Title

    Resource Allocation for Linux With Cgroups Presentation

    Copyright

    © Attribution Non-Commercial (BY-NC)

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    CGroups (control groups) allow processes to be organized into hierarchical groups whose access to resources can then be limited, accounted, and isolated. CGroups were originally developed in 2006 and merged into the Linux kernel in 2009. They provide controllers for limiting and tracking CPU, memory, disk I/O, network bandwidth, and other resources for process groups. System administrators can use CGroups to guarantee quality of service levels, improve consolidation of virtual machines, and perform cost accounting of resource usage across groups.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PDF, TXT or read online from Scribd
    Download as pdf or txt
    182 views25 pages

    Resource Allocation For Linux With Cgroups Presentation

    Uploaded by

    myslef1234
    CGroups (control groups) allow processes to be organized into hierarchical groups whose access to resources can then be limited, accounted, and isolated. CGroups were originally developed in 2006 and merged into the Linux kernel in 2009. They provide controllers for limiting and tracking CPU, memory, disk I/O, network bandwidth, and other resources for process groups. System administrators can use CGroups to guarantee quality of service levels, improve consolidation of virtual machines, and perform cost accounting of resource usage across groups.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PDF, TXT or read online from Scribd
    Download as pdf or txt
    You are on page 1of 25

    Resource Management with CGroups

    Solution Architect Red Hat New Zealand sellis@redhat.com


    Attribution-NonCommercial-NoDerivs 3.0 Unported (CC BY-NC-ND 3.0)

    Steven Ellis

    CGroups

    What

    are CGroups do I need CGroups do I use CGroups


    Resource Management with CGroups

    Why

    How

    What are CGroups

    In Kernel capability to limit, account and isolate resources

    CPU Memory Disk I/O

    Originally developed by Rohit Seth in 2006 under the name Process Containers Kernel merge in 2.6.24, now included in most major distributions
    Resource Management with CGroups

    CGroup Controllers

    memory: Memory controller

    Allows for setting limits on RAM and swap usage and querying cumulative usage of all processes in the group Binding of processes within a group to a set of CPUs and controlling migration between CPus Information about CPU usage for a group of processes Controlling the priorization of processes in the group. Think of it as a more advanced nice level Access control lists on character and block devices
    Resource Management with CGroups

    cpuset: CPU set controller

    cpuacct: CPU accounting controller

    cpu: CPU schedular controller

    devices: Devices controller

    CGroup Controllers

    blkio: I/O controller for block devices

    Sets limits on input/output access to and from block devices such as physical drives (disk, solid state, USB, etc.). Suspend or resumes tasks Tags network packets so the Linux traffic controller can identify packets with a particular CGroup

    freezer:

    net_cls: Network Class controller

    Resource Management with CGroups

    Why

    SLA Management

    Meet application SLAs by reducing resource contention and increasing predictability in performance.

    Large Virtual Consolidation

    Prevent single or group of virtual machines monopolising resources., or impacting other environments.

    Cost based accounting

    Cost recovery from business units

    Resource Management with CGroups

    When

    When did I first need CGroups?

    Even I was surprised

    Resource Management with CGroups

    2009/2010

    Mobile Messaging Company Database backups were impacting production services. Very I/O intensive queries

    and insufficient spindles

    Global Coverage

    Scheduling backups was was a major issue.

    Resource Management with CGroups

    2006

    Multiple Websphere JVM's on shared hardware. Memory leaks and CPU peaks were impacting other business services.

    Resource Management with CGroups

    2003-2004

    Multi Vendor JVM testing Red Hat Enterprise Linux

    Releases 2.1 and 3

    JRockit had some interesting performance characteristics

    Can not SSH into host. Physical TTY would timeout before login. Power button wouldn't work.

    10

    Resource Management with CGroups

    Too Far back

    11

    Resource Management with CGroups

    1998-1999

    UK Based Development House Red Hat 5.0 Primary Server

    IMAP email Samba / AFS / NFS GNU Cross-Compilers GDB over serial for Embedded Hardware Remote X via VNC to Mac Workstations

    Boss isn't getting his email


    Resource Management with CGroups

    12

    Modern Challenge - Virtualisation


    Hosting providers requires QoS
    (quality of service guarantees based on pricepoint)
    Network

    40% net Virt Guest A


    50% CPU 50% Mem

    40% net Virt Guest B


    25% CPU 25% Mem

    20% net

    Virt Guest C
    25% CPU 25% Mem

    60%

    20% Storage

    20% I/O

    13

    Resource Management with CGroups

    How

    14

    Resource Management with CGroups

    Using CGroups

    Install cgroups support


    yum install libcgroup apt-get install cgroup-bin libcgroup1


    mount { cpuset = /cgroup/cpuset; cpu = /cgroup/cpu; cpuacct = /cgroup/cpuacct; memory = /cgroup/memory; }

    Setup a basic /etc/cgconfig.conf


    Start the cgroups daemon

    service cgconfig start


    Resource Management with CGroups

    15

    Command Line Tools

    cgexec

    Start new process in specified group(s).

    cgclassify

    Move process to specified group(s).

    cgcreate / cgdelete

    Create and remove cgroups manually

    cgset

    Modify defined cgroup

    16

    Resource Management with CGroups

    Subsystems - memory

    Limit memory usage of processes in a group Parameters (see memory.txt):


    memory.limit_in_bytes maximum allowed memory usage by tasks in the group. memory.max_usage_in_bytes maximum of used memory. memory.stat current memory statistics (RSS, swap, ...)

    Examples:

    HTTP can take only 30% of memory.

    17

    Resource Management with CGroups

    Subsystems - cpu

    Set scheduler priority. Parameters:


    cpu.shares priority of threads in this group, relative to other groups.

    Example:

    SQL can take 2x more CPU cycles than HTTP.

    18

    Resource Management with CGroups

    Subsystems - cpuacct

    Computes CPU cycles, burned by members of the group. Parameters:


    cpuacct.usage nr. of cycles.

    cpuacct.usage_percpu nr. of cycles per CPU.

    Example:

    Members of 'developers' used 107 cpu cycles. Out of that, only 2x106 cpu cycles were exhausted by mySQL.

    19

    Resource Management with CGroups

    Apache Example

    Edit /etc/cgconfig.conf

    group http { memory { memory.limit_in_bytes = 1024M; } }

    Next, add this to the /etc/sysconfig/httpd.conf:

    CGROUP_DAEMON="memory:/http"

    The start cgconfig service and httpd

    20

    Resource Management with CGroups

    CGroups and Virtual Machines

    Allows to control libvirtd and any other process in the cgroup virt

    Examples are memory ceiling / capping Restrict which CPUs libvirt can utilise
    group virt { memory { memory.limit_in_bytes = 3.5G; } cpuset { cpuset.cpus = 1-3; } }

    Add these rules to /etc/cgconfig.conf


    Modify /etc/sysconfig/libvirtd and add

    CGROUP_DAEMON="memory:/virt

    21

    Resource Management with CGroups

    Subsystems - blkio

    Manages block and char I/O devices

    proportional weight-based disk access Weight from 1-1000 Upper limit throttling

    Specify a fixed number of bps per device

    22

    Resource Management with CGroups

    Blkio Demo

    # restart cgroups service cgconfig restart # Setup the throttle as zero and then play with it. cd /cgroup/blkio/ echo 253:0 $((0*1024*1024)) > blkio.throttle.write_bps_device #Monitor I/O with iostat dm-0 3 # Then start DD on the volume while true; do dd if=/dev/zero of=/tmp/test.out; done # Adjust blkio throttle and check iostart output echo 253:0 $((20*1024*1024)) > blkio.throttle.write_bps_device echo 253:0 $((10*1024*1024)) > blkio.throttle.write_bps_device echo 253:0 $((1*1024*1024)) > blkio.throttle.write_bps_device

    23

    Resource Management with CGroups

    References

    RHEL 6 Resource Management Guide

    http://docs.redhat.com/docs/enUS/Red_Hat_Enterprise_Linux/6/html/Resource_Management_Guide

    Fedora Overview

    http://fedoraproject.org/wiki/Features/ControlGroups

    Manage Your Performance with Cgroups and Projects

    http://broadcast.oreilly.com/2009/06/manage-your-performance-with-cgroups-andprojects.html

    Zonker at ServerWatch on Cgroups

    http://www.serverwatch.com/tutorials/article.php/3920051/Introduction-to-LinuxCgroups.htm

    Using Cgroups under Debian

    http://hydra.geht.net/tino/english/faq/debian/squeeze/cgroups/

    24

    Resource Management with CGroups

    Images

    Clipart

    http://www.cksinfo.com/clipart/electronics/phones/mobilephones/camera-phone.png

    Corporate logos (c) current owners. Pointy Headed Boss c/o Scott Adams

    Used under fair use, please contact me if you want this removed.

    25

    Resource Management with CGroups

    You might also like