Using Docker to run RackHD along with ELK.

Copyright 2016, EMC, Inc.

On Mac OS X.

Prerequisites:

• Install Vagrant. See https://www.vagrantup.com/docs/installation/
• Install Docker Toolbox. See https://www.docker.com/products/docker-toolbox

$ cd RackHD/docker
$ vagrant up                  # Create and provision Docker VM.
$ . export_docker_host.bash   # Point docker host to Docker VM.
$ vagrant ssh                 # SSH into Docker VM.
$ cd /RackHD/docker           # Go to RackHD/docker.
$ docker-compose up           # Run RackHD.

On a Linux host.

Prerequisites:

• docker v1.10 or higher
• docker-compose v1.6 or higher Install Docker Compose
• Please make sure vm.max_map_count >= 262144 sudo sysctl -w vm.max_map_count=262144

$ cd RackHD/docker                            # TAG can be a release version, if not set default: latest
$ sudo TAG=${TAG} docker-compose pull         # Download prebuilt docker images.
$ sudo TAG=${TAG} docker-compose up           # Create containers and Run RackHD.

Once RackHD is running.

Open http://127.0.0.1:9090 in a web browser.

The index.html file being service is located at: RackHD/docker/monorail/static/http.

You can actually edit this file and refresh your browser to see your changes.

How to change RackHD config.

Simply edit the RackHD/docker/monorail/config.json file and restart your containers.

docker-compose restart        # Restart RackHD.

Rebuild RackHD images for development.

It is recommended that you uncomment the core RackHD service before developing RackHD. This service doesn't need to run but it should be rebuilt before other RackHD images are built.

$ ../scripts/reset_submodules.bash  # Fetch latest submodules.
$ docker-compose build              # Build RackHD Docker images.
$ docker-compose kill               # Force stop running RackHD containers.
$ docker-compose rm -f              # Remove previous RackHD containers.
$ docker-compose create             # Create new RackHD containers.
$ docker-compose start              # Run RackHD.
$ docker-compose logs               # Show docker logs.

(Advanced)The above rebuild steps won't rebuild static files image: rackhd/files and just pull latest, If you reset ../on-imagebuilder to a specific commit or customize its code, you need to rebuild rackhd/files.

......
$ cd ../on-imagebuilder && sudo build_all.sh                       # Build static files.
$ rm -rf common pxe && mkdir common && mkdir pxe                   # Prepare folders for stashing static files.
$ cp $output_path/builds/* common/                                 # Copy http static files
$ cp $output_path/syslinux/* pxe/ && cp $output_path/ipxe/* pxe/   # Copy tftp static files
$ docker-compose -f docker-compose-dev.yml build                   # Use *-dev.yml to build images including rackhd/files
......

DHCP Server runs by default.

By default this will run dhcpd on eth1, however you can change the configuration at RackHD/docker/dhcp/config/dhcpd.conf and RackHD/docker/dhcp/defaults/isc-dhcp-server.

Restart rackhd/isc-dhcp-server and the changes will take effect.

The dhcpd.leases file is shared between docker containers using a docker volume.

You can disable the DHCP server by commenting it out the docker-compose.yml file.

Or after you've started all containers you can run:

$ docker-compose kill dhcp    # Stop the DHCP server.

Shared on-http and on-tftp files.

The rackhd/files image shares on-http and on-tftp file downloads with the host machine. Experimental

Using Docker on the EMC network:

If you're trying to run this example inside the EMC see: https://github.com/emccode/training/tree/master/docker-workshops/docker-platform-intro/lab1-your-first-container#for-emc-employees-only

Discovering a VirtualBox VM in RackHD.

This example is meant to run on Mac OS X or if you're using VirtualBox to run RackHD on Docker.

$ NAME=pxe-1 ./create_pxe_vm.bash   # Creates PXE VM in VirtualBox.

Now start pxe-1 from VirtualBox. You should see it boot and auto automatically get discovered and catalogs by RackHD.

Troubleshoot common Vagrant issues.

If running ./docker_vm_up.bash fails: * By default the Vagrant Docker VM exposes all related ports. Some of which are only necessary for development and debugging. You can disable any ports you do not wish to use, or change the which port on the host they map too. * Ensure you have the right version of Vagrant for VirtualBox. Later versions of VirtualBox require a more recent version of Vagrant.

Run RackHD containers (with ELK).

For who need ELK running along with RackHD, due to system performance restriction or docker-pull network bandwidth restriction: an alternative docker-compose file can be used by "-f" option:

$ TAG=${TAG} docker-compose -f docker-compose-elk.yml pull
$ TAG=${TAG} docker-compose -f docker-compose-elk.yml up

Open http://127.0.0.1:5601 in a web browser, you can see kibana's website.

Running this example without docker-compose.

For convenience there are alternative scripts you can use instead of docker-compose.

$ ./scripts/compose_services.bash    # Run all RackHD docker containers.
$ ./scripts/follow_services.bash     # Follow all RackHD logs.
$ ./scripts/restart_services.bash    # Restart all RackHD docker containers.
$ ./scripts/stop_services.bash       # Stop all RackHD docker containers.
$ ./scripts/remove_services.bash     # Remove all RackHD docker containers