Deploying Docker (Provisioning /w Docker + Chef/Puppet) - DevopsDaysPGH
76 likes53,670 views
This document discusses using Docker containers and Chef configuration management together. It begins by showing how to build Docker images that include Chef using Dockerfiles. It then explains how Chef can be used to configure containers during the image build process, essentially "baking" the configuration into the images. This allows immutable infrastructure where configured containers can be started without needing to rerun Chef provisioning. The document also discusses using multi-stage Dockerfiles and Chef runs to fully configure images. It briefly covers tools for deploying Docker containers, such as using Chef on EC2 instances or with OpenStack Heat orchestration.
![It’s a shell-script?
$ cat SomeApp/Dockerfile
FROM ubuntu:13.10
RUN apt-get update; apt-get install apache
RUN sed ’s/something/else/‘ /etc/apache/httpd.conf
ADD shell-script.sh
RUN shell-script.sh
RUN [‘/usr/bin/apachectl’, ‘start’]](https://image.slidesharecdn.com/deployingdockerdevopsdayspgh-140530093514-phpapp01/85/Deploying-Docker-Provisioning-w-Docker-Chef-Puppet-DevopsDaysPGH-9-320.jpg)
![#!/bin/bash -x
aws ec2 run-instances
--image-id ami-e55a648c
--key-name my-key
--user-data "#include https://get.docker.io”
ip=$(aws ec2 describe-instances
--output json
--filter Name=instance-state-name,Values=running | python
-c 'import json; import sys; print json.load(sys.stdin)
[“Reservations”][0]["Instances"][0]["PublicIpAddress"]')
ssh ubuntu@$ip sudo docker run cirros](https://image.slidesharecdn.com/deployingdockerdevopsdayspgh-140530093514-phpapp01/85/Deploying-Docker-Provisioning-w-Docker-Chef-Puppet-DevopsDaysPGH-47-320.jpg)
![docker::run { 'helloworld':
image => 'base',
command => '/bin/sh -c "while true; do echo
hello world; sleep 1; done"',
ports => ['4444', '4555'],
links => ['mysql:db'],
use_name => true,
volumes => ['/var/lib/couchdb', '/var/log'],
volumes_from => '6446ea52fbc9',
memory_limit => 10485760, # bytes
username => 'example',
hostname => 'example.com',
env => ['FOO=BAR', 'FOO2=BAR2'],
dns => ['8.8.8.8', '8.8.4.4'],
restart_service => true,
}](https://image.slidesharecdn.com/deployingdockerdevopsdayspgh-140530093514-phpapp01/85/Deploying-Docker-Provisioning-w-Docker-Chef-Puppet-DevopsDaysPGH-49-320.jpg)
![heat_template_version: 2013-05-23
description: shared volumes example
resources:
my_instance:
type: OS::Nova::Server
properties:
key_name: ewindisch_key
image: ubuntu-precise
flavor: m1.large
user_data: #include https://get.docker.io
ftp_container:
type: DockerInc::Docker::Container
properties:
docker_endpoint: { get_attr:
[my_instance, first_address] }
image: mikz/vsftpd
ports: [ “21:21” ]
volumes: [ “/ftp” ]
name: “FTP”
apache_container:
type: DockerInc::Docker::Container
properties:
docker_endpoint: { get_attr:
[my_instance, first_address] }
image: fedora/apache
ports: [ “80:80” ]
volumes-from: “FTP”
cmd: “rm -rf /var/www;
ln -s /ftp /var/www;
/run-apache.sh”](https://image.slidesharecdn.com/deployingdockerdevopsdayspgh-140530093514-phpapp01/85/Deploying-Docker-Provisioning-w-Docker-Chef-Puppet-DevopsDaysPGH-52-320.jpg)
Deploying Docker (Provisioning /w Docker + Chef/Puppet) - DevopsDaysPGH
- 1. Deploying with Docker DevOps Days PGH 2014.05.30 a.k.a. provisioning docker containers and images with Chef Deploying with Docker (or not)
- 6. Why do we still need <insert tool here>?
- 9. It’s a shell-script? $ cat SomeApp/Dockerfile FROM ubuntu:13.10 RUN apt-get update; apt-get install apache RUN sed ’s/something/else/‘ /etc/apache/httpd.conf ADD shell-script.sh RUN shell-script.sh RUN [‘/usr/bin/apachectl’, ‘start’]
- 10. I ♥ #!/bin/bash . oo # https://raw.githubusercontent.com/ # ewindisch/bashoo/master/lib/oo # Classes are created implicitly through functions function MsgWriter::new { self=$1; shift msg=$1; shift instance_var $self msg $msg } function MsgWriter::write { self=$1; shift echo $($self.msg) } new terminal is MsgWriter “Hello World” terminal.write
- 11. stack:~/devstack$ wc -l stack.sh functions functions-common lib/* lib/*/* | tail -n1 15490 total
- 14. $ cd ~/rpm-chef $ cat Dockerfile FROM fedora RUN yum update yum -y install chef DockerChef
- 15. $ cd ~/omnibus-chef $ cat Dockerfile FROM fedora" RUN curl -L https://www.opscode.com/chef/install.sh | /bin/bash DockerChef
- 18. Images on HW is usually mutable Hardware Image Linux Chef Installs Chef Image' Linux Chef Creates Replaces Runs
- 19. Ephemeral environments are (somewhat) immutable. Hypervisor Image Linux Chef Runs Image' Linux Chef Chef Runs Configures VM Accesses COW
- 21. Chef-for-runtime $ cat Dockerfile FROM fedora RUN yum update; yum -y install chef ADD http://x/receipes.tar.gz /opt/chef" ADD solo.rb /etc/chef/solo.rb" CMD chef-solo -c /etc/chef/solo.rb ; ! apachectl start
- 30. X
- 31. X
- 33. Servers vs Things Pets vs Cattle
- 35. LET US BAKE IMAGES! Let us BAKE images!
- 37. Containers are like ephemeral VMs* * Docker containers don’t HAVE to be ephemeral, but it’s TheRightThing Docker Image Linux Chef Runs Image' Linux Chef Chef Runs Configures Container Accesses COW TM
- 38. Bakery Chef $ cat Dockerfile FROM fedora RUN yum update; yum -y install chef" ADD http://x/receipes.tar.gz /opt/chef" ADD solo.rb /etc/chef/solo.rb" RUN chef-solo -c /etc/chef/solo.rb
- 39. Burning configuration into images. Docker ContainerInitiates Creates Image Linux Chef Chef Runs Configures Build Creates
- 40. Expanded view: Burning configuration into images. Docker Image tagInitiates Image' Linux Chef Chef Build Image Linux Chef Creates Creates Runs Creates References 1 2
- 43. Anatomy of a Docker +Chef build & run Docker ContainerInitiates Creates Image Linux Chef Chef Runs Configures Chef Runs Configures Build Creates Stage 1 Stage 2
- 44. For All The Things! $ cat Dockerfile FROM fedora RUN yum update; yum -y install chef ADD http://x/receipes.tar.gz /opt/chef" ADD solo-stage1.rb /etc/chef/solo-stage1.rb" ADD solo-stage2.rb /etc/chef/solo-stage2.rb" RUN chef-solo -c /etc/chef/solo-stage1.rb" CMD chef-solo -c /etc/chef/solo-stage2.rb; " apachectl start
- 45. Does it converge? $ docker build —rm . $ echo $? # pass or fail (This is great use of Docker as an alternative to VMs for testing Chef recipes targeting non-Docker production systems)
- 46. Deploying Docker (for real this time)
- 47. #!/bin/bash -x aws ec2 run-instances --image-id ami-e55a648c --key-name my-key --user-data "#include https://get.docker.io” ip=$(aws ec2 describe-instances --output json --filter Name=instance-state-name,Values=running | python -c 'import json; import sys; print json.load(sys.stdin) [“Reservations”][0]["Instances"][0]["PublicIpAddress"]') ssh ubuntu@$ip sudo docker run cirros
- 48. # using https://github.com/bflad/chef-docker $ cat cookbooks/docker-registry/default.rb # Pull latest image docker_image 'samalba/docker-registry' ! # Run container exposing ports docker_container 'samalba/docker-registry' do detach true port '5000:5000' env 'SETTINGS_FLAVOR=local' volume '/mnt/docker:/docker-storage' end $ knife ec2 server create # yada yada yada
- 49. docker::run { 'helloworld': image => 'base', command => '/bin/sh -c "while true; do echo hello world; sleep 1; done"', ports => ['4444', '4555'], links => ['mysql:db'], use_name => true, volumes => ['/var/lib/couchdb', '/var/log'], volumes_from => '6446ea52fbc9', memory_limit => 10485760, # bytes username => 'example', hostname => 'example.com', env => ['FOO=BAR', 'FOO2=BAR2'], dns => ['8.8.8.8', '8.8.4.4'], restart_service => true, }
- 50. Orchestration for Docker with OpenStack Heat DockerInc::Docker: :Container VMs Baremetal
- 51. Heat Workflow Heat API VM Docker NovaNova resource Docker resource Container1 Container2 Container3 HOT
- 52. heat_template_version: 2013-05-23 description: shared volumes example resources: my_instance: type: OS::Nova::Server properties: key_name: ewindisch_key image: ubuntu-precise flavor: m1.large user_data: #include https://get.docker.io ftp_container: type: DockerInc::Docker::Container properties: docker_endpoint: { get_attr: [my_instance, first_address] } image: mikz/vsftpd ports: [ “21:21” ] volumes: [ “/ftp” ] name: “FTP” apache_container: type: DockerInc::Docker::Container properties: docker_endpoint: { get_attr: [my_instance, first_address] } image: fedora/apache ports: [ “80:80” ] volumes-from: “FTP” cmd: “rm -rf /var/www; ln -s /ftp /var/www; /run-apache.sh”
- 53. Ansible - hosts: web sudo: yes tasks: - name: ensure redis container is running docker: image=crosbymichael/redis name=redis - name: ensure redis_ambassador container is running docker: image=svendowideit/ambassador ports=6379:6379 links=redis:redis name=redis_ambassador_ansible
- 54. Mesos Flynn.io
- 57. This is probably material for another talk…
- 58. Container Inventory • discoverd / sdutil • serf • skydock • others?
- 59. X
- 60. X
- 64. Q & A @ewindisch