Tyler Fitch

#ChefConf 2014 BoF - Creating Deploy Jobs in Jenkins

• Tyler Fitch • ChefConf

At #ChefConf 2014 I had the honor of leading a Birds of a Feather session on “Creating Deploy Jobs in Jenkins”.

ChefConf 2014 BoF

My interest here is in deploying a web app to my Chef managed servers.  The problem I need to solve is for when you don’t know what servers you have because in the Cloud the servers come and go.  Servers are cattle - not pets, right?

So what are our options?

knife status “role:webserver AND chef_environment:stage”

will give me the following output.

12 mins ago, ec2-, ec2-57-186-102-29.us-west-2.compute.amazonaws.com,, centos 6.4.
8 mins ago, ec2-, ec2-57-82-206-136.compute-1.amazonaws.com,, centos 6.4.

So I want to cherry pick the 3rd item of the comma-separated list, the hostname.  I could use awk, but found a simple example using cut and went with it. I loop over the output of the knife status search like so

for h in $(knife status “role:webserver AND chef_environment:load”| cut -d’,’ -f3); do ssh -oStrictHostKeyChecking=no myuser@$h “uptime”; done

The -oStrictHostKeyChecking=no is there because I’ve maybe never deployed to this cow before.  Change the ssh “uptime” command to the necessary scp command and you’re deploying.

But it isn’t bulletproof.  If a server crashes and doesn’t unregister itself as an active node with the Chef server you’ll try to deploy to a place that is no longer valid.  One way to mitigate this is use the timestamp column in the knife status result that shows the last time the server phoned home.  If all servers are checking in every 15-30 mins and it’s been an hour since the Chef client last checked with the Chef server then skip trying to deploy to it.

Amazon AWS API options:

During the discussion two options for Amazon Web Services were identified.

Both of these options are nice a would be more accurate than polling the Chef server.  But in my environment I actually have a tool called Scalr fronting my AWS account.  So I can create servers but do not actually have the account’s AWS secret key use the AWS API or Edda!  It’s a hard knock life in the corporate world of cloud billing and measures to consolidate billing for their numerous AWS accounts.

Lesser known options:

Also discussed were the ideas of using Apache Zookeeper, Serf from Hashicorp or etcd from CoreOS.  Zookeeper was not highly rated for WAN setups with machines not on the same networks.  And there was not enough experience with Serf or etcd in the room to give them a proper evaluation. 

The end result for me?

I’m still proceeding with my initial plan that uses Chef Server + knife status lookup command, but now know a few more options to use in the future to solve to create my deployment jobs in Jenkins.

Thanks to Kennon, Eric from Boston, Mahesh from Dow Jones, the Behance guys and the others that I didn’t get your names but joined in the conversation for the BoF.  I had a great time and hope you all did too.

comments powered by Disqus