Linecook

Linecook
(A Chef Alternative)
Simon Chiang
Tuesday, April 26, 2011

Chef

Ruby
Chef

Opscode
Ruby
Chef

“Systems Integration
Framework” Opscode
Ruby
Chef

Ruby
Open Source Chef

Ruby
Open Source Chef

Automated

Ruby
Open Source Chef

Scalable
Automated

Ruby
Server Provisioning
Open Source Chef
Scalable
Automated

Ruby
Server Provisioning
Open Source Chef
Scalable
Automated
Community

Ruby
Server Provisioning
Open Source Chef
Scalable
Automated
Community
Hotness

An alternative to
shell scripts
Not dismissing Chef when I say that. The advantages over manually writing setup/maintenance script are not to
be underestimated. But for the most part things you do with Chef are things you would otherwise do with shell
scripts, and there are problems.
Never a quick
Quickstart
“Before installing Chef, you should take a moment to
understand the various "flavors" of chef: client-server,
chef-solo, and the Opscode Platform. Deciding which
one is right for you will impact your installation
process. You may also want to take a quick look at
Chef's architecture to get an idea of what you're
installing before you proceed.”
http://wiki.opscode.com/display/chef/Installation

Not a script,
but sort of...
[lib/chef/provider/package/zypper.rb] @ 0.10.0.rc.0
def install_package(name, version)

if version
run_command(
:command => "zypper -n --no-gpg-checks install -l #{name}=#{version}"
)

Not a script,
but sort of...

if version
run_command(
)
Fixed options :(

Not a script,
but sort of...

if version
run_command(
)
Fixed options :(
Error for version=""

https://github.com/opscode/chef/pull/27

Many moving parts
http://wiki.opscode.com/display/chef/Architecture

Many moving parts
http://wiki.opscode.com/display/chef/Vagrant

Many moving parts
http://wiki.opscode.com/display/chef/Vagrant
http://community.opscode.com/cookbooks

Alternative?

Shell Scripts!

Linecook
A Shell Script Generator

Established Tools
(bash, ssh, gems, VirtualBox)
Just use the existing systems. Some ‘advanced’ techniques but all established, known systems
Prior experience applies any learning will feed back into existing workflow
Start with a Script
End with a Script
Able to bring an existing script to Linecook, then rework to make it more powerful or maintainable. You will work
with scripts directly. Again all prior experience applies.
Pretty quick
Quickstart
Make a server
Make a script
Run script on server

Pretty quick
Quickstart
Make a server 1
Make a script
Run script on server

Pretty quick
Quickstart
Make a server 1
Make a script
Run script on server 2

Pretty quick
Quickstart
Make a server 1
Make a script 3
Run script on server 2

An ERB Trick...

How to Make a Server
VirtualBox
Install OS
SSH Key Exchange localhost

VirtualBox VirtualBox
Install OS

abox-ubuntu
Install OS

abox-ubuntu
Install OS

Port Forwarding
abox-ubuntu
VBoxManage modifyvm abox
--natpf1 'abox-ssh,tcp,,
2220,,22' VirtualBox
Access VM by ssh to
localhost
localhost
ssh -p 2220 linecook@localhost

Lather, rinse
abox-ubuntu
VBoxManage modifyvm bbox
--natpf1 'bbox-ssh,tcp,, bbox-ubuntu
2221,,22' ...
Repeat as needed
localhost

Advantages
No special prerequisites on servers
Fast Access (fast enough for TDD)
Cmdline control
Multiple VMs
Snapshots

How to Run Scripts
cat > script.sh <<"DOC"
echo "# $(whoami)@$(hostname): hello
world!"
DOC
chmod +x script.sh
scp -P 2220 script.sh linecook@localhost:/tmp/script.sh

ssh -p 2220 linecook@localhost -- /tmp/script.sh
# linecook@abox-ubuntu: hello world!

Redundany
cat > script.sh <<"DOC"
echo "# $(whoami)@$(hostname): hello
world!"
DOC
chmod +x script.sh
scp -P 2220 script.sh linecook@localhost:/tmp/script.sh

ssh -p 2220 linecook@localhost -- /tmp/script.sh

Use SSH Config
mkdir config
cat > config/ssh <<"DOC"
Host abox
Port 2220
User linecook
Hostname localhost
DOC
scp -F config/ssh script.sh abox:/tmp/script.sh

ssh -F config/ssh abox -- /tmp/script.sh

Multiple Hosts
Host abox
Port 2220
Host bbox
Port 2221
Host *
User linecook
Hostname localhost
DOC
scp -F config/ssh script.sh bbox:/tmp/script.sh

ssh -F config/ssh bbox -- /tmp/script.sh
# linecook@bbox-ubuntu: hello world!

Redundancy
Host abox
Port 2220
Host bbox
Port 2221
Host *
User linecook
Hostname localhost
DOC


Redundancy
Host abox
Port 2220
Host bbox
Port 2221
Host *
User linecook
Hostname localhost
DOC


Make a “Package”
Run with Linecook
[config/ssh] [packages/abox/script.sh]
Host abox echo "# $(whoami)@$(hostname): hello
Port 2220 world!"
[packages/bbox/script.sh]
Host bbox
echo "# $(whoami)@$(hostname): Hullo
Port 2221
Wurld!"
Host *
User linecook
Hostname localhost
linecook run --script script.sh --remote-dir /tmp abox bbox

# linecook@bbox-ubuntu: Hullo Wurld!

Leverge Defaults
[config/ssh] [packages/abox/run]
Host abox echo "# $(whoami)@$(hostname): hello
Port 2220 world!"
[packages/bbox/run]
Host bbox
echo "# $(whoami)@$(hostname): Hullo
Port 2221
Wurld!"
Host *
User linecook script: run
Hostname localhost remote dir: ~/linecook
hosts: *
linecook run
# linecook@bbox-ubuntu: Hullo Wurld!

Easy Way To Test!
[packages/abox/run]
echo "hello world" > /tmp/message.txt
[packages/abox/test]
if [ $(cat /tmp/message.txt) == "hello world" ]
then echo "# success"
else echo "# fail"
fi
linecook run --script test

# fail
linecook run
# success

Cmdline Dev Cycle
linecook start
linecook run
linecook ssh abox
linecook snapshot modified
linecook stop
linecook start --snapshot modified

...

Advantages
Standard use of SSH
One standard config file
Ordinary inputs (directories, scripts)
Multiple VMs
Flexible!

How to Make a Script

How to Make a Script
(boring alert)

Start with a Script
[packages/abox/run]
echo "# I will not manually configure my server"
linecook run
# I will not manually configure my server

Convert to Recipe
[packages/abox.yml]
linecook:
package:
recipes:
A package file
run: abox
[recipes/abox.rb]
target <<"SCRIPT"
SCRIPT

Convert to Recipe
[packages/abox.yml]
linecook:
package: A tempfile
recipes: (packages/abox/run)
run: abox
[recipes/abox.rb]
target <<"SCRIPT"
SCRIPT

Simplify
[packages/abox.yml] If default, no
{}
manifest needed
[recipes/abox.rb]
target <<"SCRIPT"
SCRIPT

Build and Run
[packages/abox.yml]
{}
[recipes/abox.rb]
target <<"SCRIPT"
SCRIPT
linecook build
linecook run

Ok... that was boring.
Seems pointless, but here is where it gets cool.

Use Recipe as
Context for ERB

ERB Compiles to Ruby
require 'erb'
compiler = ERB::Compiler.new("<>")
compiler.put_cmd = "target<<"
compiler.insert_cmd = "target<<"
compiler.compile "got <%= obj %>"
# => "target<<\"got \"; target<<(( obj ).to_s)"

InstanceEval for Context
class Recipe
attr_accessor :target
def initialize
@target = ""
end
def obj
"milk"
end
end
code = "target<<\"got \"; target<<(( obj ).to_s)"
recipe = Recipe.new
recipe.instance_eval(code)
recipe.target
# => "got milk"

Make a Module
module Helper
def get(obj)
target<<"got "; target<<(( obj ).to_s)
end
end
recipe = Recipe.new
recipe.extend Helper
recipe.instance_eval %q{
get "milk"
target << ", "
get "cookies"
}
recipe.target
# => "got milk, got cookies"

Make a Module
module Helper
def get(obj)
target<<"got "; target<<(( obj ).to_s)
end
end
recipe = Recipe.new
recipe.extend Helper
recipe.instance_eval %q{
get "milk"
target << ", "
get "cookies"
This is a recipe!
}
recipe.target
# => "got milk, got cookies"

Helpers
[helpers/example/echo.erb]
Write an echo statement
(str)
--
echo "<%= str %>"
[recipes/abox.rb]
helpers "example"

Helpers
[helpers/example/echo.erb] [lib/example.rb]
Write an echo statement module Example
(str) # Write an echo ...
-- def echo(str)
echo "<%= str %>" target<< "echo ";...
end
end
[recipes/abox.rb]
helpers "example"

Helpers
-- def echo(str)
end
end
[recipes/abox.rb]
helpers "example"

Helpers
-- def echo(str)
end
end
[recipes/abox.rb]
helpers "example"

Helpers
-- def echo(str)
end
end
[recipes/abox.rb]
helpers "example"

Helpers
-- def echo(str)
end
end
[recipes/abox.rb]
helpers "example"

Helpers
-- def echo(str)
end
end
[recipes/abox.rb]
helpers "example"

Helpers
(str)
-- require "example"
echo "<%= str %>" extend Example
[recipes/abox.rb]
helpers "example"

Helpers
(str)
--
echo "<%= str %>"
[recipes/abox.rb]
helpers "example"
linecook build
linecook run

Capture (no write)
[helpers/example/color.erb]
Add color to a string
(color, str)
codes = Hash[*%W{red 0;31 white 1;37 blue 0;34}]
--
\033[<%= codes[color.to_s] %>m<%= str %>\033[0m
[recipes/abox.rb]
helpers "example"
msg = "# I will not manually configure my server"
echo _color("blue", msg)

Capture (no write)
(color, str)
--
[recipes/abox.rb]
helpers "example"
Prefix with underscore

String output used as input

Capture (no write)
(color, str)
--
[recipes/abox.rb]
helpers "example"
linecook build
linecook run

Recipes are Ruby
[recipes/abox.rb]
helpers "example"

3.times do
end
linecook build
linecook run

Advantages
Easily extensible DSL
Produces ordinary modules
Test as any other Ruby
Distribute as Gems (versions, bundler)
Reprocessing of output
Also, kind of cool...

Linebook
(Standard Library for Linecook)

Logic + Pipelines
[recipes/demo.rb]
helpers 'linebook/shell'
unless_ _file?('/tmp/message') do
cat.to('/tmp/message').heredoc do
writeln 'hello world!'
end
end
cat('/tmp/message')

Logic + Pipelines
[packages/demo/run]
if ! [ -f "/tmp/message" ]
then
cat > /tmp/message << HEREDOC_0
hello world!
HEREDOC_0
fi
cat "/tmp/message"

Under Construction
Exit status checks, ‘stack trace’
Helpers for login/su
User and File Management
Server-side testing (assert_script)
Installs, config, deployments, etc.

No need to wait!

Linecook
Attributes
Helpers
Recipes Packages
Files
Templates
Server

Learn More
GitHub:
pinnacol/linecook.git
pinnacol/linebook.git
Me:
github.com/thinkerbot
@thinkerbot

Thanks Pinnacol!

Thanks Derailed!

Questions?

Linecook - A Chef Alternative

Uploaded by

Copyright:

Available Formats

You might also like

Linecook - A Chef Alternative

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Linecook - A Chef Alternative

Uploaded by

Copyright:

Available Formats

Tuesday, April 26, 2011

Tuesday, April 26, 2011

Tuesday, April 26, 2011

Tuesday, April 26, 2011

Tuesday, April 26, 2011

Open Source Chef

Tuesday, April 26, 2011

Open Source Chef

Tuesday, April 26, 2011

Open Source Chef

Tuesday, April 26, 2011

Tuesday, April 26, 2011

Tuesday, April 26, 2011

Tuesday, April 26, 2011

Tuesday, April 26, 2011

Tuesday, April 26, 2011

def install_package(name, version)

Tuesday, April 26, 2011

def install_package(name, version)

Tuesday, April 26, 2011

def install_package(name, version)

Error for version=""

Tuesday, April 26, 2011

Tuesday, April 26, 2011

Tuesday, April 26, 2011

Tuesday, April 26, 2011

Tuesday, April 26, 2011

Tuesday, April 26, 2011

Tuesday, April 26, 2011

Tuesday, April 26, 2011

Tuesday, April 26, 2011

Run script on server

Tuesday, April 26, 2011

Run script on server

Tuesday, April 26, 2011

Run script on server 2

Tuesday, April 26, 2011

Tuesday, April 26, 2011

Tuesday, April 26, 2011

SSH Key Exchange localhost

Tuesday, April 26, 2011

SSH Key Exchange localhost

Tuesday, April 26, 2011

SSH Key Exchange localhost

Tuesday, April 26, 2011

SSH Key Exchange localhost

Tuesday, April 26, 2011

ssh -p 2220 linecook@localhost

Tuesday, April 26, 2011

Tuesday, April 26, 2011

No special prerequisites on servers

Fast Access (fast enough for TDD)

Tuesday, April 26, 2011

scp -P 2220 script.sh linecook@localhost:/tmp/script.sh

Tuesday, April 26, 2011

scp -P 2220 script.sh linecook@localhost:/tmp/script.sh

Tuesday, April 26, 2011

scp -F config/ssh script.sh abox:/tmp/script.sh