Build Automation Report From IT Central Station 2015-07-04E5

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 34

Build Automation

A PEEK INTO WHAT REAL USERS THINK

2015

IT Central Station helps tech professionals by providing...

A comprehensive list of A sample of real user Specific information to help


enterprise level Build reviews from tech you choose the best vendor
Automation vendors. professionals. for your needs.

Disclaimer

IT Central Station Ltd. does not endorse or recommend any products or services. The views and opinions of reviewers
quoted in this document, IT Central Station websites, and IT Central Station materials (i.e. Content) do not reflect the
opinions of IT Central Station. We make no guarantees about the accuracy, currency, suitability, or quality of the content, and
we assume no responsibility for unintended, objectionable, inaccurate, misleading, or unlawful content made available by
Content authors or other third parties.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
ABOUT IT CENTRAL STATION

User reviews, candid discussions, and more for enterprise technology


professionals.
The Internet has completely changed the way we make
buying decisions. We now use ratings and review sites
to see what other real users think before we buy Use IT Central Station to:
electronics, book a hotel, visit a doctor or choose a
restaurant. But in the world of enterprise technology, • Read and post reviews of vendors
most of the information online and in your inbox comes and products
from vendors but what you really want is objective • Request or share information about
information from other users. functionality, quality, and pricing
• Contact real users with relevant
We created IT Central Station to provide product experience
technology professionals like you with a • Get immediate answers to questions
community platform to share information about • Validate vendor claims
enterprise software, applications, hardware and • Exchange tips for getting the best
services. deals with vendors

We commit to offering user-contributed information that


is valuable, objective and relevant. We protect your
privacy by providing an environment where you can
post anonymously and freely express your views. As a
result, the community becomes a valuable resource,
ensuring you get access to the right information and
connect to the right people, whenever you need it.

244 5th Avenue, Suite R-230


New York, NY 10001

www.ITCentralStation.com
reports@ITCentralStation.com
+1 (646) 328-1944

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
ABOUT THIS REPORT

This report is comprised of a comprehensive list of enterprise level Build Automation vendors. We have
also included several real user reviews posted on ITCentralStation.com. The reviewers of these
products have been validated as real users based on their LinkedIn profiles to ensure that they provide
reliable opinions and not those of product vendors.

IMPORTANT NOTICE

Did you find this whitepaper helpful? At IT Central Station, our philosophy is “Give to Get”. Our active
community and unbiased reviews are made possible by your participation and as such, we ask that you
share your expertise with us as well. Please email reviews@itcentralstation.com and one of our
community managers will be in touch with you shortly. You can choose to review anonymously or not
and your company name will not be included in the review.

If you found this report and/or the reviews on IT Central Station useful, we would greatly appreciate your
participation in giving back to our community.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
VENDOR (BY RANKING) SOLUTION

Rating: 8.8
Jenkins Jenkins (14 reviews)
Rating: 8.38
JetBrains TeamCity (9 reviews)
Rating: 5.76
Atlassian Bamboo (7 reviews)
Rating: 8.0
CloudBees CloudBees (7 reviews)
Rating: 7.34
GNU GNU Make (3 reviews)
Rating: 7.5
Thoughtworks Thoughtworks Go (2 reviews)
Rating: 8.0
ZeroTurnaround JRebel (1 review)

Travis CI Travis CI (1 review)

Circle CI Circle CI

Codeship Codeship

Oracle Hudson CI (2 reviews)

OpenMake Software OpenMake

IBM Rational Build Forge

XebiaLabs XL Release

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
Top Build Automation Vendors

Over 87,463 professionals have used IT Central Station research on enterprise tech. Here are the top
Build Automation vendors based on product reviews, ratings, and comparisons. All reviews and ratings
are from real users, validated by our triple authentication process.

3087 3716 8 Re 262 F A


1. Jenkins View Com vi ollow verage R
s paris ews ers ating
ons : 8.8

3433 1343 8 Re 236 F A


2. TeamCity View Com vi ollow verage R
s paris ews ers ating
ons : 8.4

4352 2139 5 Re 239 F A


3. Bamboo View Com vi ollow verage R
s paris ews ers ating
ons : 5.8

442 V 903 C 3 243 F A


4. GNU Make iews ompa Reviews ollow verage R
rison e rs ating
s : 7.4

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
Chart Key
Views: Number of total page views

Comparisons: Number of times compared to another product

Reviews: Total number of reviews on IT Central Station

Followers: Number of followers on IT Central Station

Average Rating: Average rating based on reviews


The total ranking of a product (i.e. bar length) is based on a weighted aggregate ranking of that product's Views (weighting
factor = 17.5%), Comparisons (17.5%), Reviews (17.5%), Followers (17.5%), and Average Rating (30%).

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
TOP 5 TOP 5
Based on Views Based on Views of Comparisons

6376 CloudBees 3716 Jenkins

4352 Bamboo 2681 CloudBees

3433 TeamCity 2580 Thoughtworks Go

3087 Jenkins 2139 Bamboo

1219 Thoughtworks Go 1767 Rational Build Forge

TOP 5 TOP 5
Based on Followers Based on Rating

662 Thoughtworks Go 8.8 Jenkins

363 CloudBees 8.4 TeamCity

262 Jenkins 8.0 JRebel

253 Rational Build Forge 8.0 CloudBees

243 Hudson CI 7.6 Thoughtworks Go

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
Jenkins
Vendor: Jenkins

Overview: Jenkins is an award-winning application that monitors executions of repeated jobs, such as building a
software project or jobs run by cron.

Sample Airial, Clarus Financial Technology, cubetutor, Metawidget, mysocio, namma, silverpeas, Sokkva, So
Customers: Rave, tagzbox

Top Rational Build Forge vs. Jenkins Compared 34% of the time.
Comparisons:*
Bamboo vs. Jenkins Compared 18% of the time.
TeamCity vs. Jenkins Compared 9% of the time.

Top Industries:* Comms Service Provider 20%


Financial Services Firm 16%
Media Company 13%
Insurance Company 11%

Company Size:* 1-100 Employees 32%


101-1000 Employees 19%
1000+ Employees 49%

* Data is based on the aggregate profiles of IT Central Station Users researching this solution.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
JENKINS REVIEW BY A REAL USER
Maksym Grebenets Verified by IT Central Station WHAT REAL USERS
Senior iOS Developer at a media company with 1000+ ARE SAYING...
employees
"This is a very good,
powerful and flexible
Valuable Features: product, but requires a lot
of time investment to get
The Jenkins Job DSL plug-in is the most valuable. the maximum out of it."

Improvements to My Organization: "Robust community


support plugins."
We have been able to create CI jobs for each branch of our repository. Being able
to test builds for each branch before it is merged to mainstream branch helped to " It's simple and intuitive
improve stability of the app and have faster develop-test iterations. but the plugins need to be
streamlined"
Room for Improvement:
"Provisioning VMs was an
The installation process could be simplified, especially on Mac OS X. issue during deployment
but automation in general
Use of Solution: has been improved."

I've used it for eight months. "Open source community


with many plugins although
Deployment Issues: stability for all but the most
popular plugins needs to
be improved."
Yes because the installation process is not obvious.

Stability Issues:

The default settings do not work properly on Mac OS X. You have to tweak JVM
parameters and allocate more heap memory as well as change other parameters to
have a stable Jenkins server.

Scalability Issues:

I haven't had to scale up yet. We have one build box which is running two agents on
it.

Customer Service:

As this is open source, there is no such thing as customer service, but there is a big
community to look for information and get answers.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
Technical Support:

As this is open source, there is no such thing as tech support, but there is a big
community to look for information and get answers.

Previous Solutions:

Personally, I previously used Bamboo. I switched because I changed jobs and at


my new place Jenkins had been used. It would unjustified to do a move from
Jenkins to Bamboo, given that Jenkins is capable of performing same tasks.

Initial Setup:

It was complex and additional knowledge about launch agents and daemons is
required. There are at least three, if not four, different ways to install and configure
Jenkins, which is not always good.

Implementation Team:

We implemented it in-house.

ROI:

It's high because the product is free.

Pricing:

The original setup. for us, was the cost of a new Mac Mini box which costs, from
$1,000 to $2,000 depending on the configuration.

Other Advice:

This is a very good, powerful and flexible product, but requires a lot of time
investment to get the maximum out of it.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
JENKINS REVIEW BY A REAL USER
James Jenkins (Jay) Verified by IT Central Station
Release Manager at a financial services firm with 1000+
employees

Valuable Features:

The feature of this product that is most valuable to me is the robust community
support plugins.

Improvements to My Organization:

Jenkins has greatly improved the time it takes to deliver a software package to the
market.

Room for Improvement:

I can't think of any at the moment.

Use of Solution:

I have used Jenkins and Hudson for about four years.

Deployment Issues:

No issues encountered.

Stability Issues:

No issues encountered.

Scalability Issues:

No issues encountered.

Technical Support:

The community of people who use this open source tool are very helpful.

Previous Solutions:

No previous solution used.

Initial Setup:

Jenkins is very straightforward to install. Basically, it's a Java app that runs on an
app server.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
Implementation Team:

We implemented Jenkins in-house.

ROI:

100% since it is open source.

Pricing:

No setup/;day to day costs.

Alternate Solutions:

Yes, we also looked at Hudson and Cruise Control.

Other Advice:

Invest in time reading the support forums and newsgroups. Collaborate with other
professionals.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
TeamCity
Vendor: JetBrains

Overview: TeamCity is a Continuous Integration and Deployment server that provides out-of-the-box continuous unit
testing, code quality analysis, and early reporting on build problems. A simple installation process lets you
deploy TeamCity and start improving your release management practices in a matter of minutes. TeamCity
supports Java, .NET and Ruby development and integrates perfectly with major IDEs, version control
systems, and issue tracking systems.

Sample Toyota, Xerox, Apple, MIT, Volkswagen, HP, Twitter, Expedia


Customers:
Top Jenkins vs. TeamCity Compared 25% of the time.
Comparisons:*
Bamboo vs. TeamCity Compared 22% of the time.
CloudBees vs. TeamCity Compared 12% of the time.

Top Industries:* Comms Service Provider 20%


Media Company 17%
Financial Services Firm 13%
Manufacturing Company 11%

Company Size:* 1-100 Employees 32%


101-1000 Employees 40%
1000+ Employees 28%

* Data is based on the aggregate profiles of IT Central Station Users researching this solution.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
TEAMCITY REVIEW BY A REAL USER
DevOpsEng776 Verified by IT Central Station WHAT REAL USERS
DevOps Engineer at a media company with 1-100 ARE SAYING...
employees
"The templates allow a
consistent configuration on
Valuable Features: how an application is built."
Ease of configuring complete build chains with the use of build templates
"Useful to see how the
build is progressing and
Creating a single custom build runner that allows us to have a single entry point and how many tests are left to
filter steps by arguments for all our builds
pass."
The ability to trigger subsequent builds in a chain based off of multiple types of
triggers in a deterministic fashion "Allowed us to create a
visual flow of the
processes and steps
Improvements to My Organization: involved in moving a build
through its phases."
Creating a meta-runner to use as a single build entry point. The templates allow a
consistent configuration on how an application is built, and by combining the use of
the meta-runner and build templates, the whole organisation understands, and "The support for cross-
follows, this convention. By following this convention, a complete build stack is platform builds is very
completed in a single REST call. valuable, as is the flexibility
in creating build steps."
Room for Improvement:
"Very useful for setting up
build agents in a Unix
Client side load as projects/builds with a lot of test history, and branches can take
quite a bit of time to load platform."

It would also be nice to have a conditional build step: "I use it to increase
visibility and clarity of build
https://youtrack.jetbrains.com/issue/TW-17939 and deployment activities.
"
Having project templates

Use of Solution:

I used it for three years.

Deployment Issues:

You shouldn't use TeamCity as a deployment tool.

Stability Issues:

As versions progress, TeamCity has greatly improved it's stability with it's
resourcing. Also following JetBrains' documentation about how to set up TeamCity,
distributes load in a more even fashion.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
Scalability Issues:

There have been times when making copies of a project has caused major stability
issues, especially when you have nested project structure based off of different
build configuration templates.

Customer Service:

I've never needed to deal with customer service.

Technical Support:

YouTrack has been a great forum to raise/track issues.

Previous Solutions:

We previously used CC.Net. TeamCity provided a much easier method of


configuration as well as templating over CC.Net.

Initial Setup:

If you want just a basic setup, it is extremely straightforward. If you require


optimizations such as I/O distribution, you will need to do a little bit more work.

Implementation Team:

We implemented it in-house.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
TEAMCITY REVIEW BY A REAL USER
Ricky Shome Verified by IT Central Station
Director at Testing QA Solutions Ltd (TQS)

Valuable Features:

It's a very useful, intuitive tool to continuously deploy new builds

A clean user interface

It's very easy to use, even for non-build engineers

Ability to run automated tests as part of the build process

Easy to pinpoint issues with the detailed logs

Easy navigation

Useful to see how the build is progressing and how many tests are left to pass
before the build is green

Improvements to My Organization:

Improved the quality of builds by running unit tests as part of every build

Reduced the risks of regression defects by running automated tests as part of the
build process

Room for Improvement:

The UI could be more structured, as it is so customisable it is quite easy to get lost


around the screens.

Use of Solution:

I have used this product for over six months now.

Deployment Issues:

Only environment issues which caused failed deployments. Also, if people were
connected to the database on the backend, the build would fail.

Stability Issues:

It seemed a very stable tool with hardly any downtime in the six months I was using
it.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
Scalability Issues:

Not at all. In fact it was so stable we were able to add and create our own virtual
environments each time we needed to deploy. This meant that each user had their
own virtual environment, meaning nothing ever got overwritten.

Technical Support:

I had no need for it as we had DevOps engineers who fixed any issues.

Previous Solutions:

I used to use Jenkins in a previous job. I started using TeamCity when I changed
jobs as that was the tool that was being used, but I preferred TeamCity to Jenkins.

Initial Setup:

It's fairly straightforward.

Implementation Team:

It was implemented by an in-house team.

ROI:

We used to deploy multiple times a day too many different environments. Also, we
had offices in Australia who were using it when we were asleep! Effectively we
were using this tool 24 hours a day, seven days a week.

Other Advice:

Do it! Very easy to use and very stable. A must have tool for any teams using agile
methodologies.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
Bamboo
Vendor: Atlassian

Top Jenkins vs. Bamboo Compared 31% of the time.


Comparisons:*
CloudBees vs. Bamboo Compared 14% of the time.
TeamCity vs. Bamboo Compared 14% of the time.

Top Industries:* Financial Services Firm 14%


Comms Service Provider 13%
Media Company 11%
Manufacturing Company 10%

Company Size:* 1-100 Employees 45%


101-1000 Employees 14%
1000+ Employees 40%

* Data is based on the aggregate profiles of IT Central Station Users researching this solution.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
BAMBOO REVIEW BY A REAL USER
Siva Mandadi Verified by IT Central Station WHAT REAL USERS
Build and Release Engineer at a comms service provider ARE SAYING...
with 1-100 employees
"APIs were helpful for
creating customizations
Valuable Features: but there are limited
options with SSH plugins "
Integration with Atlassian products like Jira,Crowd, and Stash
"PRO: flexibility when
Easy to setup setting up our builds. CON:
lacks support for branched
Price builds using multiple
source repositories"
Improvements to My Organization:
"Bamboo easily integrates
With Bamboo's integration with Jira, we were able to update build status and test into an Atlassian stack."
reports to Jira bugs/tasks.
"The new Salesforce
In Stash, we were able to improve the pull request review standards by being able plugin looked interesting
to review the build and test reports. despite the fact you had
limited control on how the
Integration with Artifactory, helped us in auto updated libs and artifacts. SF package is deployed."

APIs were helpful for creating customizations.

Room for Improvement:

Ease of use.

It needs "re-build/Trigger build" switch from Stash Pullrequest.

More 3rd party plugins to support IDEs.

Integration of older plugins with newer version of Bamboo.

More options for deployment plans

Configuring tools to agents (Had to do it manually). It would be nice have sharing


from server.

-Docker support

Limited options with SSH plugins, can't use options to it

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
Use of Solution:

Two to three years.

Deployment Issues:

No issues with deployment.

Stability Issues:

Yes, Regular server/agent being down.

Scalability Issues:

Yes, It needs to allow multiple plans to run on a agent(at same time). Dedicating
one whole agent isn't fair, I know we have to buy more agents, but in-terms buying
and maintaining more infrastructure isn't scalable either. .

Customer Service:

Never used it. Had a decent responses from open forum.

Technical Support:

Never used it.

Previous Solutions:

Yes. since we wanted to keep Atlassian suite all-around.

Initial Setup:

Easy. Just like other Atlassian products.

ROI:

We got the product for a cheap price, so its alright.

Pricing:

We initially got 5 agents for around $2000 excluding infrastructure setup. Now we
are using docker containers to maximize the mileage on them.

Other Advice:

If you are looking for good integration with Atlassian products and then this is the
tool.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
BAMBOO REVIEW BY A REAL USER
Jan Swaelens Verified by IT Central Station
Solution Management at a software R&D company with 1-
100 employees

Valuable Features:

We are very fond of the flexibility it offers in terms of setting up our builds. We have
a wide variety of components we need to build which often require custom actions
or manipulations using in house technology. Bamboo allows us to set this up quite
easily by the flexible configuration features it includes.

Secondly we really like the integration of the build aspect and deploy aspect. One
of the recent major releases included this feature to link build and deploy projects
together allowing a deployment pipe-line to be setup completely in Bamboo. This
makes the status of deployments very visible and also allows for easy follow up and
even rollback in case a deployment causes too much havoc.

Improvements to My Organization:

Thanks to Bamboo we are able to build changes made by development quite


quickly and allow them to deploy to our internal environments when needed (as well
as automated during the night). This significantly reduces the effort required to get
something into test.

The fact that all builds use a unified setup and infrastructure makes it much easier
to control and adapt the ever increasing number of builds.

Room for Improvement:

We are lacking proper support for branched builds using multiple source
repositories. The current approach is quite clunky (or non-existent) but it seems
there is something in the pipe line for the end of the year according to a recent post
on the Bamboo Jira.

Use of Solution:

We have been using Bamboo for about 6 years now

Deployment Issues:

Not at all, over all those years we only had a handful of issues and that's probably
because we always take each new update directly.

Stability Issues:

No, we never encountered any serious regression. For the few cases we
encountered bugs they were fixed in a reasonable time interval.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
Scalability Issues:

Scaling out a build system is not always easy, but thanks to the remote agent
technology we are able to scale out and add nodes in a transparent way.

Customer Service:

We use a 3d party for our license management, which makes it hard to judge this
but we never had direct interactions with Atlassian Customer support.

Technical Support:

Pretty good once you get trough the initial levels of the support team, it can take a
while before you are able to prove that there's a genuine issue.

Previous Solutions:

We came from Jenkins back in the day, I recall our most important reasons to
switch where the enterprise readiness of Bamboo and its integration in the
Atlassian stack (Jira and others).

Initial Setup:

Bamboo is very easy to deploy, all it takes is extracting the distribution and a JRE
to run it. This also goes for the remote agents which install by running a JAR which
already contains the configuration for communicating with its master.

Implementation Team:

We implemented in house.

ROI:

That would be 100%, the time saved in development is enormous.

Pricing:

We started out using only a number of agents and moved to a bigger setup using
many remote agents over the years. The cost depends on the agents used and
amount of boxes deployed to run them on.

Alternate Solutions:

Only Jenkins, see previous answer.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
Other Advice:

Plan before you start, Bamboo is 'only' that which automates. One should have a
decent design of how the build needs to work internally and have that (scripts,
servers, descriptors ...) in order before attempting to automate on a large scale.

Secondly, don't be afraid to change things to you application or pipeline to help the
automation to be more efficient - for example we replaced massive chunks of hard
SQL from the build scripts by a webservice to avoid dependencies to JDBC in our
builds.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
CloudBees
Vendor: CloudBees

Sample Acxiom, ARTstor, Choose Digital, Dominion Marine Media, Egraphs, Inc., Global Bank, jclouds, Movellas
Customers:
Top Heroku vs. CloudBees Compared 17% of the time.
Comparisons:*
Amazon AWS vs. CloudBees Compared 14% of the time.
Bamboo vs. CloudBees Compared 11% of the time.

* Data is based on the aggregate profiles of IT Central Station Users researching this solution.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
CLOUDBEES REVIEW BY A REAL USER
Shashikant86 Verified by IT Central Station WHAT REAL USERS
Senior Developer in Test at a media company with 1000+ ARE SAYING...
employees
"Support for PHP and
Ruby is needed but its
Valuable Features: simple interface is a
valuable feature"
Jenkins Plugins

Simple interface

Improvements to My Organization:

Yes. We were using Buildbot and started using Jenkins. It helped the team to get
visibility of the tests running and breaking builds. Jenkins has wall display setup so
that everybody can see build status including non-technical people. Using Jenkins
well doesn't make any difference unless it is used smartly.

Room for Improvement:

Support for PHP and Ruby

Use of Solution:

Four years.

Deployment Issues:

No issues with deployment.

Stability Issues:

Sometimes it randomly throws 'Error 500' while saving the settings of a job.

Scalability Issues:

No issues encountered.

Customer Service:

Great community support on Google Group as well as conferences.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
Previous Solutions:

We were using Buildbot and Switched to Jenkins for its nice interface and visibility.

Initial Setup:

Initial setup of the Jenkins was not as easy as if you are setting master/slave
architecture. You need make sure that the master and all slaves are running OK as
well as to utilise slaves effectively.

ROI:

It's free and open-source so it's worth trying and you won't regret using it.

Alternate Solutions:

We looked at

Buildbot

Teamcity

Go

Bamboo

Other Advice:

It's one of the best open-source continuous integration/continuous deployment


solutions. You should try it without fear and you won't regret it. It works well with
any team size.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
Thoughtworks Go
Vendor: Thoughtworks

Sample Lufax.com, Zopa, Manheim, Bresic Whitney, Kaplen, comparethemarket.com, Loof, iproperty.com,
Customers: Rosetta Stone

Top UrbanCode Deploy vs. Thoughtworks Go Compared 11% of the time.


Comparisons:*
JIRA vs. Thoughtworks Go Compared 10% of the time.
XL Deploy vs. Thoughtworks Go Compared 7% of the time.

* Data is based on the aggregate profiles of IT Central Station Users researching this solution.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
THOUGHTWORKS GO REVIEW BY A REAL USER
Emmanuel Kong Verified by IT Central Station WHAT REAL USERS
Senior Developer at a software R&D company with 1-100 ARE SAYING...
employees
"We have a completely
automated product
Valuable Features: delivery process but it
needs better statistic and
The Pipeline concept, Fan-in Fan-out, and Compare build are the most valuable to report options."
me.
"Valuable: hackability,
Improvements to My Organization: visual representation of
build pipelines. Room for
We used to run our complex build process on TFS build and release manager, but improvement: user
its complicated license issue restricted us to roll it out to every team, and we always management,
found a limited configuration for it to work as expected. After we switched to GO, documentation"
each team can set-up their own delivery pipeline and run it themselves. Now, we
have a completely automated product delivery process.

Room for Improvement:

GO statistic and report options.

Use of Solution:

6 months.

Deployment Issues:

No major issues.

Stability Issues:

So far so good.

Scalability Issues:

No, we don't have any problem scaling our GO implementation from


either infrastructure or team points of view.

Customer Service:

Haven't had a need to call them.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
Technical Support:

Good documentation but not much community support compare to other CI/ CD
tools

Previous Solutions:

I used TFS build, Jenkins and TeamCity previously. We switched to GO because


the pipeline concept promoted by GO is a good match with our process.

Initial Setup:

It's pretty easy, I got it done without any problems.

Implementation Team:

In-house, and all our developers take part in keeping their GO server running.

ROI:

GO is open source, our initial cost is zero but it comes with a bit of learning curve
so if your delivery process isn't that complex, I think other tools might give you
better ROI.

Pricing:

Zero initial cost, and we host them on Azure, 8-9 VMs, at approximately $14 per
day.

Alternate Solutions:

Go was our winner when evaluated, along with Jenkins, TFS build, Atlassian
Bamboo and Team City.

Other Advice:

GO doesn't come with a lot of out of the box features like other tools, don't expect
that you can get it to work by clicking the NEXT button.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
THOUGHTWORKS GO REVIEW BY A REAL USER
Peter Faric Verified by IT Central Station
DevOps Engineer at a healthcare company with 1-100
employees

Valuable Features:

Hackability, visual representation of build pipelines, open source

Apache License 2.0

Improvements to My Organization:

Before implementing Go we used librarian-puppet to deploy code to

different Puppet master servers. With Go we were able to automate

that process, implement extra code checking functionality and get a

nice visual view of our environments state.

Room for Improvement:

User management, Documentation, Advanced GUI functionality.

Use of Solution:

6 months

Deployment Issues:

Nothing which was Go's fault.

Stability Issues:

No stability issues.

Scalability Issues:

We have just one Go server and haven't looked into scalability

yet.

Customer Service:

We used the online community only and hence cannot comment on

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
this.

Technical Support:

We used the online community only and hence cannot comment on

this.

Previous Solutions:

We used librarian-puppet. We switched because of greater automation,


transparency and manageability of deploying our Puppet code through our
environments.

Initial Setup:

It was straightforward because there are online resources on how

to do it.

Implementation Team:

In-house team.

ROI:

The product is free to use. In terms of value added it has more than achieved
everything we wanted from it and more.

Pricing:

Setup cost was 1 week's time of one of our team member.

Alternate Solutions:

Jenkins.

Other Advice:

Try out alternatives and pick the one which fits you the best.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
JRebel
Vendor: ZeroTurnaround

Top Jenkins vs. JRebel Compared 26% of the time.


Comparisons:*
CloudBees vs. JRebel Compared 16% of the time.
Bamboo vs. JRebel Compared 15% of the time.

* Data is based on the aggregate profiles of IT Central Station Users researching this solution.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
JREBEL REVIEW BY A REAL USER
Leonardo Silva Verified by IT Central Station WHAT REAL USERS
Developer at a tech services company with 1-100 ARE SAYING...
employees
"Easy to configure, works
well, has 'free' options (like
Valuable Features: Social)"
Easy to configure, works well, has 'free' options (like Social)

Improvements to My Organization:

It gets the used time for redeploy in a development environment really fast and of
course that's a good point.

Room for Improvement:

Development environment

I had a little problem in redeploying applications using a specific framework (reactor


+ spring) in a Maven multi-module project.

Use of Solution:

3 years

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation
Join the IT Central Station Community

This report features just a few of the Build Automation reviews on IT Central Station. If you would like to
read more about what real users are saying about the many Build Automation solutions on the market,
visit the Build Automation page at IT Central Station:

http://www.itcentralstation.com/category/build-automation

There are a number of ways you can participate in the IT Central Station community. Write a review,
read a comment, or just follow a product. Either way, we’ll be sure to let you know when people are
talking about the solutions you care about!

Give to Get

Did you find this whitepaper helpful? At IT Central Station, our philosophy is “Give to Get”. Our active
community and unbiased reviews are made possible by your participation and as such, we ask that you
share your expertise with us as well. Please expect to be contacted shortly by an IT Central Station
Community Manager. We will ask you for 10 minutes of your time to review a product that you use either
via a 10 minute phone interview or questionnaire. You can choose to review anonymously or not and
your company name will not be included in the review.

If you found this report and/or the reviews on IT Central Station useful, we would greatly appreciate your
participation in giving back to our community.

© 2015 IT Central Station Reproduction Prohibited


To read more reviews about Build Automation, please visit:
http://www.itcentralstation.com/category/build-automation

You might also like