Setting up Build Server to run NUnit Selenium Automated tests

Question

I've been assigned a task of setting up a build server (jenkins) and running automated tests after the build agent completes the build.

We are using NUnit and selenium to run automated tests.

The main concern is wait time. Suppose several users check in their sources, a build is run and automated tests are run afterwards (there could be several hundred of these). What's the best way to set this up so that each user does NOT have to wait in queue for tests results. Also, I'm to consider things like test result reports etc.

Where do I start? What do I even google?

I'm very new at this stuff and any info on doing this would be greatly appreciated. thanks

Answer 1

The first thing you'll want to do is to separate your unit tests from your integration tests.

Unit tests should be fast. Integration tests will obviously be slower since you're interacting with external components.

As far as configuring your environment, to do what you're trying to do properly, you'll need to research using Jenkins in a Master/multiple-Slave configuration. This isn't terribly complex, but can take some time to set up.

What you'll likely end up doing is setting up a number of Jobs within Selenium to handle each part of your build process. ie, one job to do the compilation, at least one job to run the unit tests, and at least one job to run the integration tests (and then maybe packaging or deployment jobs depending on how far you want to take this..).

Depending on how slow your overall build process is, you could easily have one job for each component's integration tests and run these concurrently on different slave machines. A parent job could would then aggregate the results and determine whether or not the chick-in passed.

For reporting, you'll want to install the HTML Publisher Plugin , and the NUnit Plugin . These plugins will allow you to bundle the reports produced with the rest of the build artifacts.

In order to give feedback to your team, you'll also want to look at the Wall Display Plugin to display the status of the jobs.