Tools/techniques to Load/Soak test a deployed Java EE application?

Question

I'm quite new to performance testing and am looking to be pointed in the right direction.

I have a Java project which contains two parts, deployed seperately:

• A service-broker, published as a webservice; which has service and db wrappers.
• A front end, which has a service-broker facade, business logic and a Spring MVC UI.

It is deployed on tomcat, which is running on a fresh install of Windows server 2008.

I need to do basic soak testing on this project, to highlight major memory leaks performance issues.

I've been told SOAP UI is the tool I need to do this.

Now for my questions:

• Soap UI (Load UI) is only appropriate as the load-generator for testing the service-broker aspect of the project, right?
• What additional tools would be helpful (Something to visualize garbage collection, memory use, heap/stack size etc?)
• Can I use Load UI as a load generator for a Spring MVC Front end? If not, what's an appropriate alternative?

Thanks a lot.

Answer 1

Here is my opinions

1. SoapUI is good enough for microbenchmark test but not good at huge scale of testing. So i recommend to use other load testing tool. LoadUI can be a solution. But i want to recommend nGrinder. I used it, it works very well. Apache Jmeter is common tool. But it is JVM based so Jmeter itself needs a tuning.

2. To monitoring application during perfomance testing. easiest way is use VisualVM. It can monitor all that u mentioned. But it can show ua data in just Java Virtual machine perspective. I rather to recommend to use APM (Application Performance Monitoring). AppDynamic will be good solution.

3. About UX testing, big difference is, it needs record and play feature. U can do it by using Load UI. but nGrinder can also cover that by implementing HTTP resquest in coding. (It is a reason why we use such a expensive tools like LoadRunner etc).

I hope this will be useful to u. Cheers

Answer 2

There are four sets of requirements you need to cover in a tool

• Can it exercise my interface (Any HTTP test tool will do this for a web services application)
• Can it monitor my infrastructure. Now you are getting into the details of if your underlying OS and Virtual Machine can be monitored in an integrated fashion. Not all tools allow for this and you need to be very explicit as to the level of detail you are interested in.
• Will it report appropriate to my requirements and in a way which allows for easier identification of system bottlenecks? This is a mix of objective and subjective items. You have not indicated what level of reporting you need
• Does my user community have the skills to use the tool? Get the top three right and miss this one and even a free as in beer tool goes to a negative ROI almost immediately.

It's time to button up the requirements or just hire a firm with a set of tools included to do the job.