在我的testNG集成测试中，我可以多次使用@factory吗（使用Jenkins和Maven进行构建）？

Question

What - Detailed Steps

1. My test calls a 3rd party API and sends a request for a new transaction (let's say I need to do this for 5 tests which were generated by @Factory). These tests end here with the status of 'Pending'.

2. The 3rd party API takes 5 minutes to process the data. I need to make a second call to the API after 5 minutes (for all my pending tests) to get the transaction ID for my request and then pass/fail the test.

3. I want to spin up another @Factory here to re-generate all the Pending tests. These pending tests call the API again (with different inputs) to get the transaction ID and pass/fail the test based on this info.

How

I am trying to use @Factory to generate a bunch of tests dynamically and run them. After these tests are run I want to use @Factory again to generate a second batch of new tests and run them. The problem is, I did not have success when trying to call @Factory for the second time.

I am using Jenkins and Maven in my setup for generating builds and that is when I would want the tests to run.

Questions

Is step 3 possible?

Is there a better way to do this?

Thanks everyone!

Answer 1

Reading the extra comment / improves question, it sounds indeed like an Integration Test .

There are some need Integration Test libraries like JBehave , Serenity , Cucumber , etc which would probably better for setting this up.

With TestNG, you could create 3 tests, where each next test depends on the previous test. See code sample below, from testng dependency test

package com.mkyong.testng.examples.dependency;

import org.testng.annotations.Test;

public class App {

    @Test
    public void method1() {
        System.out.println("This is method 1");
    }

    @Test(dependsOnMethods = { "method1" })
    public void method2() {
        System.out.println("This is method 2");
    }

}

Here the most simple dependency is show. See the sample code for more complex cases, like groups etc. For setting up two test classes each with their own @Factory

Answer 2

Solved! Responses to this question led me in finding the answer - Thanks @Verhagen

1. I added 2 tests in my testng.xml.
2. And have 2 factories setup in my code.

3. When a build is triggered,

    @Factory 1 creates tests --> @Factory 2 creates more tests --> tests by @Factory 1 are executed --> tests by @Factory 2 are executed 

This solves my requirement for running a batch of tests (first batch) and then running a second batch of tests based on the out come of the first batch.