How to run Gradle test when all tests are UP-TO-DATE?

Question

I have my grade script set up. When I execute the Gradle build, everything is working and it runs the jUnit tests.

After that when I run the Gradle test I get the following:

C:\Users\..\..\Project>gradle test
:compileJava UP-TO-DATE
:processResources UP-TO-DATE
:classes UP-TO-DATE
:compileTestJava UP-TO-DATE
:processTestResources UP-TO-DATE
:testClasses UP-TO-DATE
:test UP-TO-DATE

When I perform gradle clean , then Gradle build works, of course... I want to be able to reset only the tests, not build the whole project: how should I do this?

Answer 1

One option would be using the --rerun-tasks flag in the Forcing tasks to execute section. This would rerun all the the test task and all the tasks it depends on.

If you're only interested in rerunning the tests then another option would be to make gradle clean the tests results before executing the tests. This can be done using the cleanTest task.

Some background - the Java plugin defines a clean tasks to each of the other tasks. According to the Tasks documentation:

cleanTaskName - Deletes files created by specified task. cleanJar will delete the JAR file created by the jar task, and cleanTest will delete the test results created by the test task.

Therefore, all you need in order to re-run your tests is to also run the cleanTest task, ie:
gradle cleanTest test

Answer 2

其他选项是在 build.gradle 中添加以下内容：

test.outputs.upToDateWhen {false}

Answer 3

gradle test --rerun-tasks

Specifies that any task optimization is ignored.

Source: https://gradle.org/docs/current/userguide/gradle_command_line.html

Answer 4

This was recently the topic on Gradle's blog post Stop rerunning your tests . The author shows an example using outputs.upToDateWhen { false } and explains why it is wrong:

This doesn't actually force reruns

What the author of this snippet probably wanted to say is “Always rerun my tests”. That's not what this snippet does though. It will only mark the task out-of-date, forcing Gradle to recreate the output. But here's the thing, if the build cache is enabled, Gradle doesn't need to run the task to recreate the output. It will find an entry in the cache and unpack the result into the test's output directory.

The same is true for this snippet:

 test.dependsOn cleanTest

Gradle will unpack the test results from the build cache after the output has been cleaned, so nothing will be rerun. In short, these snippets are creating a very expensive no-op.

If you're now thinking “Okay, I'll deactivate the cache too”, let me tell you why you shouldn't.

Then, the author goes on to explain why rerunning some tests is a waste of time:

The vast majority of your tests should be deterministic, ie given the same inputs they should produce the same result.

In the few cases where you do want to rerun tests where the code has not changed, you should model them as an input. Here are both examples from the blog post that show adding an input so the task will use it during its up-to-date checks.

task randomizedTest(type: Test) {
  systemProperty "random.testing.seed", new Random().nextInt()
}

---

task systemIntegrationTest(type: Test) {
  inputs.property "integration.date", LocalDate.now()
}

I recommend reading the entire blog post.

Answer 5

--rerun-tasks works, but is inefficient as it reruns all tasks.

cleanTest by itself may not suffice due to build cache.

so, best way to accomplish this is:

./gradlew --no-build-cache cleanTest test

Answer 6

Here's a solution using the "build.gradle" file, in case you don't want to modify your command line:

test {
    dependsOn 'cleanTest'
    //Your previous task details (if any)
}

And here's the output. Notice 2 changes from your previous output:

1) A new 'cleanTest' task appears in the output.

2) 'test' is always cleaned (ie never 'UP-TO-DATE') so it gets executed every time:

$ gradle build
:compileJava UP-TO-DATE
:processResources UP-TO-DATE
:classes UP-TO-DATE
:findMainClass
:jar
:bootRepackage
:assemble
:cleanTest
:compileTestJava UP-TO-DATE
:processTestResources UP-TO-DATE
:testClasses UP-TO-DATE
:test
:check
:build

Answer 7

Also, having to add --rerun-tasks is really redundant. Never happens. Create a --no-rerun-tasks and make --rerun-tasks default when cleanTask

Answer 8

None of the above methods worked for me.
What worked for me was simply removing all items from the cache directory in /Users/<username>/.gradle/caches/build-cache-1/ .

Answer 9

TL; 博士

test.dependsOn cleanTest

Answer 10

I think this is a valid question given that it is possible in Gradle to run this command test , and what happens is that nothing happens!

But I would question the need ever to do this, as Jolta said in his comment: if no code has changed why do you need to re-test? If you have doubts about third-party input I'd say you need to cater for this in your app code. If you have worries that your code might be "flaky", ie able to pass all tests first time but not a second (or 100th time), don't you need to think about why you have these doubts, and address them?

Personally I think this is a (very minor) design fault in Gradle: if everything is completely up-to-date, rather than going "BUILD SUCCESSFUL" it should say "NO CHANGE SINCE LAST SUCCESSFUL BUILD: NOTHING DONE".