测试失败时，Jenkins MSTest + MSTestPublisher不会失败

Question

I am working on a Jenkins multibranch pipeline project and one of the steps runs unit tests. When some unit tests fail Jenkins marks the build as unstable instead of fail the build.

stage('UnitTests') {
  steps {
    bat(returnStatus: true, script: """
      "MSTest" /resultsfile:"testresults-module1-Tests_${env.BUILD_ID}.trx" /testcontainer:bin/module1.Tests.dll"
      "MSTest" /resultsfile:"testresults-module2-Tests_${env.BUILD_ID}.trx" /testcontainer:bin/module2.Tests.dll"
    """)
    step([$class: 'MSTestPublisher', testResultsFile:"testresults*.trx", failOnError: true, keepLongStdio: true])
  }
}

I need this job to fail when any test fails.

Answer 1

I used a workaround to solve this problem.

stage('UnitTests') {
  steps {
    script {
      resultcmd = 0

      resultcmd += bat(returnStatus: true, script: """
        "MSTest" /resultsfile:"testresults-module1-Tests_${env.BUILD_ID}.trx" /testcontainer:bin/module1.Tests.dll"
        exit /b %errorlevel%
      """)

      resultcmd += bat(returnStatus: true, script: """
        "MSTest" /resultsfile:"testresults-module2-Tests_${env.BUILD_ID}.trx" /testcontainer:bin/module2.Tests.dll"
        exit /b %errorlevel%
      """)

      if (resultcmd > 0) {
        error("Tests failed")
      }
    }
  }
}

I execute each command in a separated bat block and add the result in a variable called resultcmd. Then, at the end, I check the value of resultcmd and force an error if the value is greater then 0.

I'm sure this isn't the best solution, but this is the only fix I found.