Cucumber Scala final output shows 0 failures even when a scenario fails

[rhande-mdsol]

I have a cucumber test suite which has some tests

I run the tests using command

sbt "testOnly <cucumber_class_name>"

And one of the cucumber tests fail an assertion and console shows

Failed scenarios:
classpath:features/my_cucumber_scenario.feature:31# <my test description>

19 Scenarios (1 failed, 18 passed)
88 Steps (1 failed, 87 passed)sts 214s
3m18.224s

But in the end the console shows

Total 80, Failed 0, Errors 0, Passed 80

Since one of the tests failed, in the final output it should have shown
Failed 1 (Or something like that). But it is showing all passed instead due to which my build on travis is not failing.

How to solve this problem ? Is there a solution in cucumber ?

My dependencies are

"io.cucumber" % "cucumber-core" % "5.7.0",
"io.cucumber" % "cucumber-junit" % "5.7.0"
"io.cucumber" %% "cucumber-scala" % "5.7.0"

[gaeljw]

Hello @rhande-mdsol ,

Could it be that you have multiple scenarios with the same name (in the same file), or Scenario Outlines?

If so, this is is a known issue in sbt-junit interface:
sbt/junit-interface#84. See also #22

[mpkorstanje]

Might be worth adding a work around to detect if sbt-junit is used and act accordingly. The project seems dead.

[mpkorstanje]

Or ensure the names provided to the JUnit Description are always unique. That way sbt will also be able to handle identical features, scenarios, examples, ect. Shouldn't be too much of a burden if the #n suffix only shows up when necessary.

[mpkorstanje]

Would either of you mind checking if cucumber/cucumber-jvm#2045 solves the problem.

[rhande-mdsol]

Sorry Closed by mistake.