Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

report.json doesn't show failed tests when running '.testcafe' test files, but looks good for '.js' test files #10

Open
ravinder455 opened this issue Aug 24, 2019 · 8 comments
Assignees
Labels
bug Something isn't working
Milestone

Comments

@ravinder455
Copy link

When running tests for .testcafe files, report.json file has elements only for passed tests (missing for failed tests). However runInfo shows testscount and passed with correct numbers. Also console log (spec output) has all running tests info (passed & failed).

Missing elements for failed tests are resulting in incorrect HTMl report (always 100% passed).

I didn't see this issue when running same tests through .js files (converted .testcafe files to .js using testcafe studio)

Versions

  • testcafe-reporter-cucumber-json: "^2.0.0"

  • testcafe: "^1.3.3"

  • multiple-cucumber-html-reporter: "^1.10.2"

  • Browser : Chrome , Chromium Headless

  • OS: Mac, Linux

** Testcafe configuration **
{ "browsers": "chrome", "reporter": [ "spec", { "name": "cucumber-json", "output": "reports/report.json" } ], "skipUncaughtErrors":true, "src": ["./tests/*.testcafe"] }

  • A generated testcafe-reporter-cucumber-json.json file (no changes in noisy tags)
@ravinder455 ravinder455 changed the title report.json doesn't show failed tests when running '.testcafe' files report.json doesn't show failed tests when running '.testcafe' test files, but looks good for '.js' test files Aug 24, 2019
@hdorgeval
Copy link
Owner

Hi @ravinder455 , thank you for your feedback, it would be great if you could share a repo that shows this problem.

@ravinder455
Copy link
Author

ravinder455 commented Aug 27, 2019

@hdorgeval , Thank you so much for responding on my request.

Here is the repo - https://github.com/ravinder455/testcafe_html_issue.git.

While creating the repo, I have noticed 2 different behaviors of the issue. ReadMe page has all details of the problem and repo.

@hdorgeval
Copy link
Owner

Hi @ravinder455 , thank you very much for the time you have spent to create this repo 👍 . Give me some time to check what is going on.

@hdorgeval
Copy link
Owner

Hi @ravinder455 , v3.0.0 has been published to npm and should resolve your issue. Could you give it a try and provide any feedback?

@hdorgeval hdorgeval added bug Something isn't working and removed Needs a sample repo to show the issue labels Aug 27, 2019
@hdorgeval hdorgeval added this to the v3.0.0 milestone Aug 27, 2019
@ravinder455
Copy link
Author

Issue is resolved. You are awesome.
Thanks a lot, @hdorgeval

@ravinder455
Copy link
Author

@hdorgeval,

We are getting this console error for all failed tests. Is there a way we can silence these error logs ?

testcafe-reporter-cucumber-json: please provide the following log to github.com/hdorgeval/testcafe-reporter-cucumber-json :
testcafe-reporter-cucumber-json : { err:
   TestRunErrorFormattableAdapter {
     TEMPLATES:
      { E9: [Function: E9],
        E10: [Function: E10],
        E11: [Function: E11],
        E12: [Function: E12],
        E54: [Function: E54],
        E1: [Function: E1],
        E2: [Function: E2],
        E45: [Function: E45],
        E46: [Function: E46],
        E47: [Function: E47],
        E48: [Function: E48],```

@hdorgeval
Copy link
Owner

Hi @ravinder455 , thank you for your feedback. I will fix it asap.

@hdorgeval
Copy link
Owner

Hi @ravinder455, your last feedback should be solved by v3.0.1 available on npm.

Those warning messages should not be emitted any more in the log.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants