-
Notifications
You must be signed in to change notification settings - Fork 23
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
json file rewrites when run tests in few browsers simuntaneosly #7
Comments
Hi @maximkoev, thank you for your feedback. It is possible to have a report filename that is different at each run. The question is: how to do you want to show the report: should it be the merge of each report files, should it be the last generated report file? |
Hi @hdorgeval in the best case I want to see report with history. So I want to know when case passes and when failed. |
Hi @hdorgeval Maybe to give you an example of this issue consider the following scenario(I am facing a similar situation):
*Note: Maybe he might be thinking about the possibility of having a different report per browser or have an HTML report with all the results. |
Hi @JoanEsquivel |
Hi @vasantverma-LM , if you can provide the generated report.json file, it will help me to solve your issue concerning the browser. |
Hi @hdorgeval Thanks for your response. |
@hdorgeval |
Hi @vasantverma-LM : yes I plan to solve this issue as soon as possible :). I will start the dev this week-end. |
Hello guys, thank you for your feedbacks and your patience! I have published a v6.0.0 version to the npm registry that should solve this issue. Please read the CHANGELOG, as this release is a breaking change. It would be awesome if you could provide some feedback on this new release. |
@hdorgeval Thanks for the latest release. |
Hi @vasantverma-LM , thanks a lot for your feedback! This is a side effect caused by the removal of the report.json file declaration together with the reporter. If you put back the file declaration after the reporter, it should work. This problem is due to the fact that before version 6, the json file was 'cleaned' and written by testcafe itself. From version 6, the file is entirely managed and written by the reporter itself and not by testcafe. I fix this issue asap. |
Hi @vasantverma-LM, I have published a v6.0.1 that should solve the issue. |
Hi @hdorgeval the error log issue in the report is resolved in the v6.0.1 but the enhancement added in the v6.0.0 is not working. |
Hi @vasantverma-LM, I cannot reproduce locally on my mac your issue. Which browsers are you using? Did you try to rimraf the node_modules and re-install everything? |
Hi @hdorgeval I have tested it again and it seems that the issue that I have mentioned earlier is intermittent and occurs only when we are running tests on three or more browsers simultaneously. |
Hi @hdorgeval , Is there any way to show screenshots of each browser separately in the screenshots sections of the report. |
Hi @vasantverma-LM , I have pushed a v6.0.2 version that maybe could resolve that browser does not close at the end of the tests. Concerning the screenshots, I need some more time on my side. Thanks! |
Hi @vasantverma-LM, I am working on your issue. I will release a new version in a few days. |
Hi @vasantverma-LM , Thank's a lot for your feedback, as it helped me to significantly improve the reporter. I have pushed a There is still some improvements to implement:
Thank's for your feedback on this new version :) |
Hi, @hdorgeval I have tested the reporter v6.0.3 with chrome, edge, and firefox simultaneously and it is not showing the screenshots for each successful test. In my test code, I have added the code for capturing the screenshot at the end of every test. The screenshots are captured but not shown in the report for each browser. |
Hi @vasantverma-LM , thanks a lot for your feedback. I have published |
Hi @hdorgeval ,thanks for the update. |
Hi @vasantverma-LM : thanks again for your feedback. To solve your issue I need the json files generated by the reporter. Do you think it is possible on your side to forward me at least one of these files? |
Hi @hdorgeval I will try to reproduce the same on a sample testcafe project and then will share the json files. |
Hi @hdorgeval , attached are the json files for tests executed on BrowserStack. Attached below is the screenshot of the report: |
Hi @vasantverma-LM, thanks for the data. Unfortunately I suspect this is the way TestCafé handles the userAgent on BrowserStack. I will publish a new version that will enable you to output debug data on the console. I will ping you when this version is ready. Thanks! |
Hi @hdorgeval , thanks for the update. |
Hi @vasantverma-LM , I have published a |
Hi @hdorgeval I have tested the latest v6.0.5 but when executing testcafe tests on BrowserStack, screenshots are still not shown in the report |
Hi @vasantverma-LM , you should have console logs like : cannot match browser... |
Hi @vasantverma-LM , I have publish a "runInfo": {
"warnings": []
} The |
Hi @hdorgeval ,I have tested the reporter v6.0.7 and when running the testcafe tests, screenshots were captured but not shown in the report. |
Hi @vasantverma-LM, screenshot are generated by TestCafé on disk but are not passed to the reporter, hence the warning and the fact that the reporter does not show them. It is very complex to programmatically analyze the warnings given by TestCafe and find from that warnings which screenshot file is related to which feature/test and to which browser. For me, it is a bug within TestCafé: Testcafé takes the screenshot, but does not give it to the reporter because there is an error in post-processing that screenshot. At least TestCafé should give to the reporter the original screenshot. I suggest you to open an issue in TestCafé repo. |
Hi @hdorgeval , thanks for your response. |
Hi @vasantverma-LM, I opened this issue on TestCafé repo. |
Hi @hdorgeval ,Thanks |
Hi @hdorgeval , I am using the latest version of testcafe v1.8.8 and testcafe-reporter-cucumber-json version: 6.1.0. |
Hi @vasantverma-LM, thank you for your feedback! I have reproduced the problem on my side. I will fix this asap. |
Hi @vasantverma-LM , I have published a fix in v6.1.1. |
Hi guys, you created really good tool, I like it. Could u please help me with my problem. When I run tests in few browsers or run tests again, roport.json deletes and creates each time. how can I avoid it?
The text was updated successfully, but these errors were encountered: