Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Docs]: Dot reporter output should be explained #30908

Closed
marshmn opened this issue May 20, 2024 · 3 comments · Fixed by #30939
Closed

[Docs]: Dot reporter output should be explained #30908

marshmn opened this issue May 20, 2024 · 3 comments · Fixed by #30939
Labels
open-to-a-pull-request The feature request looks good, we are open to reviewing a PR v1.45

Comments

@marshmn
Copy link
Contributor

marshmn commented May 20, 2024

Page(s)

https://playwright.dev/docs/test-reporters#dot-reporter

Description

The dot reporter output is not necessarily obvious in all cases. For example, I can understand that . is a successful test, F is a failed test - but there are other outputs that may not be so obvious:

  • xxF - I think this means that test was tried 3 times and eventually marked failed
  • xxT - Tried three times and timed-out maybe?
  • xx± - Tried three times and then passed, so marked flakey?

The docs should explain the meaning of the output in more detail.
@marshmn
Copy link
Contributor Author

marshmn commented May 20, 2024

This has come up during Discord threads a few times (directly and indirectly), e.g:

@pavelfeldman
Copy link
Member

Would you be willing to send a PR?

@marshmn
Copy link
Contributor Author

marshmn commented May 20, 2024

Yes, sure - I'll work on that in the next 24 hours or so.

@pavelfeldman pavelfeldman added v1.45 open-to-a-pull-request The feature request looks good, we are open to reviewing a PR labels May 20, 2024
marshmn added a commit to marshmn/playwright that referenced this issue May 21, 2024
@marshmn
docs: add detail on dot reporter output
749afcb 
Detail on how to interpret dot reporter output added.

Fixes microsoft#30908
@marshmn marshmn mentioned this issue May 21, 2024
Merged
pavelfeldman pushed a commit that referenced this issue May 21, 2024
@marshmn
docs: add detail on dot reporter output (#30939)
68abd36 
docs: detail on how to interpret dot reporter output added.

Fixes #30908
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
open-to-a-pull-request The feature request looks good, we are open to reviewing a PR v1.45
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

docs: add detail on dot reporter output marshmn/playwright
2 participants
@pavelfeldman @marshmn