Test suite details for proj1

Suite Details
Version:
1
Cycle:
Cycle 123
Environment:
dev
Test Type:
regression  smoke  flaky  e2e 
Components:
api  auth  checkout  search  user  navigation 

Run Time Details
Run Date:
01/07/2026
Start Time:
12:15:26
End Time:
12:15:58
Duration (s):
00:00:32.780
Parallel Run:
Yes

CI/CD - Ran on GitHub Actions

GitHub Actions
Test Suite Summary
Run:
30
Passed:
23
Skipped:
5
Failed:
2
Tests/s:
0.76
Passed Rate:
92.00%
Test Step Summary
Run:
97
Passed:
77
Skipped:
18
Failed:
2
Steps/s:
2.41
Passed Rate:
97.47%
Risk Summary
Passed Rate: this indicates how many tests passed, how many failed and how many were out of the tests that were run were flaky.
Coverage: this indicates how many tests were run out of all your tests. It also indicates how many of the skipped tests were flaky.
Confidence: this score takes adjust your passed rate with a penallty for running flaky tests (percentage of flaky tests run * 40%) and reduces it coverage gap.
Total
Passed Rate:
92.00%
✓ 23 passed ✗ 2 failed 🛠️ 3 flaky
Coverage:
83.33%
25/30 run, 4 skipped, 1 flaky skipped
Confidence:
73.60%
-4.00% flaky penalty -16.67% coverage gap
regression
Passed Rate:
89.47%
✓ 17 passed ✗ 2 failed 🛠️ 3 flaky
Coverage:
86.36%
19/22 run, 2 skipped, 1 flaky skipped
Confidence:
72.94%
-5.60% flaky penalty -13.64% coverage gap
smoke
Passed Rate:
100.00%
✓ 6 passed ✗ 0 failed 🛠️ 0 flaky
Coverage:
100.00%
6/6 run, none skipped
Confidence:
100.00%
-0.00% flaky penalty -0.00% coverage gap
e2e
Passed Rate:
0%
✓ 0 passed ✗ 0 failed 🛠️ 0 flaky
Coverage:
0.00%
0/2 run, 2 skipped
Confidence:
0%
-0.00% flaky penalty -100.00% coverage gap

Risk By Component
api
Passed Rate:
50.00%
✓ 1 passed ✗ 1 failed 🛠️ 1 flaky
Coverage:
66.67%
2/3 run, 1 skipped
Confidence:
28.93%
-13.20% flaky penalty -33.33% coverage gap
auth
Passed Rate:
100.00%
✓ 4 passed ✗ 0 failed 🛠️ 1 flaky
Coverage:
100.00%
4/4 run, none skipped
Confidence:
90.00%
-10.00% flaky penalty -0.00% coverage gap
checkout
Passed Rate:
66.67%
✓ 2 passed ✗ 1 failed 🛠️ 1 flaky
Coverage:
75.00%
3/4 run, 1 skipped
Confidence:
45.00%
-10.00% flaky penalty -25.00% coverage gap
search
Passed Rate:
100.00%
✓ 2 passed ✗ 0 failed 🛠️ 0 flaky
Coverage:
66.67%
2/3 run, 1 flaky skipped
Confidence:
66.67%
-0.00% flaky penalty -33.33% coverage gap
user
Passed Rate:
100.00%
✓ 4 passed ✗ 0 failed 🛠️ 0 flaky
Coverage:
100.00%
4/4 run, none skipped
Confidence:
100.00%
-0.00% flaky penalty -0.00% coverage gap
navigation
Passed Rate:
100.00%
✓ 10 passed ✗ 0 failed 🛠️ 0 flaky
Coverage:
83.33%
10/12 run, 2 skipped
Confidence:
83.33%
-0.00% flaky penalty -16.67% coverage gap

Expand ID Tags Scenario Steps Status Duration (s)
JIRA-1003 api  regression  API Example test using setp steps 3
0
3
0
0.000
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Skipped 0.000
2 Expect 1 not to be null -- Skipped 0.000
3 Expect undefined to be undefined -- Skipped 0.000
JIRA-1001 api  smoke  API Example test using setp steps 1
3
0
0
1.545
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Passed 0.503
2 Expect 1 not to be null -- Passed 0.329
3 Expect undefined to be undefined -- Passed 0.713
JIRA-2002 auth  regression  flaky  AUTH flaky(but not) test with it steps 2
4
0
0
2.234
Step step description Error Retries Status Duration (s)
1 show environment data -- Passed 0.112
2 Expect 1 to be 1 -- Passed 0.439
3 Expect true to be true -- Passed 1.001
4 Expect anything to be anything -- Passed 0.682
JIRA-2004 auth  regression  AUTH Pass test with it steps 4
3
0
0
1.545
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Passed 0.501
2 Expect 1 not to be null -- Passed 0.329
3 Expect undefined to be undefined -- Passed 0.715
JIRA-2003 auth  regression  AUTH Pass test with it steps 3
3
0
0
1.545
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Passed 0.502
2 Expect 1 not to be null -- Passed 0.329
3 Expect undefined to be undefined -- Passed 0.714
JIRA-2001 auth  smoke  AUTH Pass test with it steps 1
3
0
0
1.545
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Passed 0.501
2 Expect 1 not to be null -- Passed 0.329
3 Expect undefined to be undefined -- Passed 0.715
JIRA-3003 checkout  regression  CHECKOUT Pass test with it steps 3
3
0
0
1.545
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Passed 0.502
2 Expect 1 not to be null -- Passed 0.329
3 Expect undefined to be undefined -- Passed 0.714
JIRA-2004 checkout  regression  CHECKOUT skip test with it steps 4
0
3
0
0.000
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Skipped 0.000
2 Expect 1 not to be null -- Skipped 0.000
3 Expect undefined to be undefined -- Skipped 0.000
JIRA-1002 api  regression  flaky  API Example test using setp steps 2
3
1
1
6.965
Step step description Error Retries Status Duration (s)
1 show environment data -- Passed 0.112
2 Expect 1 to be 1 -- Passed 0.438
3 Expect true to be true, retries and fails 2 Passed 3.003
4 Expect anything to be anything expected 'nothing' to equal 'anything' 4 Failed 3.412
5 Expect step to be skipped -- Skipped 0.000
JIRA-3001 checkout  smoke  CHECKOUT Pass test with it steps 1
3
0
0
1.547
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Passed 0.502
2 Expect 1 not to be null -- Passed 0.329
3 Expect undefined to be undefined -- Passed 0.716
JIRA-5002 search  regression  SEARCH Example test using step steps 2
3
0
0
1.544
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Passed 0.501
2 Expect 1 not to be null -- Passed 0.329
3 Expect undefined to be undefined -- Passed 0.714
JIRA-5003 search  regression  flaky  SEARCH skip flaky Example test using setp steps 3
0
5
0
0.000
Step step description Error Retries Status Duration (s)
1 show environment data -- Skipped 0.000
2 Expect 1 to be 1 -- Skipped 0.000
3 Expect true to be true, retries and fails -- Skipped 0.000
4 Expect anything to be anything -- Skipped 0.000
5 Expect step to be skipped -- Skipped 0.000
JIRA-5001 search  smoke  SEARCH Example testusing step steps 1
3
0
0
1.543
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Passed 0.501
2 Expect 1 not to be null -- Passed 0.328
3 Expect undefined to be undefined -- Passed 0.714
JIRA-3002 checkout  regression  flaky  CHECKOUT flaky test with it steps 2
4
0
1
7.236
Step step description Error Retries Status Duration (s)
1 show environment data -- Passed 0.112
2 Expect 1 to be 1 -- Passed 0.438
3 Expect true to be true -- Passed 1.001
4 Expect anything to be anything -- Passed 0.682
5 Expect true to be true, retries and fails expected true to equal 'true' 4 Failed 5.003
JIRA-6002 user  regression  USER Example test using step steps 2
3
0
0
1.544
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Passed 0.501
2 Expect 1 not to be null -- Passed 0.329
3 Expect undefined to be undefined -- Passed 0.714
JIRA-6003 user  regression  USER Example test using step steps 3
3
0
0
1.544
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Passed 0.501
2 Expect 1 not to be null -- Passed 0.329
3 Expect undefined to be undefined -- Passed 0.714
JIRA-6004 user  regression  USER Example test using step steps 4
3
0
0
1.545
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Passed 0.502
2 Expect 1 not to be null -- Passed 0.329
3 Expect undefined to be undefined -- Passed 0.714
JIRA-6006 user  regression  USER Example test using step steps 6
3
0
0
1.543
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Passed 0.500
2 Expect 1 not to be null -- Passed 0.329
3 Expect undefined to be undefined -- Passed 0.714
JIRA-4001 navigation  smoke  NAVIGATION Pass test with step steps 1
3
0
0
1.544
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Passed 0.499
2 Expect 1 not to be null -- Passed 0.331
3 Expect undefined to be undefined -- Passed 0.714
JIRA-4002 navigation  regression  NAVIGATION Pass test with step steps 2
3
0
0
1.544
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Passed 0.500
2 Expect 1 not to be null -- Passed 0.329
3 Expect undefined to be undefined -- Passed 0.715
JIRA-4003 navigation  regression  NAVIGATION Pass test with step steps 3
3
0
0
1.543
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Passed 0.501
2 Expect 1 not to be null -- Passed 0.328
3 Expect undefined to be undefined -- Passed 0.714
JIRA-4004 navigation  regression  NAVIGATION Pass test with step steps 4
3
0
0
1.544
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Passed 0.501
2 Expect 1 not to be null -- Passed 0.328
3 Expect undefined to be undefined -- Passed 0.715
JIRA-4005 navigation  regression  NAVIGATION Pass test with step steps 5
3
0
0
1.544
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Passed 0.501
2 Expect 1 not to be null -- Passed 0.329
3 Expect undefined to be undefined -- Passed 0.714
JIRA-4006 navigation  e2e  NAVIGATION skip test with step steps 6
0
3
0
0.000
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Skipped 0.000
2 Expect 1 not to be null -- Skipped 0.000
3 Expect undefined to be undefined -- Skipped 0.000
JIRA-4001 navigation  smoke  NAVIGATION Pass test with step steps 1
3
0
0
1.545
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Passed 0.501
2 Expect 1 not to be null -- Passed 0.329
3 Expect undefined to be undefined -- Passed 0.715
JIRA-4002 navigation  regression  NAVIGATION Pass test with step steps 2
3
0
0
1.545
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Passed 0.501
2 Expect 1 not to be null -- Passed 0.329
3 Expect undefined to be undefined -- Passed 0.715
JIRA-4003 navigation  regression  NAVIGATION Pass test with step steps 3
3
0
0
1.545
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Passed 0.501
2 Expect 1 not to be null -- Passed 0.329
3 Expect undefined to be undefined -- Passed 0.715
JIRA-4004 navigation  regression  NAVIGATION Pass test with step steps 4
3
0
0
1.545
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Passed 0.501
2 Expect 1 not to be null -- Passed 0.329
3 Expect undefined to be undefined -- Passed 0.715
JIRA-4005 navigation  regression  NAVIGATION Pass test with step steps 5
3
0
0
1.545
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Passed 0.501
2 Expect 1 not to be null -- Passed 0.329
3 Expect undefined to be undefined -- Passed 0.715
JIRA-4006 navigation  e2e  NAVIGATION skip test with step steps 6
0
3
0
0.000
Step step description Error Retries Status Duration (s)
1 Expect [1,2,3] to include 2 -- Skipped 0.000
2 Expect 1 not to be null -- Skipped 0.000
3 Expect undefined to be undefined -- Skipped 0.000