PMM Upgrade Matrix (e2e tests) #38
vyaroshpmm-upgrade-ui-tests-matrix.yml
on: schedule
Get versions
/
Get versions
2s
Matrix: Configuration / Settings
Matrix: RBAC / User Roles
Annotations
14 errors, 6 warnings, and 33 notices
|
RBAC / User Roles (2.11.0) / Docker way "2.11.0" -> "2.39.0"
Process completed with exit code 1.
|
|
[chromium] › configuration/defaultSettings.spec.ts:23:7 › Default Settings tests › PMM-T1659 Verify that BM is enabled by default after upgrade in 2.36.0+ @config-post-upgrade @config:
pmm-ui-tests/playwright-tests/api/helpers/apiHelper.ts#L79
1) [chromium] › configuration/defaultSettings.spec.ts:23:7 › Default Settings tests › PMM-T1659 Verify that BM is enabled by default after upgrade in 2.36.0+ @config-post-upgrade @config
Error: Status: 500 Internal Server Error
Expected: 200
Received: 500
at ../api/helpers/apiHelper.ts:79
77 | console.log(`GET: ${path}${options ? ` with ${JSON.stringify(options)}` : ''}`);
78 | const response = await (await getConfiguredRestApi()).get(path, options);
> 79 | expect(response.status(), `Status: ${response.status()} ${response.statusText()}`).toEqual(200);
| ^
80 | return response;
81 | },
82 |
at Object.get (/home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/api/helpers/apiHelper.ts:79:88)
at Object.getPmmVersion (/home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/api/server.ts:12:22)
at /home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/tests/configuration/defaultSettings.spec.ts:11:18
|
|
Configuration / Settings (2.11.0) / Docker way "2.11.0" -> "2.39.0"
Process completed with exit code 1.
|
|
RBAC / User Roles (2.31.0) / Docker way "2.31.0" -> "2.39.0"
Process completed with exit code 1.
|
|
RBAC / User Roles (2.33.0) / Docker way "2.33.0" -> "2.39.0"
Process completed with exit code 1.
|
|
[chromium] › rbac/rbac.spec.ts:82:7 › Spec file for Access Control (RBAC) › PMM-T1580 Verify creating Access Role @rbac @rbac-pre-upgrade @rbac-post-upgrade:
pmm-ui-tests/playwright-tests/components/toast.ts#L34
1) [chromium] › rbac/rbac.spec.ts:82:7 › Spec file for Access Control (RBAC) › PMM-T1580 Verify creating Access Role @rbac @rbac-pre-upgrade @rbac-post-upgrade
locator.waitFor: Error: strict mode violation: locator('xpath=//div[contains(@data-testid, "Alert") or contains(@aria-label, "Alert")]') resolved to 3 elements:
1) <div role="alert" class="css-14ka8ii" data-testid="da…>…</div> aka getByRole('alert', { name: 'Templating [region]' })
2) <div role="alert" class="css-14ka8ii" data-testid="da…>…</div> aka getByRole('alert', { name: 'Templating [environment]' })
3) <div role="alert" class="css-14ka8ii" data-testid="da…>…</div> aka getByTestId('data-testid Alert success')
=========================== logs ===========================
waiting for locator('xpath=//div[contains(@data-testid, "Alert") or contains(@aria-label, "Alert")]') to be visible
============================================================
at ../components/toast.ts:34
32 | let selectedToast: Locator = this.selectToast(options?.variant);
33 |
> 34 | await selectedToast.waitFor({ state: 'visible', timeout: options?.timeout || 30000 });
| ^
35 | await expect(selectedToast).toHaveText(message, { timeout: options?.assertionTimeout || config.expect?.timeout });
36 | await this.closeButton(selectedToast).click();
37 | await selectedToast.waitFor({ state: 'detached' });
at Toast.checkToastMessage (/home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/components/toast.ts:34:25)
at CreateRolePage.createNewRole (/home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/tests/configuration/pages/CreateRole.page.ts:69:22)
at /home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/tests/rbac/rbac.spec.ts:98:7
at /home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/tests/rbac/rbac.spec.ts:97:5
|
|
RBAC / User Roles (2.35.0) / Docker way "2.35.0" -> "2.39.0"
Process completed with exit code 1.
|
|
RBAC / User Roles (2.34.0) / Docker way "2.34.0" -> "2.39.0"
Process completed with exit code 1.
|
|
RBAC / User Roles (2.32.0) / Docker way "2.32.0" -> "2.39.0"
Process completed with exit code 1.
|
|
RBAC / User Roles (2.38.0) / Docker way "2.38.0" -> "2.39.0"
Process completed with exit code 1.
|
|
RBAC / User Roles (2.37.1) / Docker way "2.37.1" -> "2.39.0"
Process completed with exit code 1.
|
|
RBAC / User Roles (2.38.1) / Docker way "2.38.1" -> "2.39.0"
Process completed with exit code 1.
|
|
RBAC / User Roles (2.37.0) / Docker way "2.37.0" -> "2.39.0"
Process completed with exit code 1.
|
|
RBAC / User Roles (2.36.0) / Docker way "2.36.0" -> "2.39.0"
Process completed with exit code 1.
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts took 33.3s
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts took 4.4m
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts took 4.4m
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts took 3.9m
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts took 4.7m
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts took 4.8m
|
|
🎭 Playwright Run Summary
1 passed (1.0s)
|
|
🎭 Playwright Run Summary
1 passed (986ms)
|
|
🎭 Playwright Run Summary
1 passed (1.0s)
|
|
🎭 Playwright Run Summary
1 passed (1.0s)
|
|
🎭 Playwright Run Summary
3 skipped
|
|
🎭 Playwright Run Summary
1 passed (1.2s)
|
|
🎭 Playwright Run Summary
1 skipped
|
|
🎭 Playwright Run Summary
1 passed (1.3s)
|
|
🎭 Playwright Run Summary
1 passed (1.4s)
|
|
🎭 Playwright Run Summary
1 skipped
|
|
🎭 Playwright Run Summary
1 passed (1.3s)
|
|
🎭 Playwright Run Summary
1 passed (1.9s)
|
|
🎭 Playwright Run Summary
1 failed
[chromium] › configuration/defaultSettings.spec.ts:23:7 › Default Settings tests › PMM-T1659 Verify that BM is enabled by default after upgrade in 2.36.0+ @config-post-upgrade @config
|
|
🎭 Playwright Run Summary
1 passed (1.4s)
|
|
🎭 Playwright Run Summary
1 skipped
|
|
🎭 Playwright Run Summary
1 passed (1.2s)
|
|
🎭 Playwright Run Summary
1 passed (1.2s)
|
|
🎭 Playwright Run Summary
1 passed (1.4s)
|
|
🎭 Playwright Run Summary
1 passed (1.5s)
|
|
🎭 Playwright Run Summary
1 passed (1.5s)
|
|
🎭 Playwright Run Summary
1 skipped
|
|
🎭 Playwright Run Summary
1 passed (1.5s)
|
|
🎭 Playwright Run Summary
1 skipped
|
|
🎭 Playwright Run Summary
3 skipped
|
|
🎭 Playwright Run Summary
3 skipped
|
|
🎭 Playwright Run Summary
1 failed
[chromium] › rbac/rbac.spec.ts:82:7 › Spec file for Access Control (RBAC) › PMM-T1580 Verify creating Access Role @rbac @rbac-pre-upgrade @rbac-post-upgrade
1 skipped
1 passed (37.4s)
|
|
🎭 Playwright Run Summary
3 skipped
|
|
🎭 Playwright Run Summary
3 skipped
|
|
🎭 Playwright Run Summary
3 passed (4.4m)
|
|
🎭 Playwright Run Summary
3 passed (4.4m)
|
|
🎭 Playwright Run Summary
3 passed (3.9m)
|
|
🎭 Playwright Run Summary
3 passed (4.7m)
|
|
🎭 Playwright Run Summary
3 passed (4.8m)
|
Artifacts
Produced during runtime
| Name | Size | |
|---|---|---|
|
config-2.11.0-report
Expired
|
1.15 MB |
|
|
rbac-2.11.0-report
Expired
|
409 KB |
|
|
rbac-2.31.0-report
Expired
|
409 KB |
|
|
rbac-2.32.0-report
Expired
|
409 KB |
|
|
rbac-2.33.0-report
Expired
|
409 KB |
|
|
rbac-2.34.0-report
Expired
|
409 KB |
|
|
rbac-2.35.0-report
Expired
|
2.84 MB |
|
|
rbac-2.36.0-report
Expired
|
13.3 MB |
|
|
rbac-2.37.0-report
Expired
|
13.5 MB |
|
|
rbac-2.37.1-report
Expired
|
13 MB |
|
|
rbac-2.38.0-report
Expired
|
13 MB |
|
|
rbac-2.38.1-report
Expired
|
13.1 MB |
|