PMM Upgrade Matrix (e2e tests) #22
This run and associated checks have been archived and are scheduled for deletion.
Learn more about checks retention
pmm-upgrade-ui-tests-matrix.yml
on: schedule
Push repo versions
1s
Matrix: Configuration / Settings
Matrix: RBAC / User Roles
Annotations
27 errors, 21 warnings, and 76 notices
RBAC / User Roles (2.30.0, Docker way) / Docker way "2.30.0" -> "2.38.0"
Process completed with exit code 1.
|
RBAC / User Roles (2.31.0, Docker way) / Docker way "2.31.0" -> "2.38.0"
Process completed with exit code 1.
|
RBAC / User Roles (2.33.0, Docker way) / Docker way "2.33.0" -> "2.38.0"
Process completed with exit code 1.
|
RBAC / User Roles (2.32.0, Docker way) / Docker way "2.32.0" -> "2.38.0"
Process completed with exit code 1.
|
[chromium] βΊ configuration/defaultSettings.spec.ts:23:7 βΊ Default Settings tests βΊ PMM-T1659 Verify that BM is enabled by default after upgrade in 2.36.0+ @config-post-upgrade @config:
pmm-ui-tests/playwright-tests/api/helpers/apiHelper.ts#L79
1) [chromium] βΊ configuration/defaultSettings.spec.ts:23:7 βΊ Default Settings tests βΊ PMM-T1659 Verify that BM is enabled by default after upgrade in 2.36.0+ @config-post-upgrade @config
Error: Status: 500 Internal Server Error
Expected: 200
Received: 500
at ../api/helpers/apiHelper.ts:79
77 | console.log(`GET: ${path}${options ? ` with ${JSON.stringify(options)}` : ''}`);
78 | const response = await (await getConfiguredRestApi()).get(path, options);
> 79 | expect(response.status(), `Status: ${response.status()} ${response.statusText()}`).toEqual(200);
| ^
80 | return response;
81 | },
82 |
at Object.get (/home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/api/helpers/apiHelper.ts:79:88)
at Object.getPmmVersion (/home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/api/server.ts:12:22)
at /home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/tests/configuration/defaultSettings.spec.ts:11:18
|
Configuration / Settings (2.11.0, Docker way) / Docker way "2.11.0" -> "2.38.0"
Process completed with exit code 1.
|
RBAC / User Roles (2.31.0, UI way) / UI way "2.31.0" -> "2.38.0"
Process completed with exit code 2.
|
RBAC / User Roles (2.11.0, Docker way) / Docker way "2.11.0" -> "2.38.0"
Process completed with exit code 1.
|
RBAC / User Roles (2.30.0, UI way) / UI way "2.30.0" -> "2.38.0"
Process completed with exit code 2.
|
RBAC / User Roles (2.33.0, UI way) / UI way "2.33.0" -> "2.38.0"
Process completed with exit code 2.
|
RBAC / User Roles (2.34.0, Docker way) / Docker way "2.34.0" -> "2.38.0"
Process completed with exit code 1.
|
RBAC / User Roles (2.34.0, UI way) / UI way "2.34.0" -> "2.38.0"
Process completed with exit code 2.
|
RBAC / User Roles (2.32.0, UI way) / UI way "2.32.0" -> "2.38.0"
Process completed with exit code 2.
|
RBAC / User Roles (2.11.0, UI way) / UI way "2.11.0" -> "2.38.0"
Process completed with exit code 2.
|
[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts:15:7 βΊ Common Upgrade PMM tests βΊ PMM-T288 Verify user can see Update widget before upgrade [critical] @pmm-upgrade:
pmm-ui-tests/playwright-tests/components/pmmUpgrade.ts#L43
1) [chromium] βΊ upgrade/upgradePmmViaUi.spec.ts:15:7 βΊ Common Upgrade PMM tests βΊ PMM-T288 Verify user can see Update widget before upgrade [critical] @pmm-upgrade
locator.waitFor: Timeout 180000ms exceeded.
=========================== logs ===========================
waiting for locator('xpath=//*[@aria-label="PMM Upgrade panel"]').getByText('Upgrade to') to be visible
============================================================
at ../components/pmmUpgrade.ts:43
41 |
42 | verifyUpgradeWidget = async () => {
> 43 | await this.buttons.upgradeButton.waitFor({ state: 'visible', timeout: Duration.ThreeMinutes });
| ^
44 | await expect(this.elements.upToDate).toBeHidden();
45 | await this.elements.lastUpgradeCheckDate.waitFor({ state: 'visible' });
46 | const availableVersion = await this.elements.availableVersion.textContent();
at PmmUpgrade.verifyUpgradeWidget (/home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/components/pmmUpgrade.ts:43:38)
at /home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/tests/upgrade/upgradePmmViaUi.spec.ts:19:36
|
[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts:22:7 βΊ Common Upgrade PMM tests βΊ PMM-T3 Verify user is able to Upgrade PMM version [blocker] @pmm-upgrade:
pmm-ui-tests/playwright-tests/pages/HomeDashboard.page.ts#L43
2) [chromium] βΊ upgrade/upgradePmmViaUi.spec.ts:22:7 βΊ Common Upgrade PMM tests βΊ PMM-T3 Verify user is able to Upgrade PMM version [blocker] @pmm-upgrade
locator.waitFor: Timeout 180000ms exceeded.
=========================== logs ===========================
waiting for locator('xpath=//*[@aria-label="PMM Upgrade panel"]').getByText('Upgrade to') to be visible
============================================================
at ../pages/HomeDashboard.page.ts:43
41 |
42 | upgradePMM = async () => {
> 43 | await this.pmmUpgrade.buttons.upgradeButton.waitFor({ state: 'visible', timeout: Duration.ThreeMinutes });
| ^
44 | const currentVersion = await this.pmmUpgrade.elements.currentVersion.textContent();
45 | await this.pmmUpgrade.buttons.upgradeButton.click();
46 | const availableVersion = await this.pmmUpgrade.elements.availableVersion.textContent();
at HomeDashboard.upgradePMM (/home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/pages/HomeDashboard.page.ts:43:49)
at /home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/tests/upgrade/upgradePmmViaUi.spec.ts:25:25
|
Configuration / Settings (2.11.0, UI way) / UI way "2.11.0" -> "2.38.0"
Process completed with exit code 1.
|
RBAC / User Roles (2.37.0, UI way) / UI way "2.37.0" -> "2.38.0"
Process completed with exit code 2.
|
RBAC / User Roles (2.37.1, Docker way) / Docker way "2.37.1" -> "2.38.0"
Process completed with exit code 1.
|
RBAC / User Roles (2.37.0, Docker way) / Docker way "2.37.0" -> "2.38.0"
Process completed with exit code 1.
|
RBAC / User Roles (2.35.0, Docker way) / Docker way "2.35.0" -> "2.38.0"
Process completed with exit code 1.
|
RBAC / User Roles (2.38.0, Docker way) / Docker way "2.38.0" -> "2.38.0"
Process completed with exit code 1.
|
RBAC / User Roles (2.36.0, UI way) / UI way "2.36.0" -> "2.38.0"
Process completed with exit code 2.
|
RBAC / User Roles (2.35.0, UI way) / UI way "2.35.0" -> "2.38.0"
Process completed with exit code 2.
|
RBAC / User Roles (2.37.1, UI way) / UI way "2.37.1" -> "2.38.0"
Process completed with exit code 2.
|
RBAC / User Roles (2.38.0, UI way) / UI way "2.38.0" -> "2.38.0"
Process completed with exit code 2.
|
RBAC / User Roles (2.36.0, Docker way) / Docker way "2.36.0" -> "2.38.0"
Process completed with exit code 1.
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts took 3.0m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts took 4.2m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts took 4.1m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts took 4.2m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts took 4.7m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts took 4.8m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts took 4.7m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts took 4.7m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts took 5.5m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts took 5.4m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts took 6.4m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts took 5.4m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts took 5.5m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts took 5.7m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts took 6.0m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts took 5.4m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts took 4.9m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts took 5.9m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts took 5.5m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts took 5.3m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts took 6.3m
|
π Playwright Run Summary
3 skipped
|
π Playwright Run Summary
1 passed (1.1s)
|
π Playwright Run Summary
1 passed (1.1s)
|
π Playwright Run Summary
1 passed (1.1s)
|
π Playwright Run Summary
1 passed (1.1s)
|
π Playwright Run Summary
1 passed (1000ms)
|
π Playwright Run Summary
1 passed (1.1s)
|
π Playwright Run Summary
1 passed (1.0s)
|
π Playwright Run Summary
1 passed (1.0s)
|
π Playwright Run Summary
1 skipped
|
π Playwright Run Summary
1 passed (1.3s)
|
π Playwright Run Summary
3 skipped
|
π Playwright Run Summary
1 skipped
|
π Playwright Run Summary
1 passed (1.2s)
|
π Playwright Run Summary
1 passed (1.0s)
|
π Playwright Run Summary
1 skipped
|
π Playwright Run Summary
1 passed (1.4s)
|
π Playwright Run Summary
1 passed (1.3s)
|
π Playwright Run Summary
3 skipped
|
π Playwright Run Summary
1 passed (1.4s)
|
π Playwright Run Summary
1 skipped
|
π Playwright Run Summary
1 passed (1.4s)
|
π Playwright Run Summary
1 passed (1.5s)
|
π Playwright Run Summary
3 skipped
|
π Playwright Run Summary
1 passed (2.2s)
|
π Playwright Run Summary
1 failed
[chromium] βΊ configuration/defaultSettings.spec.ts:23:7 βΊ Default Settings tests βΊ PMM-T1659 Verify that BM is enabled by default after upgrade in 2.36.0+ @config-post-upgrade @config
|
π Playwright Run Summary
3 skipped
|
π Playwright Run Summary
3 skipped
|
π Playwright Run Summary
3 skipped
|
π Playwright Run Summary
3 skipped
|
π Playwright Run Summary
3 skipped
|
π Playwright Run Summary
3 skipped
|
π Playwright Run Summary
3 skipped
|
π Playwright Run Summary
3 skipped
|
π Playwright Run Summary
2 passed (3.0m)
|
π Playwright Run Summary
1 passed (1.1s)
|
π Playwright Run Summary
1 skipped
|
π Playwright Run Summary
1 passed (1.2s)
|
π Playwright Run Summary
2 passed (4.2m)
|
π Playwright Run Summary
1 skipped
|
π Playwright Run Summary
2 passed (4.1m)
|
π Playwright Run Summary
1 passed (1.1s)
|
π Playwright Run Summary
1 skipped
|
π Playwright Run Summary
2 passed (4.2m)
|
π Playwright Run Summary
1 passed (1.0s)
|
π Playwright Run Summary
1 passed (992ms)
|
π Playwright Run Summary
2 passed (4.8m)
|
π Playwright Run Summary
1 passed (1.0s)
|
π Playwright Run Summary
1 passed (1.0s)
|
π Playwright Run Summary
1 passed (1.3s)
|
π Playwright Run Summary
2 passed (4.9m)
|
π Playwright Run Summary
1 passed (1.3s)
|
π Playwright Run Summary
1 skipped
|
π Playwright Run Summary
1 passed (1.4s)
|
π Playwright Run Summary
2 passed (4.8m)
|
π Playwright Run Summary
2 passed (4.7m)
|
π Playwright Run Summary
1 passed (1.2s)
|
π Playwright Run Summary
1 passed (1.2s)
|
π Playwright Run Summary
2 passed (5.5m)
|
π Playwright Run Summary
1 passed (1.5s)
|
π Playwright Run Summary
1 passed (1.5s)
|
π Playwright Run Summary
2 passed (5.4m)
|
π Playwright Run Summary
1 passed (1.4s)
|
π Playwright Run Summary
1 passed (1.5s)
|
π Playwright Run Summary
2 failed
[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts:15:7 βΊ Common Upgrade PMM tests βΊ PMM-T288 Verify user can see Update widget before upgrade [critical] @pmm-upgrade
[chromium] βΊ upgrade/upgradePmmViaUi.spec.ts:22:7 βΊ Common Upgrade PMM tests βΊ PMM-T3 Verify user is able to Upgrade PMM version [blocker] @pmm-upgrade
|
π Playwright Run Summary
1 passed (1.8s)
|
π Playwright Run Summary
3 passed (5.4m)
|
π Playwright Run Summary
3 passed (5.5m)
|
π Playwright Run Summary
3 passed (5.7m)
|
π Playwright Run Summary
3 passed (6.0m)
|
π Playwright Run Summary
3 passed (5.5m)
|
π Playwright Run Summary
3 passed (4.9m)
|
π Playwright Run Summary
3 passed (6.0m)
|
π Playwright Run Summary
3 passed (5.6m)
|
π Playwright Run Summary
3 passed (5.3m)
|
π Playwright Run Summary
3 passed (6.4m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
config-2.11.0-report
Expired
|
19.2 MB |
|
rbac-2.11.0-report
Expired
|
409 KB |
|
rbac-2.30.0-report
Expired
|
409 KB |
|
rbac-2.31.0-report
Expired
|
409 KB |
|
rbac-2.32.0-report
Expired
|
409 KB |
|
rbac-2.33.0-report
Expired
|
409 KB |
|
rbac-2.34.0-report
Expired
|
409 KB |
|
rbac-2.35.0-report
Expired
|
28.1 MB |
|
rbac-2.36.0-report
Expired
|
28.4 MB |
|
rbac-2.37.0-report
Expired
|
27.8 MB |
|
rbac-2.37.1-report
Expired
|
27.3 MB |
|
rbac-2.38.0-report
Expired
|
27 MB |
|