PMM Upgrade Matrix (e2e tests) #21
vyarosh
This run and associated checks have been archived and are scheduled for deletion.
Learn more about checks retention
pmm-upgrade-ui-tests-matrix.yml
on: schedule
Push repo versions
3s
Matrix: Configuration / Settings
Matrix: RBAC / User Roles
Annotations
28 errors, 21 warnings, and 76 notices
|
RBAC / User Roles (2.30.0, Docker way) / Docker way "2.30.0" -> "2.38.0"
Process completed with exit code 1.
|
|
RBAC / User Roles (2.31.0, Docker way) / Docker way "2.31.0" -> "2.38.0"
Process completed with exit code 1.
|
|
[chromium] › configuration/defaultSettings.spec.ts:23:7 › Default Settings tests › PMM-T1659 Verify that BM is enabled by default after upgrade in 2.36.0+ @config-post-upgrade @config:
pmm-ui-tests/playwright-tests/api/helpers/apiHelper.ts#L79
1) [chromium] › configuration/defaultSettings.spec.ts:23:7 › Default Settings tests › PMM-T1659 Verify that BM is enabled by default after upgrade in 2.36.0+ @config-post-upgrade @config
Error: Status: 500 Internal Server Error
Expected: 200
Received: 500
at ../api/helpers/apiHelper.ts:79
77 | console.log(`GET: ${path}${options ? ` with ${JSON.stringify(options)}` : ''}`);
78 | const response = await (await getConfiguredRestApi()).get(path, options);
> 79 | expect(response.status(), `Status: ${response.status()} ${response.statusText()}`).toEqual(200);
| ^
80 | return response;
81 | },
82 |
at Object.get (/home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/api/helpers/apiHelper.ts:79:88)
at Object.getPmmVersion (/home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/api/server.ts:12:22)
at /home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/tests/configuration/defaultSettings.spec.ts:11:18
|
|
Configuration / Settings (2.11.0, Docker way) / Docker way "2.11.0" -> "2.38.0"
Process completed with exit code 1.
|
|
RBAC / User Roles (2.33.0, Docker way) / Docker way "2.33.0" -> "2.38.0"
Process completed with exit code 1.
|
|
RBAC / User Roles (2.34.0, UI way) / UI way "2.34.0" -> "2.38.0"
Process completed with exit code 2.
|
|
RBAC / User Roles (2.33.0, UI way) / UI way "2.33.0" -> "2.38.0"
Process completed with exit code 2.
|
|
RBAC / User Roles (2.11.0, Docker way) / Docker way "2.11.0" -> "2.38.0"
Process completed with exit code 1.
|
|
RBAC / User Roles (2.34.0, Docker way) / Docker way "2.34.0" -> "2.38.0"
Process completed with exit code 1.
|
|
RBAC / User Roles (2.31.0, UI way) / UI way "2.31.0" -> "2.38.0"
Process completed with exit code 2.
|
|
RBAC / User Roles (2.32.0, Docker way) / Docker way "2.32.0" -> "2.38.0"
Process completed with exit code 1.
|
|
[chromium] › rbac/rbac.spec.ts:82:7 › Spec file for Access Control (RBAC) › PMM-T1580 Verify creating Access Role @rbac @rbac-pre-upgrade @rbac-post-upgrade:
pmm-ui-tests/playwright-tests/components/toast.ts#L34
1) [chromium] › rbac/rbac.spec.ts:82:7 › Spec file for Access Control (RBAC) › PMM-T1580 Verify creating Access Role @rbac @rbac-pre-upgrade @rbac-post-upgrade
locator.waitFor: Error: strict mode violation: locator('xpath=//div[contains(@data-testid, "Alert") or contains(@aria-label, "Alert")]') resolved to 3 elements:
1) <div role="alert" class="css-14ka8ii" data-testid="da…>…</div> aka getByRole('alert', { name: 'Templating [environment]' })
2) <div role="alert" class="css-14ka8ii" data-testid="da…>…</div> aka getByRole('alert', { name: 'Templating [region]' })
3) <div role="alert" class="css-14ka8ii" data-testid="da…>…</div> aka getByTestId('data-testid Alert success')
=========================== logs ===========================
waiting for locator('xpath=//div[contains(@data-testid, "Alert") or contains(@aria-label, "Alert")]') to be visible
============================================================
at ../components/toast.ts:34
32 | let selectedToast: Locator = this.selectToast(options?.variant);
33 |
> 34 | await selectedToast.waitFor({ state: 'visible', timeout: options?.timeout || 30000 });
| ^
35 | await expect(selectedToast).toHaveText(message, { timeout: options?.assertionTimeout || config.expect?.timeout });
36 | await this.closeButton(selectedToast).click();
37 | await selectedToast.waitFor({ state: 'detached' });
at Toast.checkToastMessage (/home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/components/toast.ts:34:25)
at CreateRolePage.createNewRole (/home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/tests/configuration/pages/CreateRole.page.ts:69:22)
at /home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/tests/rbac/rbac.spec.ts:98:7
at /home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/tests/rbac/rbac.spec.ts:97:5
|
|
RBAC / User Roles (2.35.0, Docker way) / Docker way "2.35.0" -> "2.38.0"
Process completed with exit code 1.
|
|
RBAC / User Roles (2.32.0, UI way) / UI way "2.32.0" -> "2.38.0"
Process completed with exit code 2.
|
|
RBAC / User Roles (2.30.0, UI way) / UI way "2.30.0" -> "2.38.0"
Process completed with exit code 2.
|
|
RBAC / User Roles (2.11.0, UI way) / UI way "2.11.0" -> "2.38.0"
Process completed with exit code 2.
|
|
RBAC / User Roles (2.37.0, Docker way) / Docker way "2.37.0" -> "2.38.0"
Process completed with exit code 1.
|
|
RBAC / User Roles (2.38.0, UI way) / UI way "2.38.0" -> "2.38.0"
Process completed with exit code 2.
|
|
RBAC / User Roles (2.38.0, Docker way) / Docker way "2.38.0" -> "2.38.0"
Process completed with exit code 1.
|
|
RBAC / User Roles (2.36.0, UI way) / UI way "2.36.0" -> "2.38.0"
Process completed with exit code 2.
|
|
RBAC / User Roles (2.37.1, Docker way) / Docker way "2.37.1" -> "2.38.0"
Process completed with exit code 1.
|
|
RBAC / User Roles (2.36.0, Docker way) / Docker way "2.36.0" -> "2.38.0"
Process completed with exit code 1.
|
|
RBAC / User Roles (2.35.0, UI way) / UI way "2.35.0" -> "2.38.0"
Process completed with exit code 2.
|
|
RBAC / User Roles (2.37.0, UI way) / UI way "2.37.0" -> "2.38.0"
Process completed with exit code 2.
|
|
RBAC / User Roles (2.37.1, UI way) / UI way "2.37.1" -> "2.38.0"
Process completed with exit code 2.
|
|
[chromium] › upgrade/upgradePmmViaUi.spec.ts:15:7 › Common Upgrade PMM tests › PMM-T288 Verify user can see Update widget before upgrade [critical] @pmm-upgrade:
pmm-ui-tests/playwright-tests/components/pmmUpgrade.ts#L43
1) [chromium] › upgrade/upgradePmmViaUi.spec.ts:15:7 › Common Upgrade PMM tests › PMM-T288 Verify user can see Update widget before upgrade [critical] @pmm-upgrade
locator.waitFor: Timeout 180000ms exceeded.
=========================== logs ===========================
waiting for locator('xpath=//*[@aria-label="PMM Upgrade panel"]').getByText('Upgrade to') to be visible
============================================================
at ../components/pmmUpgrade.ts:43
41 |
42 | verifyUpgradeWidget = async () => {
> 43 | await this.buttons.upgradeButton.waitFor({ state: 'visible', timeout: Duration.ThreeMinutes });
| ^
44 | await expect(this.elements.upToDate).toBeHidden();
45 | await this.elements.lastUpgradeCheckDate.waitFor({ state: 'visible' });
46 | const availableVersion = await this.elements.availableVersion.textContent();
at PmmUpgrade.verifyUpgradeWidget (/home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/components/pmmUpgrade.ts:43:38)
at /home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/tests/upgrade/upgradePmmViaUi.spec.ts:19:36
|
|
[chromium] › upgrade/upgradePmmViaUi.spec.ts:22:7 › Common Upgrade PMM tests › PMM-T3 Verify user is able to Upgrade PMM version [blocker] @pmm-upgrade:
pmm-ui-tests/playwright-tests/pages/HomeDashboard.page.ts#L43
2) [chromium] › upgrade/upgradePmmViaUi.spec.ts:22:7 › Common Upgrade PMM tests › PMM-T3 Verify user is able to Upgrade PMM version [blocker] @pmm-upgrade
locator.waitFor: Timeout 180000ms exceeded.
=========================== logs ===========================
waiting for locator('xpath=//*[@aria-label="PMM Upgrade panel"]').getByText('Upgrade to') to be visible
============================================================
at ../pages/HomeDashboard.page.ts:43
41 |
42 | upgradePMM = async () => {
> 43 | await this.pmmUpgrade.buttons.upgradeButton.waitFor({ state: 'visible', timeout: Duration.ThreeMinutes });
| ^
44 | const currentVersion = await this.pmmUpgrade.elements.currentVersion.textContent();
45 | await this.pmmUpgrade.buttons.upgradeButton.click();
46 | const availableVersion = await this.pmmUpgrade.elements.availableVersion.textContent();
at HomeDashboard.upgradePMM (/home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/pages/HomeDashboard.page.ts:43:49)
at /home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/tests/upgrade/upgradePmmViaUi.spec.ts:25:25
|
|
Configuration / Settings (2.11.0, UI way) / UI way "2.11.0" -> "2.38.0"
Process completed with exit code 1.
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts took 36.0s
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts took 4.3m
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts took 4.5m
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts took 4.3m
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts took 5.4m
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts took 5.4m
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts took 5.4m
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › upgrade/upgradePmmViaUi.spec.ts took 4.2m
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts took 5.3m
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts took 5.4m
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › rbac/rbac.spec.ts took 4.7m
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › upgrade/upgradePmmViaUi.spec.ts took 5.2m
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › upgrade/upgradePmmViaUi.spec.ts took 4.5m
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › upgrade/upgradePmmViaUi.spec.ts took 4.2m
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › upgrade/upgradePmmViaUi.spec.ts took 5.2m
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › upgrade/upgradePmmViaUi.spec.ts took 6.4m
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › upgrade/upgradePmmViaUi.spec.ts took 4.2m
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › upgrade/upgradePmmViaUi.spec.ts took 3.3m
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › upgrade/upgradePmmViaUi.spec.ts took 3.8m
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › upgrade/upgradePmmViaUi.spec.ts took 4.4m
|
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] › upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] › upgrade/upgradePmmViaUi.spec.ts took 5.7m
|
|
🎭 Playwright Run Summary
1 passed (1.0s)
|
|
🎭 Playwright Run Summary
1 passed (1.0s)
|
|
🎭 Playwright Run Summary
3 skipped
|
|
🎭 Playwright Run Summary
3 skipped
|
|
🎭 Playwright Run Summary
1 passed (1.7s)
|
|
🎭 Playwright Run Summary
1 failed
[chromium] › configuration/defaultSettings.spec.ts:23:7 › Default Settings tests › PMM-T1659 Verify that BM is enabled by default after upgrade in 2.36.0+ @config-post-upgrade @config
|
|
🎭 Playwright Run Summary
3 skipped
|
|
🎭 Playwright Run Summary
1 passed (1.1s)
|
|
🎭 Playwright Run Summary
1 passed (1.1s)
|
|
🎭 Playwright Run Summary
3 skipped
|
|
🎭 Playwright Run Summary
3 skipped
|
|
🎭 Playwright Run Summary
3 skipped
|
|
🎭 Playwright Run Summary
3 skipped
|
|
🎭 Playwright Run Summary
3 skipped
|
|
🎭 Playwright Run Summary
3 skipped
|
|
🎭 Playwright Run Summary
1 passed (1.0s)
|
|
🎭 Playwright Run Summary
1 passed (985ms)
|
|
🎭 Playwright Run Summary
1 failed
[chromium] › rbac/rbac.spec.ts:82:7 › Spec file for Access Control (RBAC) › PMM-T1580 Verify creating Access Role @rbac @rbac-pre-upgrade @rbac-post-upgrade
1 skipped
1 passed (40.0s)
|
|
🎭 Playwright Run Summary
3 skipped
|
|
🎭 Playwright Run Summary
3 skipped
|
|
🎭 Playwright Run Summary
1 passed (1.5s)
|
|
🎭 Playwright Run Summary
1 passed (1.3s)
|
|
🎭 Playwright Run Summary
3 skipped
|
|
🎭 Playwright Run Summary
1 passed (1.4s)
|
|
🎭 Playwright Run Summary
1 passed (1.4s)
|
|
🎭 Playwright Run Summary
1 passed (1.1s)
|
|
🎭 Playwright Run Summary
1 passed (1.1s)
|
|
🎭 Playwright Run Summary
1 passed (1.3s)
|
|
🎭 Playwright Run Summary
1 skipped
|
|
🎭 Playwright Run Summary
1 skipped
|
|
🎭 Playwright Run Summary
1 passed (1.1s)
|
|
🎭 Playwright Run Summary
3 passed (4.4m)
|
|
🎭 Playwright Run Summary
1 skipped
|
|
🎭 Playwright Run Summary
1 passed (1.2s)
|
|
🎭 Playwright Run Summary
3 passed (4.5m)
|
|
🎭 Playwright Run Summary
3 passed (4.3m)
|
|
🎭 Playwright Run Summary
1 passed (1.0s)
|
|
🎭 Playwright Run Summary
1 skipped
|
|
🎭 Playwright Run Summary
3 passed (5.4m)
|
|
🎭 Playwright Run Summary
3 passed (5.4m)
|
|
🎭 Playwright Run Summary
3 passed (5.5m)
|
|
🎭 Playwright Run Summary
2 passed (4.3m)
|
|
🎭 Playwright Run Summary
1 passed (1.0s)
|
|
🎭 Playwright Run Summary
1 passed (1.1s)
|
|
🎭 Playwright Run Summary
3 passed (5.3m)
|
|
🎭 Playwright Run Summary
3 passed (5.4m)
|
|
🎭 Playwright Run Summary
3 passed (4.8m)
|
|
🎭 Playwright Run Summary
2 passed (5.2m)
|
|
🎭 Playwright Run Summary
1 passed (1.4s)
|
|
🎭 Playwright Run Summary
1 passed (1.4s)
|
|
🎭 Playwright Run Summary
2 passed (4.5m)
|
|
🎭 Playwright Run Summary
1 passed (1.1s)
|
|
🎭 Playwright Run Summary
1 passed (1.1s)
|
|
🎭 Playwright Run Summary
2 passed (4.3m)
|
|
🎭 Playwright Run Summary
1 passed (1.0s)
|
|
🎭 Playwright Run Summary
1 passed (985ms)
|
|
🎭 Playwright Run Summary
2 passed (5.2m)
|
|
🎭 Playwright Run Summary
1 passed (1.3s)
|
|
🎭 Playwright Run Summary
1 passed (1.3s)
|
|
🎭 Playwright Run Summary
2 failed
[chromium] › upgrade/upgradePmmViaUi.spec.ts:15:7 › Common Upgrade PMM tests › PMM-T288 Verify user can see Update widget before upgrade [critical] @pmm-upgrade
[chromium] › upgrade/upgradePmmViaUi.spec.ts:22:7 › Common Upgrade PMM tests › PMM-T3 Verify user is able to Upgrade PMM version [blocker] @pmm-upgrade
|
|
🎭 Playwright Run Summary
1 passed (1.7s)
|
|
🎭 Playwright Run Summary
2 passed (4.2m)
|
|
🎭 Playwright Run Summary
1 passed (1.0s)
|
|
🎭 Playwright Run Summary
1 skipped
|
|
🎭 Playwright Run Summary
2 passed (3.3m)
|
|
🎭 Playwright Run Summary
1 passed (1.1s)
|
|
🎭 Playwright Run Summary
1 skipped
|
|
🎭 Playwright Run Summary
1 skipped
|
|
🎭 Playwright Run Summary
1 passed (1.1s)
|
|
🎭 Playwright Run Summary
2 passed (3.9m)
|
|
🎭 Playwright Run Summary
1 passed (1.3s)
|
|
🎭 Playwright Run Summary
2 passed (4.5m)
|
|
🎭 Playwright Run Summary
1 skipped
|
|
🎭 Playwright Run Summary
1 passed (1.6s)
|
|
🎭 Playwright Run Summary
2 passed (5.7m)
|
|
🎭 Playwright Run Summary
1 passed (1.6s)
|
Artifacts
Produced during runtime
| Name | Size | |
|---|---|---|
|
config-2.11.0-report
Expired
|
21 MB |
|
|
rbac-2.11.0-report
Expired
|
409 KB |
|
|
rbac-2.30.0-report
Expired
|
409 KB |
|
|
rbac-2.31.0-report
Expired
|
409 KB |
|
|
rbac-2.32.0-report
Expired
|
409 KB |
|
|
rbac-2.33.0-report
Expired
|
409 KB |
|
|
rbac-2.34.0-report
Expired
|
409 KB |
|
|
rbac-2.35.0-report
Expired
|
16.4 MB |
|
|
rbac-2.36.0-report
Expired
|
26.9 MB |
|
|
rbac-2.37.0-report
Expired
|
26.2 MB |
|
|
rbac-2.37.1-report
Expired
|
26.2 MB |
|
|
rbac-2.38.0-report
Expired
|
26 MB |
|