Skip to content

PMM Upgrade Matrix (e2e tests) #22

PMM Upgrade Matrix (e2e tests)

PMM Upgrade Matrix (e2e tests) #22

Triggered via schedule July 5, 2023 00:07
Status Failure
Total duration 15m 51s
Artifacts 12
This run and associated checks have been archived and are scheduled for deletion. Learn more about checks retention
Push repo versions
1s
Push repo versions
Matrix: Configuration / Settings
Matrix: RBAC / User Roles
Fit to window
Zoom out
Zoom in

Annotations

27 errors, 21 warnings, and 76 notices
RBAC / User Roles (2.30.0, Docker way) / Docker way "2.30.0" -> "2.38.0"
Process completed with exit code 1.
RBAC / User Roles (2.31.0, Docker way) / Docker way "2.31.0" -> "2.38.0"
Process completed with exit code 1.
RBAC / User Roles (2.33.0, Docker way) / Docker way "2.33.0" -> "2.38.0"
Process completed with exit code 1.
RBAC / User Roles (2.32.0, Docker way) / Docker way "2.32.0" -> "2.38.0"
Process completed with exit code 1.
[chromium] β€Ί configuration/defaultSettings.spec.ts:23:7 β€Ί Default Settings tests β€Ί PMM-T1659 Verify that BM is enabled by default after upgrade in 2.36.0+ @config-post-upgrade @config: pmm-ui-tests/playwright-tests/api/helpers/apiHelper.ts#L79
1) [chromium] β€Ί configuration/defaultSettings.spec.ts:23:7 β€Ί Default Settings tests β€Ί PMM-T1659 Verify that BM is enabled by default after upgrade in 2.36.0+ @config-post-upgrade @config Error: Status: 500 Internal Server Error Expected: 200 Received: 500 at ../api/helpers/apiHelper.ts:79 77 | console.log(`GET: ${path}${options ? ` with ${JSON.stringify(options)}` : ''}`); 78 | const response = await (await getConfiguredRestApi()).get(path, options); > 79 | expect(response.status(), `Status: ${response.status()} ${response.statusText()}`).toEqual(200); | ^ 80 | return response; 81 | }, 82 | at Object.get (/home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/api/helpers/apiHelper.ts:79:88) at Object.getPmmVersion (/home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/api/server.ts:12:22) at /home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/tests/configuration/defaultSettings.spec.ts:11:18
Configuration / Settings (2.11.0, Docker way) / Docker way "2.11.0" -> "2.38.0"
Process completed with exit code 1.
RBAC / User Roles (2.31.0, UI way) / UI way "2.31.0" -> "2.38.0"
Process completed with exit code 2.
RBAC / User Roles (2.11.0, Docker way) / Docker way "2.11.0" -> "2.38.0"
Process completed with exit code 1.
RBAC / User Roles (2.30.0, UI way) / UI way "2.30.0" -> "2.38.0"
Process completed with exit code 2.
RBAC / User Roles (2.33.0, UI way) / UI way "2.33.0" -> "2.38.0"
Process completed with exit code 2.
RBAC / User Roles (2.34.0, Docker way) / Docker way "2.34.0" -> "2.38.0"
Process completed with exit code 1.
RBAC / User Roles (2.34.0, UI way) / UI way "2.34.0" -> "2.38.0"
Process completed with exit code 2.
RBAC / User Roles (2.32.0, UI way) / UI way "2.32.0" -> "2.38.0"
Process completed with exit code 2.
RBAC / User Roles (2.11.0, UI way) / UI way "2.11.0" -> "2.38.0"
Process completed with exit code 2.
[chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts:15:7 β€Ί Common Upgrade PMM tests β€Ί PMM-T288 Verify user can see Update widget before upgrade [critical] @pmm-upgrade: pmm-ui-tests/playwright-tests/components/pmmUpgrade.ts#L43
1) [chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts:15:7 β€Ί Common Upgrade PMM tests β€Ί PMM-T288 Verify user can see Update widget before upgrade [critical] @pmm-upgrade locator.waitFor: Timeout 180000ms exceeded. =========================== logs =========================== waiting for locator('xpath=//*[@aria-label="PMM Upgrade panel"]').getByText('Upgrade to') to be visible ============================================================ at ../components/pmmUpgrade.ts:43 41 | 42 | verifyUpgradeWidget = async () => { > 43 | await this.buttons.upgradeButton.waitFor({ state: 'visible', timeout: Duration.ThreeMinutes }); | ^ 44 | await expect(this.elements.upToDate).toBeHidden(); 45 | await this.elements.lastUpgradeCheckDate.waitFor({ state: 'visible' }); 46 | const availableVersion = await this.elements.availableVersion.textContent(); at PmmUpgrade.verifyUpgradeWidget (/home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/components/pmmUpgrade.ts:43:38) at /home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/tests/upgrade/upgradePmmViaUi.spec.ts:19:36
[chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts:22:7 β€Ί Common Upgrade PMM tests β€Ί PMM-T3 Verify user is able to Upgrade PMM version [blocker] @pmm-upgrade: pmm-ui-tests/playwright-tests/pages/HomeDashboard.page.ts#L43
2) [chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts:22:7 β€Ί Common Upgrade PMM tests β€Ί PMM-T3 Verify user is able to Upgrade PMM version [blocker] @pmm-upgrade locator.waitFor: Timeout 180000ms exceeded. =========================== logs =========================== waiting for locator('xpath=//*[@aria-label="PMM Upgrade panel"]').getByText('Upgrade to') to be visible ============================================================ at ../pages/HomeDashboard.page.ts:43 41 | 42 | upgradePMM = async () => { > 43 | await this.pmmUpgrade.buttons.upgradeButton.waitFor({ state: 'visible', timeout: Duration.ThreeMinutes }); | ^ 44 | const currentVersion = await this.pmmUpgrade.elements.currentVersion.textContent(); 45 | await this.pmmUpgrade.buttons.upgradeButton.click(); 46 | const availableVersion = await this.pmmUpgrade.elements.availableVersion.textContent(); at HomeDashboard.upgradePMM (/home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/pages/HomeDashboard.page.ts:43:49) at /home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/tests/upgrade/upgradePmmViaUi.spec.ts:25:25
Configuration / Settings (2.11.0, UI way) / UI way "2.11.0" -> "2.38.0"
Process completed with exit code 1.
RBAC / User Roles (2.37.0, UI way) / UI way "2.37.0" -> "2.38.0"
Process completed with exit code 2.
RBAC / User Roles (2.37.1, Docker way) / Docker way "2.37.1" -> "2.38.0"
Process completed with exit code 1.
RBAC / User Roles (2.37.0, Docker way) / Docker way "2.37.0" -> "2.38.0"
Process completed with exit code 1.
RBAC / User Roles (2.35.0, Docker way) / Docker way "2.35.0" -> "2.38.0"
Process completed with exit code 1.
RBAC / User Roles (2.38.0, Docker way) / Docker way "2.38.0" -> "2.38.0"
Process completed with exit code 1.
RBAC / User Roles (2.36.0, UI way) / UI way "2.36.0" -> "2.38.0"
Process completed with exit code 2.
RBAC / User Roles (2.35.0, UI way) / UI way "2.35.0" -> "2.38.0"
Process completed with exit code 2.
RBAC / User Roles (2.37.1, UI way) / UI way "2.37.1" -> "2.38.0"
Process completed with exit code 2.
RBAC / User Roles (2.38.0, UI way) / UI way "2.38.0" -> "2.38.0"
Process completed with exit code 2.
RBAC / User Roles (2.36.0, Docker way) / Docker way "2.36.0" -> "2.38.0"
Process completed with exit code 1.
Slow Test: pmm-ui-tests/playwright-tests/[chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts took 3.0m
Slow Test: pmm-ui-tests/playwright-tests/[chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts took 4.2m
Slow Test: pmm-ui-tests/playwright-tests/[chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts took 4.1m
Slow Test: pmm-ui-tests/playwright-tests/[chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts took 4.2m
Slow Test: pmm-ui-tests/playwright-tests/[chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts took 4.7m
Slow Test: pmm-ui-tests/playwright-tests/[chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts took 4.8m
Slow Test: pmm-ui-tests/playwright-tests/[chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts took 4.7m
Slow Test: pmm-ui-tests/playwright-tests/[chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts took 4.7m
Slow Test: pmm-ui-tests/playwright-tests/[chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts took 5.5m
Slow Test: pmm-ui-tests/playwright-tests/[chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts took 5.4m
Slow Test: pmm-ui-tests/playwright-tests/[chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts took 6.4m
Slow Test: pmm-ui-tests/playwright-tests/[chromium] β€Ί rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] β€Ί rbac/rbac.spec.ts took 5.4m
Slow Test: pmm-ui-tests/playwright-tests/[chromium] β€Ί rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] β€Ί rbac/rbac.spec.ts took 5.5m
Slow Test: pmm-ui-tests/playwright-tests/[chromium] β€Ί rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] β€Ί rbac/rbac.spec.ts took 5.7m
Slow Test: pmm-ui-tests/playwright-tests/[chromium] β€Ί rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] β€Ί rbac/rbac.spec.ts took 6.0m
Slow Test: pmm-ui-tests/playwright-tests/[chromium] β€Ί rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] β€Ί rbac/rbac.spec.ts took 5.4m
Slow Test: pmm-ui-tests/playwright-tests/[chromium] β€Ί rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] β€Ί rbac/rbac.spec.ts took 4.9m
Slow Test: pmm-ui-tests/playwright-tests/[chromium] β€Ί rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] β€Ί rbac/rbac.spec.ts took 5.9m
Slow Test: pmm-ui-tests/playwright-tests/[chromium] β€Ί rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] β€Ί rbac/rbac.spec.ts took 5.5m
Slow Test: pmm-ui-tests/playwright-tests/[chromium] β€Ί rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] β€Ί rbac/rbac.spec.ts took 5.3m
Slow Test: pmm-ui-tests/playwright-tests/[chromium] β€Ί rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] β€Ί rbac/rbac.spec.ts took 6.3m
🎭 Playwright Run Summary
3 skipped
🎭 Playwright Run Summary
1 passed (1.1s)
🎭 Playwright Run Summary
1 passed (1.1s)
🎭 Playwright Run Summary
1 passed (1.1s)
🎭 Playwright Run Summary
1 passed (1.1s)
🎭 Playwright Run Summary
1 passed (1000ms)
🎭 Playwright Run Summary
1 passed (1.1s)
🎭 Playwright Run Summary
1 passed (1.0s)
🎭 Playwright Run Summary
1 passed (1.0s)
🎭 Playwright Run Summary
1 skipped
🎭 Playwright Run Summary
1 passed (1.3s)
🎭 Playwright Run Summary
3 skipped
🎭 Playwright Run Summary
1 skipped
🎭 Playwright Run Summary
1 passed (1.2s)
🎭 Playwright Run Summary
1 passed (1.0s)
🎭 Playwright Run Summary
1 skipped
🎭 Playwright Run Summary
1 passed (1.4s)
🎭 Playwright Run Summary
1 passed (1.3s)
🎭 Playwright Run Summary
3 skipped
🎭 Playwright Run Summary
1 passed (1.4s)
🎭 Playwright Run Summary
1 skipped
🎭 Playwright Run Summary
1 passed (1.4s)
🎭 Playwright Run Summary
1 passed (1.5s)
🎭 Playwright Run Summary
3 skipped
🎭 Playwright Run Summary
1 passed (2.2s)
🎭 Playwright Run Summary
1 failed [chromium] β€Ί configuration/defaultSettings.spec.ts:23:7 β€Ί Default Settings tests β€Ί PMM-T1659 Verify that BM is enabled by default after upgrade in 2.36.0+ @config-post-upgrade @config
🎭 Playwright Run Summary
3 skipped
🎭 Playwright Run Summary
3 skipped
🎭 Playwright Run Summary
3 skipped
🎭 Playwright Run Summary
3 skipped
🎭 Playwright Run Summary
3 skipped
🎭 Playwright Run Summary
3 skipped
🎭 Playwright Run Summary
3 skipped
🎭 Playwright Run Summary
3 skipped
🎭 Playwright Run Summary
2 passed (3.0m)
🎭 Playwright Run Summary
1 passed (1.1s)
🎭 Playwright Run Summary
1 skipped
🎭 Playwright Run Summary
1 passed (1.2s)
🎭 Playwright Run Summary
2 passed (4.2m)
🎭 Playwright Run Summary
1 skipped
🎭 Playwright Run Summary
2 passed (4.1m)
🎭 Playwright Run Summary
1 passed (1.1s)
🎭 Playwright Run Summary
1 skipped
🎭 Playwright Run Summary
2 passed (4.2m)
🎭 Playwright Run Summary
1 passed (1.0s)
🎭 Playwright Run Summary
1 passed (992ms)
🎭 Playwright Run Summary
2 passed (4.8m)
🎭 Playwright Run Summary
1 passed (1.0s)
🎭 Playwright Run Summary
1 passed (1.0s)
🎭 Playwright Run Summary
1 passed (1.3s)
🎭 Playwright Run Summary
2 passed (4.9m)
🎭 Playwright Run Summary
1 passed (1.3s)
🎭 Playwright Run Summary
1 skipped
🎭 Playwright Run Summary
1 passed (1.4s)
🎭 Playwright Run Summary
2 passed (4.8m)
🎭 Playwright Run Summary
2 passed (4.7m)
🎭 Playwright Run Summary
1 passed (1.2s)
🎭 Playwright Run Summary
1 passed (1.2s)
🎭 Playwright Run Summary
2 passed (5.5m)
🎭 Playwright Run Summary
1 passed (1.5s)
🎭 Playwright Run Summary
1 passed (1.5s)
🎭 Playwright Run Summary
2 passed (5.4m)
🎭 Playwright Run Summary
1 passed (1.4s)
🎭 Playwright Run Summary
1 passed (1.5s)
🎭 Playwright Run Summary
2 failed [chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts:15:7 β€Ί Common Upgrade PMM tests β€Ί PMM-T288 Verify user can see Update widget before upgrade [critical] @pmm-upgrade [chromium] β€Ί upgrade/upgradePmmViaUi.spec.ts:22:7 β€Ί Common Upgrade PMM tests β€Ί PMM-T3 Verify user is able to Upgrade PMM version [blocker] @pmm-upgrade
🎭 Playwright Run Summary
1 passed (1.8s)
🎭 Playwright Run Summary
3 passed (5.4m)
🎭 Playwright Run Summary
3 passed (5.5m)
🎭 Playwright Run Summary
3 passed (5.7m)
🎭 Playwright Run Summary
3 passed (6.0m)
🎭 Playwright Run Summary
3 passed (5.5m)
🎭 Playwright Run Summary
3 passed (4.9m)
🎭 Playwright Run Summary
3 passed (6.0m)
🎭 Playwright Run Summary
3 passed (5.6m)
🎭 Playwright Run Summary
3 passed (5.3m)
🎭 Playwright Run Summary
3 passed (6.4m)

Artifacts

Produced during runtime
Name Size
config-2.11.0-report Expired
19.2 MB
rbac-2.11.0-report Expired
409 KB
rbac-2.30.0-report Expired
409 KB
rbac-2.31.0-report Expired
409 KB
rbac-2.32.0-report Expired
409 KB
rbac-2.33.0-report Expired
409 KB
rbac-2.34.0-report Expired
409 KB
rbac-2.35.0-report Expired
28.1 MB
rbac-2.36.0-report Expired
28.4 MB
rbac-2.37.0-report Expired
27.8 MB
rbac-2.37.1-report Expired
27.3 MB
rbac-2.38.0-report Expired
27 MB