Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test(e2e): stabilize flaky imagery tests #7765

Merged
merged 24 commits into from
Jul 24, 2024
Merged

Conversation

ozyx
Copy link
Member

@ozyx ozyx commented Jul 1, 2024

Closes #7769
Note: merge #7762 first

Describe your changes:

  • stabilizes the imagery tests
  • introduce new rule for vue/component-name-in-template-casing': ['error', 'PascalCase']

All Submissions:

  • Have you followed the guidelines in our Contributing document?
  • Have you checked to ensure there aren't other open Pull Requests for the same update/change?
  • Is this a notable change that will require a special callout in the release notes? For example, will this break compatibility with existing APIs or projects that consume these plugins?

Author Checklist

  • Changes address original issue?
  • Tests included and/or updated with changes?
  • Has this been smoke tested?
  • Have you associated this PR with a type: label? Note: this is not necessarily the same as the original issue.
  • Have you associated a milestone with this PR? Note: leave blank if unsure.
  • Testing instructions included in associated issue OR is this a dependency/testcase change?

Reviewer Checklist

  • Changes appear to address issue?
  • Reviewer has tested changes by following the provided instructions?
  • Changes appear not to be breaking changes?
  • Appropriate automated tests included?
  • Code style and in-line documentation are appropriate?

@ozyx ozyx added this to the Target:4.0.0 milestone Jul 1, 2024
@ozyx ozyx requested a review from unlikelyzero July 1, 2024 17:40
@ozyx ozyx force-pushed the fix-unstable-tests-in-imagery branch from 6f103d1 to d1da4ff Compare July 1, 2024 17:41
Copy link

codecov bot commented Jul 1, 2024

Codecov Report

Attention: Patch coverage is 42.10526% with 11 lines in your changes missing coverage. Please review.

Project coverage is 56.81%. Comparing base (1fae0a6) to head (d8eab43).

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #7765      +/-   ##
==========================================
- Coverage   57.07%   56.81%   -0.26%     
==========================================
  Files         674      674              
  Lines       27273    27278       +5     
  Branches     2665     2668       +3     
==========================================
- Hits        15566    15499      -67     
- Misses      11367    11439      +72     
  Partials      340      340              
Flag Coverage Δ
e2e-full 23.51% <ø> (-18.42%) ⬇️
e2e-stable 60.85% <ø> (+0.11%) ⬆️
unit 49.36% <42.10%> (-0.05%) ⬇️
Files Coverage Δ
src/api/forms/components/controls/LocatorField.vue 0.00% <ø> (ø)
src/plugins/LADTable/components/LadTable.vue 45.07% <ø> (ø)
src/plugins/LADTable/components/LadTableSet.vue 52.94% <ø> (ø)
...c/plugins/charts/bar/inspector/BarGraphOptions.vue 52.67% <ø> (ø)
...c/plugins/charts/scatter/inspector/PlotOptions.vue 60.00% <ø> (ø)
src/plugins/condition/components/ConditionItem.vue 0.00% <ø> (ø)
...ins/condition/components/inspector/StyleEditor.vue 51.85% <ø> (ø)
...gins/condition/components/inspector/StylesView.vue 49.85% <ø> (ø)
src/plugins/displayLayout/components/BoxView.vue 0.00% <ø> (ø)
...c/plugins/displayLayout/components/EllipseView.vue 0.00% <ø> (ø)
... and 61 more

... and 7 files with indirect coverage changes


Continue to review full report in Codecov by Sentry.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1fae0a6...d8eab43. Read the comment docs.

@ozyx ozyx added the type:maintenance tests, chores, or project maintenance label Jul 1, 2024
@ozyx ozyx marked this pull request as ready for review July 2, 2024 16:29
@ozyx ozyx requested a review from unlikelyzero July 2, 2024 16:29
@unlikelyzero unlikelyzero added the pr:e2e:couchdb npm run test:e2e:couchdb label Jul 2, 2024
@github-actions github-actions bot removed the pr:e2e:couchdb npm run test:e2e:couchdb label Jul 2, 2024
@ozyx ozyx force-pushed the fix-unstable-tests-in-imagery branch from 09ecf3c to f212823 Compare July 16, 2024 16:08
Copy link
Collaborator

@unlikelyzero unlikelyzero left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

2 questions

Copy link
Collaborator

@unlikelyzero unlikelyzero left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

1 change
and a few instances of documentation needed as comments

@ozyx ozyx force-pushed the fix-unstable-tests-in-imagery branch from f212823 to 0c90016 Compare July 17, 2024 18:04
@ozyx ozyx force-pushed the fix-unstable-tests-in-imagery branch from 05f861a to f63b97b Compare July 23, 2024 18:15
ozyx added 5 commits July 23, 2024 12:01
- add class for `is-panning` and wait on it in the tests
- use mock clock to fast forward in time
- add a11y for thumbnails
- increase mouse yDelta for more consistent behavior
- some locator improvements but it's still fairly atrocious
// We mock the clock so that we don't need to wait for time driven events
// to verify functionality.
await page.clock.setSystemTime(MISSION_TIME);
await page.clock.resume();
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

6mb.gif

@ozyx ozyx added the pr:e2e:couchdb npm run test:e2e:couchdb label Jul 24, 2024
@@ -39,7 +39,7 @@ export default merge(common, {
return shouldWrite;
}
},
watchFiles: ['**/*.css'],
watchFiles: ['src/**/*.css', 'example/**/*.css'],
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Webpack was rebuilding when playwright test reports were being generated and updated so let's be explicit

@github-actions github-actions bot removed the pr:e2e:couchdb npm run test:e2e:couchdb label Jul 24, 2024
@ozyx ozyx merged commit 689f7cc into master Jul 24, 2024
27 checks passed
@ozyx ozyx deleted the fix-unstable-tests-in-imagery branch July 24, 2024 03:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type:maintenance tests, chores, or project maintenance
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Implement 'vue/component-name-in-template-casing': ['error', 'PascalCase']
2 participants