feature: CI-based CDK devnets with integration tests

[rebelArtists]

Description

add the following features:

• a github actions workflow that allows cdk eng teams to create and test CDK devnets in less <20min
• cdk eng team can custom-specify the exact commit id OR existing release tag of any upstream CDK repo, and create JIT devnet on the fly using this new github action
• users get a clear go/no-go CI check whether the devnet is behaving as expected (i.e. verifiedBatchNumber is incrementing) and can withstand a series of transactions load tests (via polycli)

How Has This Been Tested?

Fully here, e2e devent workflow and cdk integration tests all working as expected:

• https://github.com/rebelArtists/agglayer/actions/runs/8832585130/job/24250186705

Screenshots (if appropriate):

Additional context

devTools jira ticket: DVT-1464

[vcastellm]

Hi @rebelArtists the time is now for this 😄 , is there a way to specify one or some of the components to be the local repo Dockerfile build instead of an existing versioned image?

[rebelArtists]

@vcastellm current code fully supports any existing released image OR short commit hash (will perform custom container build on the fly) for any upstream CDK repo

supporting local repo Dockerfiles would be custom functionality, would be interesting to better understand the use case and whether supporting commit hash is sufficient

[vcastellm]

Well, actually this is good as it is for the nighly builds use case, but I'm thinking in per PR runs.

Another use case is testing in local, so I can spin up my local Kurtosis setup but exclude the service I want to run in local, but now that I think that's pretty easy to do 😄

[rebelArtists]

note: version is the kurtosis-cdk GitHub action version and should be very latest), this is not the actual kurtosis-cdk repo version

…

On Fri, Jun 21, 2024 at 8:06 AM Victor Castell ***@***.***> wrote: ***@***.**** commented on this pull request. ------------------------------ In .github/workflows/regression-tests.yml <#3 (comment)>: > + description: 0xPolygon/kurtosis-cdk (release tag) + required: false + default: v0.2.0 + bake_time: + description: bake time (minutes) + required: false + default: 30 + +jobs: + regression_tests: + runs-on: ubuntu-latest + steps: + - name: Checkout Repository + uses: ***@***.*** + - name: Run Regression Tests + uses: ***@***.*** Should we update the version? — Reply to this email directly, view it on GitHub <#3 (review)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AX3X7Y2OWPA5I6OHOIVRWQDZIQQMVAVCNFSM6AAAAABGY3AQ7OVHI2DSMVQWIX3LMV43YUDVNRWFEZLROVSXG5CSMV3GSZLXHMZDCMZSGYYTKNJUG4> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[vcastellm]

note: version is the kurtosis-cdk GitHub action version and should be very latest), this is not the actual kurtosis-cdk repo version

Oh yes sorry!

[vcastellm]

Superseded by #11