Skip to content

Commit

Permalink
minimal e2e test-suite
Browse files Browse the repository at this point in the history
Signed-off-by: psbrar99 <[email protected]>
  • Loading branch information
psbrar99 committed Aug 7, 2023
1 parent a398b93 commit c658958
Show file tree
Hide file tree
Showing 62 changed files with 2,972 additions and 637 deletions.
3 changes: 1 addition & 2 deletions .github/ISSUE_TEMPLATE/bug_report.yml
Original file line number Diff line number Diff line change
Expand Up @@ -34,15 +34,14 @@ body:
attributes:
label: Additional Information
description: |
Please include the output of [`istioctl bug-report`](https://istio.io/help/bugs/#generating-a-cluster-state-archive).
Please include the output of [`istioctl bug-report`](http://istio.io/help/bugs/#generating-a-cluster-state-archive).
If you are unable to do so, please ensure you have collected the relevant debugging information manually and attached below;
issue without enough information will not be resolvable.
- type: checkboxes
id: area
attributes:
label: Affected product area
options:
- label: "Ambient"
- label: "Docs"
- label: "Installation"
- label: "Networking"
Expand Down
1 change: 0 additions & 1 deletion .github/ISSUE_TEMPLATE/feature_request.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,6 @@ about: Suggest an idea to improve Istio

**Affected product area (please put an X in all that apply)**

[ ] Ambient
[ ] Docs
[ ] Installation
[ ] Networking
Expand Down
1 change: 0 additions & 1 deletion .github/pull_request_template.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,6 @@

**To help us figure out who should review this PR, please put an X in all the areas that this PR affects.**

- [ ] Ambient
- [ ] Configuration Infrastructure
- [ ] Docs
- [ ] Installation
Expand Down
374 changes: 324 additions & 50 deletions .github/workflows/e2e_tests.yml

Large diffs are not rendered by default.

310 changes: 275 additions & 35 deletions .github/workflows/make_release.yml

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion .github/workflows/tools.yml
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ on:
required: true

jobs:
build_tools_docker_arm64:
build_tools_docker:
name: build tools docker
runs-on: ["self-hosted", "arm64"]
env:
Expand Down
44 changes: 44 additions & 0 deletions tetrateci/1.12/test/skip.d/eks-arm64
Original file line number Diff line number Diff line change
@@ -0,0 +1,44 @@
# e2e tests to skip (until a long-term fix is found)
#
# Each line has format:
#
# ```text
# <pkg>=<test1> <test2> <test3> ...
# ```
#
# where
# 1. <pkg> - is a name of a package with Istio e2e tests, e.g.
# `istio.io/istio/tests/integration/pilot`
# 2. <testN> - is a regexp that matches unit tests to skip, e.g.
# 'TestA', 'TestA|TestB|TestC', 'TestA/case-b', etc.
# Each `<testN>` value will be translated into the
# `--istio.test.skip` option of the Istio Test Framework.
#
# A special case,
#
# ```text
# <pkg>=*
# ```
#
# indicates that tests for the package `<pkg>` should not be run at all.

istio.io/istio/tests/integration/helm/upgrade=*

istio.io/istio/tests/integration/pilot=*
istio.io/istio/tests/integration/pilot/endpointslice=*
istio.io/istio/tests/integration/pilot/revisions=TestMultiRevision

istio.io/istio/tests/integration/security=*
istio.io/istio/tests/integration/security/sds_ingress=*
istio.io/istio/tests/integration/security/sds_tls_origination=TestSimpleTlsOrigination TestMutualTlsOrigination

istio.io/istio/tests/integration/telemetry/stats/prometheus/nullvm=TestAccessLogs
istio.io/istio/tests/integration/telemetry/tracing/zipkin/clienttracing=TestClientTracing
istio.io/istio/tests/integration/telemetry/tracing/zipkin/servertracing=TestProxyTracing

istio.io/istio/tests/integration/telemetry/stackdriver=*
istio.io/istio/tests/integration/telemetry/stackdriver/api=*
istio.io/istio/tests/integration/telemetry/stackdriver/vm=*

istio.io/istio/tests/integration/telemetry/tracing/opencensusagent=*
istio.io/istio/tests/integration/telemetry/policy=*
6 changes: 3 additions & 3 deletions tetrateci/1.13/test/skip.d/eks
Original file line number Diff line number Diff line change
Expand Up @@ -22,9 +22,9 @@
#
# indicates that tests for the package `<pkg>` should not be run at all.

istio.io/istio/tests/integration/helm/upgrade=*
istio.io/istio/tests/integration/pilot/revisions=*
istio.io/istio/tests/integration/security/sds_ingress/quic=*
istio.io/istio/tests/integration/helm/upgrade=TestRevisionTagsUpgradeFromPrevious
MinorRelease

istio.io/istio/tests/integration/pilot=TestIngress/status

istio.io/istio/tests/integration/telemetry/tracing/zipkin/servertracing=TestProxyTracing
Expand Down
43 changes: 43 additions & 0 deletions tetrateci/1.13/test/skip.d/eks-arm64
Original file line number Diff line number Diff line change
@@ -0,0 +1,43 @@
# e2e tests to skip (until a long-term fix is found)
#
# Each line has format:
#
# ```text
# <pkg>=<test1> <test2> <test3> ...
# ```
#
# where
# 1. <pkg> - is a name of a package with Istio e2e tests, e.g.
# `istio.io/istio/tests/integration/pilot`
# 2. <testN> - is a regexp that matches unit tests to skip, e.g.
# 'TestA', 'TestA|TestB|TestC', 'TestA/case-b', etc.
# Each `<testN>` value will be translated into the
# `--istio.test.skip` option of the Istio Test Framework.
#
# A special case,
#
# ```text
# <pkg>=*
# ```
#
# indicates that tests for the package `<pkg>` should not be run at all.

istio.io/istio/tests/integration/helm/upgrade=*

istio.io/istio/tests/integration/pilot=*
istio.io/istio/tests/integration/pilot/endpointslice=*
istio.io/istio/tests/integration/pilot/revisions=TestMultiRevision

istio.io/istio/tests/integration/security=*
istio.io/istio/tests/integration/security/sds_ingress/quic=*
istio.io/istio/tests/integration/security/https_jwt=*
istio.io/istio/tests/integration/security/sds_ingress=*
istio.io/istio/tests/integration/security/sds_tls_origination=TestSimpleTlsOrigination TestMutualTlsOrigination

istio.io/istio/tests/integration/telemetry/tracing/zipkin/clienttracing=TestClientTracing
istio.io/istio/tests/integration/telemetry/tracing/zipkin/servertracing=TestProxyTracing
istio.io/istio/tests/integration/telemetry/stackdriver=*
istio.io/istio/tests/integration/telemetry/stackdriver/api=*
istio.io/istio/tests/integration/telemetry/stackdriver/vm=*
istio.io/istio/tests/integration/telemetry/tracing/opencensusagent=*
istio.io/istio/tests/integration/telemetry/policy=*
11 changes: 4 additions & 7 deletions tetrateci/1.13/test/skip.d/gke
Original file line number Diff line number Diff line change
Expand Up @@ -20,14 +20,11 @@
# <pkg>=*
# ```
#
# Indicates that tests for the package `<pkg>` should not be run at all.
# indicates that tests for the package `<pkg>` should not be run at all.

istio.io/istio/tests/integration/helm/upgrade=TestRevisionTagsUpgradeFromPrevious
MinorRelease

istio.io/istio/tests/integration/helm=*
istio.io/istio/tests/integration/helm/upgrade=*
istio.io/istio/tests/integration/security=TestReachability/beta-mtls-off
istio.io/istio/tests/integration/security/sds_ingress/quic=*
istio.io/istio/tests/integration/security/mtls_first_party_jwt=*
istio.io/istio/tests/integration/security/https_jwt=TestJWTHTTPS/jwt-authn/a/to_b/valid-token-forward-remote-jwks
istio.io/istio/tests/integration/pilot=TestGateway TestIngress TestDescribe TestTraffic

istio.io/istio/tests/integration/telemetry/stackdriver=*
33 changes: 33 additions & 0 deletions tetrateci/1.14/test/skip.d/eks
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
# e2e tests to skip (until a long-term fix is found)
#
# Each line has format:
#
# ```text
# <pkg>=<test1> <test2> <test3> ...
# ```
#
# where
# 1. <pkg> - is a name of a package with Istio e2e tests, e.g.
# `istio.io/istio/tests/integration/pilot`
# 2. <testN> - is a regexp that matches unit tests to skip, e.g.
# 'TestA', 'TestA|TestB|TestC', 'TestA/case-b', etc.
# Each `<testN>` value will be translated into the
# `--istio.test.skip` option of the Istio Test Framework.
#
# A special case,
#
# ```text
# <pkg>=*
# ```
#
# indicates that tests for the package `<pkg>` should not be run at all.

istio.io/istio/tests/integration/helm/upgrade=TestRevisionTagsUpgradeFromPrevious
MinorRelease

istio.io/istio/tests/integration/pilot=TestIngress/status

istio.io/istio/tests/integration/telemetry/tracing/zipkin/servertracing=TestProxyTracing

istio.io/istio/tests/integration/telemetry/stackdriver=*
istio.io/istio/tests/integration/telemetry/stackdriver/vm=*
27 changes: 27 additions & 0 deletions tetrateci/1.14/test/skip.d/eks-arm64
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
# e2e tests to skip (until a long-term fix is found)
#
# Each line has format:
#
# ```text
# <pkg>=<test1> <test2> <test3> ...
# ```
#
# where
# 1. <pkg> - is a name of a package with Istio e2e tests, e.g.
# `istio.io/istio/tests/integration/pilot`
# 2. <testN> - is a regexp that matches unit tests to skip, e.g.
# 'TestA', 'TestA|TestB|TestC', 'TestA/case-b', etc.
# Each `<testN>` value will be translated into the
# `--istio.test.skip` option of the Istio Test Framework.
#
# A special case,
#
# ```text
# <pkg>=*
# ```
#
# indicates that tests for the package `<pkg>` should not be run at all.

istio.io/istio/tests/integration/pilot=TestGatewayConformance
istio.io/istio/tests/integration/helm/upgrade=*
istio.io/istio/tests/integration/security/sds_ingress/quic=*
37 changes: 37 additions & 0 deletions tetrateci/1.14/test/skip.d/gke
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
# e2e tests to skip (until a long-term fix is found)
#
# Each line has format:
#
# ```text
# <pkg>=<test1> <test2> <test3> ...
# ```
#
# where
# 1. <pkg> - is a name of a package with Istio e2e tests, e.g.
# `istio.io/istio/tests/integration/pilot`
# 2. <testN> - is a regexp that matches unit tests to skip, e.g.
# 'TestA', 'TestA|TestB|TestC', 'TestA/case-b', etc.
# Each `<testN>` value will be translated into the
# `--istio.test.skip` option of the Istio Test Framework.
#
# A special case,
#
# ```text
# <pkg>=*
# ```
#
# indicates that tests for the package `<pkg>` should not be run at all.

istio.io/istio/tests/integration/helm/upgrade=TestRevisionTagsUpgradeFromPrevious
MinorRelease

istio.io/istio/tests/integration/pilot=TestGateway TestIngress TestDescribe TestTraffic
istio.io/istio/tests/integration/helm=*
istio.io/istio/tests/integration/helm/upgrade=*
istio.io/istio/tests/integration/security=TestReachability/beta-mtls-off
istio.io/istio/tests/integration/security/sds_ingress/quic=*
istio.io/istio/tests/integration/security/mtls_first_party_jwt=*
istio.io/istio/tests/integration/security/https_jwt=TestJWTHTTPS/jwt-authn/a/to_b/valid-token-forward-remote-jwks
istio.io/istio/tests/integration/pilot=TestGateway TestIngress TestDescribe TestTraffic
istio.io/istio/tests/integration/telemetry/stackdriver=*
istio.io/istio/tests/integration/telemetry/stackdriver=*
27 changes: 27 additions & 0 deletions tetrateci/1.15/test/skip.d/eks
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
# e2e tests to skip (until a long-term fix is found)
#
# Each line has format:
#
# ```text
# <pkg>=<test1> <test2> <test3> ...
# ```
#
# where
# 1. <pkg> - is a name of a package with Istio e2e tests, e.g.
# `istio.io/istio/tests/integration/pilot`
# 2. <testN> - is a regexp that matches unit tests to skip, e.g.
# 'TestA', 'TestA|TestB|TestC', 'TestA/case-b', etc.
# Each `<testN>` value will be translated into the
# `--istio.test.skip` option of the Istio Test Framework.
#
# A special case,
#
# ```text
# <pkg>=*
# ```
#
# indicates that tests for the package `<pkg>` should not be run at all.

istio.io/istio/tests/integration/pilot=TestGatewayConformance TestIngress/status
istio.io/istio/tests/integration/helm/upgrade=*
istio.io/istio/tests/integration/security/sds_ingress/quic=*
27 changes: 27 additions & 0 deletions tetrateci/1.15/test/skip.d/eks-arm64
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
# e2e tests to skip (until a long-term fix is found)
#
# Each line has format:
#
# ```text
# <pkg>=<test1> <test2> <test3> ...
# ```
#
# where
# 1. <pkg> - is a name of a package with Istio e2e tests, e.g.
# `istio.io/istio/tests/integration/pilot`
# 2. <testN> - is a regexp that matches unit tests to skip, e.g.
# 'TestA', 'TestA|TestB|TestC', 'TestA/case-b', etc.
# Each `<testN>` value will be translated into the
# `--istio.test.skip` option of the Istio Test Framework.
#
# A special case,
#
# ```text
# <pkg>=*
# ```
#
# indicates that tests for the package `<pkg>` should not be run at all.

istio.io/istio/tests/integration/pilot=TestGatewayConformance
istio.io/istio/tests/integration/helm/upgrade=*
istio.io/istio/tests/integration/security/sds_ingress/quic=*
37 changes: 37 additions & 0 deletions tetrateci/1.15/test/skip.d/gke
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
# e2e tests to skip (until a long-term fix is found)
#
# Each line has format:
#
# ```text
# <pkg>=<test1> <test2> <test3> ...
# ```
#
# where
# 1. <pkg> - is a name of a package with Istio e2e tests, e.g.
# `istio.io/istio/tests/integration/pilot`
# 2. <testN> - is a regexp that matches unit tests to skip, e.g.
# 'TestA', 'TestA|TestB|TestC', 'TestA/case-b', etc.
# Each `<testN>` value will be translated into the
# `--istio.test.skip` option of the Istio Test Framework.
#
# A special case,
#
# ```text
# <pkg>=*
# ```
#
# indicates that tests for the package `<pkg>` should not be run at all.

istio.io/istio/tests/integration/pilot=TestGateway TestIngress TestDescribe TestTraffic TestGatewayConformance TestTunnelingOutboundTraffic
istio.io/istio/tests/integration/pilot/revisioncmd=*
istio.io/istio/tests/integration/helm=*
istio.io/istio/tests/integration/helm/upgrade=*
istio.io/istio/tests/integration/security=TestReachability/beta-mtls-off TestAuthz_EgressGateway TestReachability/global_no_peer_authn/http
istio.io/istio/tests/integration/security/sds_ingress/quic=*
istio.io/istio/tests/integration/security/mtls_first_party_jwt=*
istio.io/istio/tests/integration/security/https_jwt=TestJWTHTTPS/jwt-authn/a/to_b/valid-token-forward-remote-jwks
istio.io/istio/tests/integration/security/filebased_tls_origination=TestEgressGatewayTls
istio.io/istio/tests/integration/telemetry/outboundtrafficpolicy=*
istio.io/istio/tests/integration/telemetry/stats/prometheus/nullvm=*
istio.io/istio/tests/integration/telemetry/stats/prometheus/wasm=*
istio.io/istio/tests/integration/telemetry/stackdriver=*
29 changes: 29 additions & 0 deletions tetrateci/1.16/test/skip.d/eks
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
# e2e tests to skip (until a long-term fix is found)
#
# Each line has format:
#
# ```text
# <pkg>=<test1> <test2> <test3> ...
# ```
#
# where
# 1. <pkg> - is a name of a package with Istio e2e tests, e.g.
# `istio.io/istio/tests/integration/pilot`
# 2. <testN> - is a regexp that matches unit tests to skip, e.g.
# 'TestA', 'TestA|TestB|TestC', 'TestA/case-b', etc.
# Each `<testN>` value will be translated into the
# `--istio.test.skip` option of the Istio Test Framework.
#
# A special case,
#
# ```text
# <pkg>=*
# ```
#
# indicates that tests for the package `<pkg>` should not be run at all.

istio.io/istio/tests/integration/telemetry/stackdriver=*
istio.io/istio/tests/integration/telemetry/stackdriver/vm=*
istio.io/istio/tests/integration/pilot=TestGatewayConformance TestIngress/status
istio.io/istio/tests/integration/helm/upgrade=*
istio.io/istio/tests/integration/security/sds_ingress/quic=*
Loading

0 comments on commit c658958

Please sign in to comment.