karmada v1.2.2 release

Changes since v1.2.1

Bug Fixes

• karmadactl: Fixed a panic issue when retrieving resources from an unknown cluster(karmadactl get xxx --cluster=not-exist). (#2171, #2201, @my-git9)
• karmadactl: Fix Kubernetes v1.24 can not be joined issue. (#1972, @zgfh)
• karmada-controller-manager: Fixed Argo CD can not assess Deployment health status issue. (#2256, @xuqianjins)
• karmada-controller-manager: Fixed Argo CD can not assess StatefulSet/DaemonSet health status issue. (#2264, @RainbowMango)
• karmada-search: Fixed can not query a single namespace issue. (#2274, @luoMonkeyKing)
• karmada-search: Fixed panic issue when dumps error info. (#2333, @AllenZMC)
• Helm Chart: Fixed misconfigured MutatingWebhookConfiguration and added missing APIService configuration for karmada-aggregated-apiserver. (#2420, @zhixian82)

karmada v1.1.4 release

Changes since v1.1.3

Bug Fixes

• karmadactl: Fix Kubernetes v1.24 can not be joined issue. (#2199, @zgfh)
• Helm Chart: Fixed misconfigured MutatingWebhookConfiguration and added missing APIService configuration for karmada-aggregated-apiserver. (#2421, @zhixian82)

karmada v1.0.5 release

Changes since v1.0.4

Bug Fixes

• karmadactl: Fixed Kubernetes v1.24 can not be joined issue. (#2200, @zgfh)
• Helm Chart: Fixed misconfigured MutatingWebhookConfiguration and added missing APIService configuration for karmada-aggregated-apiserver. (#2422, @zhixian82)

karmada v1.2.1 release

Changes since v1.2.0

Bug Fixes

• karmada-search: Fixed panic when the resource annotation is nil. (#1939, @XiShanYongYe-Chang )
• karmada-search: Fixed a panic issue comparing uncomparable type cache.ResourceEventHandlerFuncs. (#1971, @liys87x )
• karmadactl: fixed promoting failed if a resource with another kind using the same name has been promoted before. (#1983, @wuyingjun-lucky )
• karmadactl: Removed --dry-run flag from describe, exec and log commands. (#2036, @wlp1153468871 )
• karmada-controller-manager: Fixed Job status might be incorrectly marked as Completed issue. (#2007, @Garrybest )
• karmada-controller-manager/karmada-agent : fixed panic issue when dumps error info. (#2127, @AllenZMC )

karmada v1.0.4 release

Changes since v1.0.3

Bug Fixes

• karmadactl: Fixed namespace can not be customized issue. (#1826, @likakuli)
• karmadactl: fixed can not taint while karmada control plane config is not located on default path. (#1837, @wuyingjun-lucky)
• karmada-controller-manager: Fixed Job status might be incorrectly marked as Completed issue. (#2011, @Garrybest)
• karmada-controller-manager/karmada-agent : fixed panic issue when dumps error info. (#2133, @AllenZMC)

karmada v1.1.3 release

Changes since v1.1.2

Bug Fixes

• karmadactl: Fixed namespace can not be customized issue. (#1827, @likakuli )
• karmadactl: fixed karmadactl can not taint while karmada control plane config is not located on default path. (#1838, @wuyingjun-lucky )
• karmada-controller-manager: Fixed Job status might be incorrectly marked as Completed issue. (#2010, @Garrybest )
• karmada-controller-manager/karmada-agent : fixed panic issue when dumps error info. (#2126, @AllenZMC )

karmada v1.2.0 release

What's New

Significant improvement on scheduling capability and scalability

1. Karmada Descheduler

A new component karmada-descheduler was introduced, for rebalancing the scheduling decisions over time.
One example use case is: it helps evict pending replicas (Pods) from resource-starved clusters so that karmada-scheduler can "reschedule" these replicas (Pods) to a cluster with sufficient resources.
For more details please refer to Descheduler user guide.

(Feature contributor: @Garrybest)

2. Multi region HA support

By leveraging the newly added spread-by-region constraint, users are now able to deploy workloads aross regions, e.g. people may want their workloads always running on different regions for HA purposes.
We also introduced two plugins to karmada-scheduler, which add to accurate scheduling.

• ClusterLocality is a scoring plugin that favors clusters already assigned.
• SpreadConstraint is a filter plugin that filters clusters as per spread constraints.

(Feature contributors: @huone1, @gf457832386)

We are also in the progress of enhancing the multi-cluster failover mechanism. Part of the work has been included in this release.
For example:

• A new flag(--cluster-failure-threshold) has been added to both karmada-controller-manager and karmada-agent, which specifies the cluster failure threshold (defaults to 30s). A cluster will be considered not-ready only when it stays unhealthy longer than supposed.
• A new flag(--failover-eviction-timeout) has been added to karmada-controller-manager, which specifies the grace period of eviction (defaults to 5 minutes). If a cluster stays not-ready longer than supposed, the controller taints the cluster. (Note: The taint is essentially the eviction order and the implementation is planned for the next release.)

(Feature contributors: @Garrybest, @dddddai)

Fully adopted aggregated API

The Aggregated API was initially introduced in Release 1.0, which allows users to access clusters through Karmada by a single aggregated API endpoint. By leveraging this feature, we introduced a lot of interesting features to karmadactl and kubectl-karmada.

1. The get sub-command now supports clusters both in push and pull mode.

# karmadactl get deployment -n default
NAME      CLUSTER   READY   UP-TO-DATE   AVAILABLE   AGE     ADOPTION
nginx     member1   2/2     2            2           33h     N
nginx     member2   1/1     1            1           4m38s   Y
podinfo   member3   2/2     2            2           27h     N

2. The newly added logs command prints the container logs in a specific cluster.

# ./karmadactl logs nginx-6799fc88d8-9mpxn -c nginx  -C member1
/docker-entrypoint.sh: /docker-entrypoint.d/ is not empty, will attempt to perform configuration
/docker-entrypoint.sh: Looking for shell scripts in /docker-entrypoint.d/
/docker-entrypoint.sh: Launching /docker-entrypoint.d/10-listen-on-ipv6-by-default.sh
10-listen-on-ipv6-by-default.sh: info: Getting the checksum of /etc/nginx/conf.d/default.conf
...

3. We also added watch and exec commands to karmadactl, in addition to get and logs. They all use the aggregated API.

(Feature contributor: @lonelyCZ)

Distributed search and analytics engine for Kubernetes resources (alpha)

The newly introduced karmada-search caches resources in clusters and allows users to search for resources without directly touching real clusters.

# kubectl get --raw /apis/search.karmada.io/v1alpha1/search/cache/apis/apps/v1/deployments
{
	"apiVersion": "v1",
	"kind": "List",
	"metadata": {},
	"items": [{
		"apiVersion": "apps/v1",
		"kind": "Deployment",
		"metadata": {
			"annotations": {
				"cluster.karmada.io/name": "member1",
			},
		}
	},
	]
}

The karmada-search also supports syncing cached resources to backend stores like Elasticsearch or OpenSearch. By leveraging the search engine, you can perform full-text searches with all desired features, by field, and by indice; rank results by score, sort results by field, and aggregate results.

(Feature contributors: @huntsman-li, @liys87x)

Resource Interpreter Webhook enhancement

Introduced InterpretStatus for the Resource Interpreter Webhook framework, which enables customized resource status collection.
Karmada can thereby learn how to collect status for your resources, especially custom resources. For example, a custom resource may have many status fields and only Karmada can collect only those you want.

Refer to [Customizing Resource Interpreter][https://github.com/karmada-io/karmada/blob/master/docs/userguide/customizing-resource-interpreter.md] for more details.

(Feature contributor: @XiShanYongYe-Chang)

Integrating verification with the ecosystem

Benefiting from the Kubernetes native APIs, Karmada can easily integrate the Kubernetes ecosystem. The following components are verified by the Karmada community:

• Kyverno: policy engine. Refer to working with kyverno for more details.
• Gatekeeper: another policy engine. Refer to working with gatekeeper for more details.
• fluxcd: GitOps tooling for helm chart. Refer to working with fluxcd for more details.

(Feature contributors: @Poor12, @learner0810)

Other Notable Changes

Bug Fixes

• karmadactl: Fixed the cluster joining failures in the case of legacy secrets. (@zgfh, #1306)
• karmadactl: Fixed the issue that you cannot use the '-v 6' log level. (@zgfh, #1426)
• karmadactl: Fixed the issue that the --namespace flag of init command did not work. (@sayaoailun, #1416)
• karmadactl: Allowed namespaces to be customized. (@sayaoailun, #1449)
• karmadactl: Fixed the init failure due to data path not clean. (@prodanlabs, #1455)
• karmadactl: Fixed the init failure to read the KUBECONFIG environment variable. (@lonelyCZ, #1437)
• karmadactl: Fixed the init command failure to select the default release version. (@prodanlabs, #1456)
• karmadactl: Fixed the issue that the karmada-system namespace already exists when deploying karmada-agent. (@hanweisen, #1604)
• karmadactl: Fixed the issue that the karmada-controller-manager args did not honor customized namespaces.` (@prodanlabs, #1683)
• karmadactl: Fixed a panic due to nil annotation when promoting resources to Karmada.` (@duanmengkk, #1759)
• karmadactl: Fixed the promote command failure to migrate cluster-scoped resources. (@duanmengkk, #1766)
• karmadactl: fixed the karmadactl taint failure while the karmada control plane config is not located in the default path. (@wuyingjun-lucky, #1825)
• helm-chart: Fixed the karmada-agent installation failure due to the lack of permission. (@AllenZMC, #1457)
• helm-chart: Fixed the issue that version constraints skip pre-releases. (@pigletfly, #1444)
• karmada-controller-manager: Fixed the issue that ResourceBinding may hinder en-queue in the case of schedule failures. (@mrlihanbo, #1499)
• karmada-controller-manager: Fixed the panic when the interpreter webhook returns nil patch. (@CharlesQQ, #1584)
• karmada-controller-manager: Fixed the RB/CRB controller failure to aggregate status in the case of work condition update. (@mrlihanbo, #1513)
• karmada-aggregate-apiserver: Fixed timeout issue when requesting cluster/proxy with options -w or logs -f from karmadactl get. (@XiShanYongYe-Chang, #1620)
• karmada-aggregate-apiserver: Fixed exec failed: error: unable to upgrade connection: you must specify at least 1 of stdin, stdout, stderr. (@pangsq, #1632)

Features & Enhancements

• karmada-controller-manager: Introduced several flags to specify controller's concurrent capacities(--rate-limiter-base-delay, --rate-limiter-max-delay, --rate-limiter-qps, --rate-limiter-bucket-size). (@pigletfly, #1399)
• karmada-controller-manager: The klog flags now have been grouped for better readability. (@RainbowMango, #1468)
• karmada-controller-manager: Fixed the FullyApplied condition of ResourceBinding/ClusterResourceBinding mislabeling issue in the case of non-scheduling. (@huone1, #1512)
• karmada-controller-manager: Added default AggregateStatus webhook for DaemonSet and StatefulSet. (@Poor12, #1586)
• `karmada-controll...

karmada v1.1.2 release

Changes since v1.1.1

Bug Fixes

• karmadactl: fixed the karmada-systemnamespace already existing issue when deployingkarmada-agent` issue. (#1608, @hanweisen)
• karmadactl: Fixed karmada-controller-manager args not honor customized namespace issue. (#1689, @prodanlabs)
• karmada-controller-manager: Fixed ResourceBinding maybe prevents en-queue in case of schedule failure. (#1507, @mrlihanbo)
• karmada-controller-manager: Fixed the FullyApplied condition of ResourceBinding/ClusterResourceBinding mislabeling issue in case of non-scheduled. (#1517, @huone1)
• karmada-controller-manager: Fixed RB/CRB controller can't aggregate status in case of work condition update issue. (#1523, @mrlihanbo)
• karmada-controller-manager: Fixed panic in case of interpreter webhook returns nil patch. (#1592, @CharlesQQ)
• karmada-aggregate-apiserver: Fixed timeout issue when request cluster/proxy with options -w or logs -f from karmadactl get. (#1630, @XiShanYongYe-Chang)
• karmada-aggregate-apiserver: Fixed exec failed: error: unable to upgrade connection: you must specify at least 1 of stdin, stdout, stderr. (#1642, @XiShanYongYe-Chang)

Other

• The base image alpine has been promoted to v3.15.1. (#1583, @RainbowMango)

karmada v1.0.3 release

Changes since v1.0.2

Bug Fixes

• karmadactl: fixed the karmada-systemnamespace already existing issue when deployingkarmada-agent` issue. (#1609, @hanweisen)
• karmadactl: Fixed karmada-controller-manager args not honor customized namespace issue. (#1690, @prodanlabs)
• karmada-controller-manager: Fixed the FullyApplied condition of ResourceBinding/ClusterResourceBinding mislabeling issue in case of non-scheduled. (#1518, @huone1)
• karmada-controller-manager: Fixed RB/CRB controller can't aggregate status in case of work condition update issue. (#1524, @mrlihanbo)
• karmada-controller-manager: Fixed panic in case of interpreter webhook returns nil patch. (#1591, @CharlesQQ)
• karmada-aggregate-apiserver: Fixed timeout issue when request cluster/proxy with options -w or logs -f from karmadactl get. (#1631, @XiShanYongYe-Chang)
• karmada-aggregate-apiserver: Fixed exec failed: error: unable to upgrade connection: you must specify at least 1 of stdin, stdout, stderr. (#1641, @pangsq)

Other

• The base image alpine has been promoted to v3.15.1. (#1582, @RainbowMango)

karmada v1.0.2 release

Changes since v1.0.1

Bug Fixes

• karmadactl: Fixed --namespace flag of init command not work issue. (#1452, @sayaoailun)
• karmadactl: Fixed init failure due to data path not clean issue. (#1473, @prodanlabs)
• karmadactl: Fixed init can not select default release version issue. (#1495, @prodanlabs)
• karmadactl: Fixed init can not read KUBECONFIG environment variable issue. (#1482, @lonelyCZ)
• helm chart: Fixed version constraints skip the pre-releases issue. (#1466, @pigletfly)
• karmada-controller-manager: Fixed a bug where resource binding is not created occasionally. (#1384, @dddddai)