Container Service for Kubernetes:Terway

Terway version

Kubernetes version

>=v1.10

>=Kubernetes 1.31

v1.9

>=Kubernetes 1.30

v1.8

>=Kubernetes 1.24

Version

Registry address

Update time

Changes

Impact

v1.8.4

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.8.4

April 22, 2024

• Fixed an issue where IP resource pool prefetching failed.

• Improved the idempotence of creating NICs and allocating IP addresses to mitigate resource leak issues.

• Adjusted the CNI configuration sequence to ensure that containers on new nodes are scheduled only after the CNI is fully started and running properly.

This upgrade does not affect your services.

v1.8.3

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.8.3

April 10, 2024

• Supports Red Hat 9.3.

• Fixed an issue where the vSwitch selection policy did not take effect.

• Fixed an issue with elastic Remote Direct Memory Access (eRDMA) quota calculation.

• Fixed an issue where event alerts for invalid resources were too sensitive.

• Fixed a Hubble data collection issue.

• Fixed a forwarding issue in DataPath V2 mode.

This upgrade does not affect your services.

Version

Registry Address

Update time

Changes

Impact

v1.8.0

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.8.0

March 18, 2024

• Supports DataPath V2.

• Supports alibaba-addon-secret for registered clusters.

If you select DataPathV2 or IPvlan when creating a cluster, DataPathV2 is enabled.

v1.7.4

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.7.4

March 18, 2024

Fixed a potential token update failure.

This upgrade does not affect your services.

v1.7.3

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.7.3

March 11, 2024

• Supports LINGJUN Clusters.

• Fixed an issue with eRDMA quota calculation.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact

v1.7.2

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.7.2

February 28, 2024

• Fixed a slow IP allocation issue.

• Fixed an issue where resource prefetching did not take effect.

This upgrade does not affect your services.

v1.7.0

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.7.0

February 18, 2024

• Supports eRDMA.

• Optimized the efficiency of ENI allocation.

• Reduced the pressure on the kube-apiserver in IPvlan mode.

• The elastic IP addresses (EIPs) feature is no longer supported in Terway.

• The minimum supported Kubernetes version is 1.24.

The EIP feature is no longer supported in Terway. To use this feature, see Migrate EIPs from Terway to ack-extend-network-controller.

If you have a large cluster, the load on the kube-apiserver may increase for a short period during the upgrade. Monitor the resource usage of your kube-apiserver.

ACK dedicated clusters use node RAM roles for OpenAPI authentication. Clusters created before March 1, 2020, may lack the vpc:DescribeVSwitches permission. This affects component functionality. For more information about how to add the permission to the node RAM role, see Use RBAC to authorize operations on cluster resources.

Version

Registry address

Update time

Changes

Impact

v1.6.3

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.6.3

January 24, 2024

• Fixed an issue where the Node Condition was overwritten.

• Fixed an issue where node rules were not cleared in policy-based routing mode.

• Fixed an issue where IP addresses were not reclaimed for a long time after stateful applications were released.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact

v1.6.1

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.6.1

November 21, 2023

• Fixed an issue where service backends might not be updated in IPvlan mode.

• Fixed an issue of duplicate IP address allocation.

This upgrade does not affect your services.

v1.4.9

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.9

November 21, 2023

Fixed an issue of duplicate IP address allocation.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact

v1.6.0

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.6.0

October 10, 2023

• Supports migrating EIPs from Terway to ack-extend-network-controller.

• Supports Kind configuration for the terway-controlplane component's stateful applications (StatefulSet).

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact

v1.5.7

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.5.7

August 24, 2023

• Optimized the startup speed of Terway.

• Fixed an occasional health check timeout issue.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact

v1.5.6

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.5.6

July 30, 2023

Supports configuring a custom CNI Chain.

This upgrade does not affect your services.

v1.5.5

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.5.5

July 6, 2023

Supports configuring a whitelist for ENIs.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact

v1.5.4

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.5.4

June 1, 2023

Fixed an issue where network jitter might occur during an upgrade in IPvlan mode.

This upgrade does not affect your services.

v1.4.8

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.8

June 1, 2023

Fixed an issue where network jitter might occur during an upgrade in IPvlan mode.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact of the change

v1.5.3

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.5.3

May 16, 2023

Fixed an issue in v1.4.4 where ExternalIPs might be inaccessible.

This upgrade does not affect your services.

v1.5.2

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.5.2

May 10, 2023

• Fixed an issue where an upgrade failure might cause nodes to become NotReady.

• Fixed an issue where the webhook injected unnecessary zone constraints in Trunking mode.

This upgrade does not affect your services.

v1.4.6

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.6

May 10, 2023

Fixed an issue where an upgrade failure might cause nodes to become NotReady.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact

v1.5.1

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.5.1

April 28, 2023

• Supports Kubernetes 1.26. Starting from v1.5.1, the minimum supported Kubernetes version for Terway is 1.22.

• Upgraded Felix to v3.24.5.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact of the change

v1.4.5

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.5

March 31, 2023

Reduced RBAC permissions.

This upgrade does not affect your services.

v1.4.4

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.4

March 14, 2023

• Supports modifying vSwitch configurations in the component management console.

• Reduced the high memory usage of the component in IPvlan mode.

• Upgraded Cilium to v1.12.7.

• Upgraded iptables to v1.8.8.

If IPVlan is enabled for the cluster, in Local mode (where a LoadBalancer service uses externalTrafficPolicy=Local to access the ExternalIP from within the cluster), you cannot access a backend if it is not on the current node. You can use the ClusterIP to access the service or modify the externalTrafficPolicy of the Service to Cluster.

Version

Registry address

Update time

Changes

Impact

v1.4.3

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.3

December 23, 2022

• Upgraded Cilium to v1.12.4.

• Fixed a potential issue of duplicate pod IP allocation.

• Changed the component upgrade policy to RollingUpdate.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact

v1.4.2

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.2

November 21, 2022

• Fixed a compatibility issue between Trunking mode and LocalDNS.

• Fixed a compatibility issue between NetworkPolicy (in non-IPvlan mode) and Pod PostStartHook.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact

v1.4.1

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.1

September 28, 2022

• Supports configuring terway-eniip component parameters on the component management page.

• Fixed a hairpin access failure.

• Fixed an IP allocation exception when CNI execution is out of order.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact of changes

v1.4.0

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.4.0

August 29, 2022

• Upgraded Cilium to 1.12.1.

• The minimum supported Kubernetes version is 1.20.

If IPvlan mode is enabled for your cluster, Cilium-related CRDs are updated during the cluster upgrade. If you have a large cluster, the load on the kube-apiserver may increase for a short period. Monitor the resource usage of your kube-apiserver.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact of the change

v1.3.0

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.3.0

July 22, 2022

Supports Pod QoS management. For more information, see Configure QoS for a pod.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Change Impact

v1.2.4

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.2.4

June 28, 2022

• Fixed an issue where the portmap plug-in did not take effect.

• Fixed an issue where EIPs could not be deleted.

• Fixed an issue of unbalanced service backend traffic in IPvlan mode.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact

v1.2.3

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.2.3

May 26, 2022

• Supports premium EIP and EIP bandwidth plan configurations.

• Fixed an issue where Kubelet container health checks failed when Cilium NetworkPolicy was used.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact

v1.2.2

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.2.2

March 31, 2022

Fixed an ARP probing issue in VLAN mode.

This upgrade does not affect your services.

v1.2.1

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.2.1

March 15, 2022

• Fixed an issue where calico-felix fell back to legacy iptables mode on Alibaba Cloud Linux 3.

• Fixed an IP reclamation failure when metadata is abnormal.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Change impacts

v1.2.0

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.2.0

January 11, 2022

• Optimized the efficiency of locks during CNI execution.

• Supports pods accessing their own services in IPvlan mode.

• In IPvlan mode, when accessing an ExternalIP from within the cluster, LoadBalancer traffic is loaded to the service network. This feature is enabled by default in new clusters. You can enable in-cluster load balancing for existing Terway IPvlan clusters. For more information, see How do I enable in-cluster load balancing for a Terway IPvlan cluster?.

• Fixed a false positive issue in Terway VPC mode.

• Optimized the performance of calico-felix in large-scale clusters.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact

v1.1.1

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.1.1

December 20, 2021

• Improved NIC resource reclamation to mitigate IPvlan creation failures caused by netns leaks in Containerd scenarios.

• Supports configuring multiple security groups for ENIs. For more information, see Configure multiple security groups for an ENI.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Change impact

v1.1.0

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.1.0

November 22, 2021

• Supports IPv6 dual-stack.

• Upgraded Felix to v3.20.2.

• Upgraded CNI from 0.3.0 to 0.3.1.

• Adapted the deployment template for Kubernetes 1.22. Starting from this version, the minimum supported Kubernetes version is 1.18.

• Fixed an occasional NIC configuration error in IPvlan mode. For more information, see #261.

• Added a 100Mi memory request to the Policy container.

• If your cluster has Typha deployed to optimize NetworkPolicy performance, update the component version. For more information, see Optimize the extensibility of NetworkPolicy in large-scale Terway clusters.

• If your cluster does not have Typha deployed, this upgrade does not affect your services.

• If IPvlan mode is not enabled for your cluster, calico-felix-related CRDs are updated during the cluster upgrade. If you have a large cluster, the load on the kube-apiserver may increase for a short period. Monitor the resource usage of your kube-apiserver.

• Make sure your nodes have sufficient memory to prevent pods from being evicted by Kubernetes during the upgrade.

Version

Registry address

Update time

Changes

Impacts

v1.0.10.443-gaa1bfcc-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.443-gaa1bfcc-aliyun

September 14, 2021

Reduced network latency.

This update applies only to users who use Terway in exclusive ENI mode. Other modes do not need to be updated.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact of changes

v1.0.10.398-g63d2e57-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.398-g63d2e57-aliyun

August 4, 2021

• Fixed an occasional issue where NetworkPolicy did not take effect in inclusive ENI mode.

• Upgraded the Cilium plug-in to 1.10.

If IPvlan mode is enabled for your cluster, Cilium-related CRDs are updated during the cluster upgrade. If you have a large cluster, the load on the kube-apiserver may increase for a short period. Monitor the resource usage of your kube-apiserver.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact

v1.0.10.390-g5f3c461-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.390-g5f3c461-aliyun

July 2, 2021

• Fixed an issue where users had no permission to modify pod annotations when using EIPs in Terway network mode.

• Fixed an issue where Terway could not start when using exclusive ENIs in Terway mode.

• Adapted to the network namespace path in Containerd mode.

• Supports Alibaba Cloud Linux 3.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact of the change

v1.0.10.368-g2890967-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.368-g2890967-aliyun

May 24, 2021

• Fixed an issue where the ResourceInvalid alert was triggered in EIP scenarios.

• Supports direct communication between a pod and its node in IPvlan mode. This bypasses the VPC, allowing data to be forwarded locally instead of through the VPC.

• Supports proactively checking and correcting the ip forwarding configuration.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact of changes

v1.0.10.333-gfd2b7b8-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.333-gfd2b7b8-aliyun

April 26, 2021

• Fixed an address conflict issue when stateful applications use EIPs.

• Supports enabling Hubble in IPvlan mode. For more information about Hubble, see What is Hubble.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact

v1.0.10.323-g778c128-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.323-g778c128-aliyun

March 22, 2021

• Optimized the number of OpenAPI request calls.

• Optimized event alerting when checking security group configurations.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact

v1.0.10.317-g0652857-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.317-g0652857-aliyun

February 22, 2021

• Fixed a Cilium Identity resource leak issue.

• Fixed an occasional pod IP management issue for stateful applications.

This upgrade does not affect your services.

v1.0.10.309-g5314eee-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.309-g5314eee-aliyun

February 5, 2021

• Removed the logic for proactively fixing security group rules. Now, only event prompts are used for fixes.

• Fixed an issue where pod IP addresses were occasionally reclaimed and then reallocated when nodes were under high load.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact

v1.0.10.301-g0115576-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.301-g0115576-aliyun

January 21, 2021

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact

v1.0.10.280-gdc2cb6c-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.280-gdc2cb6c-aliyun

December 25, 2020

• Added proactive checks for Terway, including the following:

  • ENIs and their secondary IP addresses.

  • Security group consistency.

  • Pod network space configuration.

  • Host network configuration.

• Added support for host network stack routing in IPVLAN mode.

This upgrade does not affect your services.

v1.0.10.263-gdbe50a9-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.263-gdbe50a9-aliyun

December 3, 2020

Fixed a Terway exception in exclusive ENI mode.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact of the change

v1.0.10.261-g8342155-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.261-g8342155-aliyun

November 27, 2020

• Supports using synchronous calls to invoke ECS APIs.

• Fixed an issue where an error message was returned when using the CNI plug-in.

This upgrade does not affect your services.

v1.0.10.250-gb7bb10a-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.250-gb7bb10a-aliyun

November 23, 2020

• Fixed a pod network issue when the ENI driver failed to load.

• Fixed an IP status issue when the ENI OpenAPI was throttled.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact

v1.0.10.247-g4cb77d0-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.247-g4cb77d0-aliyun

October 26, 2020

Supports ECS DDH instance types.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Change impact

v1.0.10.237-g6a0f948-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.237-g6a0f948-aliyun

September 16, 2020

Optimized the ENI attachment speed.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact of changes

v1.0.10.221-g8d6386a-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.221-g8d6386a-aliyun

August 11, 2020

Supports IPVLAN+eBPF container networks.

This upgrade does not affect your services.

v1.0.10.213-g27145cc-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.213-g27145cc-aliyun

August 4, 2020

Fixed an occasional pod network failure caused by an unusable ENI.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact

v1.0.10.208-gf3144bf-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.208-gf3144bf-aliyun

July 20, 2020

• Fixed a policy-based routing leak issue on high-density nodes.

• Supports internal OpenAPI.

• Fixed an issue where pod IP addresses could not be released when the vSwitch was full.

• Optimized the display of CNI failure error messages.

This upgrade does not affect your services.

v1.0.10.211-gef088a4-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.211-gef088a4-aliyun

July 24, 2020

Added a cluster ID tag to ENIs.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impacts

v1.0.10.156-g8660a0f-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.156-g8660a0f-aliyun

April 22, 2020

• Optimized the caching efficiency of ENI network resources.

• Upgraded the built-in Felix to v3.5.8.

• Added network resource reclamation for pods in the Completed or Failed state.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact

v1.0.10.139-g14a4f84-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.139-g14a4f84-aliyun

February 12, 2020

Fixed an occasional pod creation timeout issue.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact

v1.0.10.133-g001396b-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.133-g001396b-aliyun

January 10, 2020

• Supports disabling NetworkPolicy.

• Supports using IPVlan as the pod network virtualization technology for inclusive ENI clusters.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact of changes

v1.0.10.122-gd0be015-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.122-gd0be015-aliyun

December 24, 2019

Optimizes the allocation of multiple IP addresses to an ENI.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact

v1.0.10.100-g92a3fa5-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.10.100-g92a3fa5-aliyun

October 11, 2019

Fixed an issue where many concurrent Job calls caused host nodes to become NotReady.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact

v1.0.9.20-g35ae000-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.9.20-g35ae000-aliyun

August 23, 2019

Compatible with Kubernetes 1.14.6.

This upgrade does not affect your services.

Version

Registry Address

Update time

Changes

Impact

v1.0.9.15-g3957085-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.9.15-g3957085-aliyun

April 11, 2019

Fixed an occasional failure during Terway component upgrades.

This upgrade does not affect your services.

Version

Registry address

Update time

Changes

Impact

v1.0.9.14-ga0346bb-aliyun

registry.cn-hangzhou.aliyuncs.com/acs/terway:v1.0.9.14-ga0346bb-aliyun

March 28, 2019

• Fixed an issue where Terway failed to obtain ENI information when the meta server was throttled.

• Fixed an issue where the error failed to move veth to host netns: file exists was reported when creating a container.

• Added a feature to periodically scan the status of ENIs and reclaim abnormally released ENIs.

• Optimized health checks: The Terway health check method was changed from HTTP path checks to TCP port checks.

This upgrade does not affect your services.