Container Service for Kubernetes:Deploy a FastChat application for AIGC in an ACK Serverless cluster

On the Deployments page, click Create from Image.

On the Basic Information wizard page, enter an application name, such as fastchat, add annotations, and then click Next.

On the Container wizard page, configure the General, Health Check, and Lifecycle settings, and then click Next.

Category	Parameter	Example	Screenshot
General	Image Name	yunqi-registry.cn-shanghai.cr.aliyuncs.com/lab/fastchat
	Image Version	v1.1.0
Health Check	Readiness	Enable readiness check, use TCP connections, and set the pod port to 7860.
Lifecycle	Command	Set the container startup command to ["sh","-c","/root/webui.sh"].

On the Advanced wizard page, click Create to the right of Services.

In the Create Service dialog box, configure the Service parameters and click Create to use the Service to expose the FastChat application.

Parameter	Example	Screenshot
Name	fastchat-svc
Type	Select Server Load Balancer, Public Access, and Create SLB Instance.
Service Port	7860
Container Port	7860

In the Labels and Annotations section, add the pod annotations in the following table and click Create in the lower-right part of the page.

If the following information is returned, the application is created.

A kubectl client is connected to the ACK Serverless cluster. For more information, see Obtain the kubeconfig file of a cluster and use kubectl to connect to the cluster.

Create a file named fastchat.yaml and copy the following content to the file:

apiVersion: apps/v1
kind: Deployment
metadata:
  labels:
    app: fastchat
  name: fastchat
  namespace: default
spec:
  replicas: 1
  selector:
    matchLabels:
      app: fastchat
  template:
    metadata:
      labels:
        app: fastchat
        alibabacloud.com/eci: "true" 
      annotations:
        k8s.aliyun.com/eci-use-specs: ecs.gn6i-c8g1.2xlarge,ecs.gn5-c8g1.2xlarge,ecs.gn6v-c8g1.8xlarge,ecs.gn6i-c16g1.4xlarge
        k8s.aliyun.com/eci-extra-ephemeral-storage: 100Gi
    spec:
      dnsPolicy: Default
      containers:
      - command:
        - sh
        - -c 
        - "/root/webui.sh"
        image: yunqi-registry.cn-shanghai.cr.aliyuncs.com/lab/fastchat:v1.1.0
        imagePullPolicy: IfNotPresent
        name: fastchat
        ports:
        - containerPort: 7860
          protocol: TCP
        readinessProbe:
          failureThreshold: 3
          initialDelaySeconds: 5
          periodSeconds: 10
          successThreshold: 1
          tcpSocket:
            port: 7860
          timeoutSeconds: 1
        resources:
          requests:
            cpu: "8"
            memory: 16Gi
          limits:
            nvidia.com/gpu: 1
---
apiVersion: v1
kind: Service
metadata:
  annotations:
    service.beta.kubernetes.io/alibaba-cloud-loadbalancer-address-type: internet
    service.beta.kubernetes.io/alibaba-cloud-loadbalancer-instance-charge-type: PayByCLCU
  name: fastchat-svc
  namespace: default
spec:
  externalTrafficPolicy: Local
  ports:
  - port: 7860
    protocol: TCP
    targetPort: 7860
  selector:
    app: fastchat
  type: LoadBalancer

Run the following command to deploy the FastChat application:

kubectl apply -f fastchat.yaml

Run the following command to query the status of the application:

kubectl get deployment fastchat

Expected output:

NAME       READY   UP-TO-DATE   AVAILABLE   AGE
fastchat   1/1     1            1           38m