All Products
Search
Document Center

Platform For AI:Overview of EAS resource groups

Last Updated:Dec 02, 2024

Elastic Algorithm Service (EAS) allows you to divide clusters into different resource groups for isolation. You can deploy a model service by using the public resource group that is provided by the system or a dedicated resource group that you create. This topic describes the differences between public and dedicated resource groups regarding billing methods, supported features, and usage workflow.

Billing and feature comparison

Resource group type

Scenario

Billing method

Features

Public resource group

Scenarios that require resource sharing or have low security requirements.

Pay-as-you-go. For more information about the billing rules, see Billing of EAS.

  • Provides computing resources that are available without purchase and shared with other Alibaba Cloud users. Resource supply is not guaranteed during peak hours.

  • Provides CPU resources.

  • Provides GPU resources, including A10, P4, P100, T4, and V100.

  • Supports Internet connections, Virtual Private Cloud (VPC) connections, and VPC direct connections.

Dedicated resource group

Scenarios that require resource isolation or have high security requirements.

Subscription and pay-as-you-go. For more information about the billing rules, see Billing of EAS.

  • Provides isolated computing resources that are exclusive to you, which ensures security.

  • Provides CPU resources.

  • Provides GPU resources, including A10, P4, P100, T4, and V100.

  • Supports Internet connections, VPC connections, and VPC direct connections.

Usage workflow comparison

The following table describes how to use public and dedicated resource groups in different deployment workflows. For information about applicable scenarios and usage notes, see Work with the public resource group and Work with dedicated resource groups.

Resource group type

Visualized deployment in Machine Learning Designer or the PAI console

CLI deployment by using Data Science Workshop (DSW) or EASCMD

Public resource group

  1. Prepare and configure resources

    After you activate EAS, the system automatically creates a public resource group.

  2. Deploy services

    When you deploy a service, select the public resource group. For more information, see Model service deployment by using the PAI console and Deploy a model service by using Machine Learning Designer.

  3. Configure networks

    You can use Internet connections, VPC connections, or VPC direct connections. To use VPC direct connections, turn on the VPC Direct Connection switch in the Platform for AI (PAI) console. For more information, see Configure network connectivity.

  4. Enable log collection

    Enable and configure log collection in the Simple Log Service console. For more information, see Configure log collection for a resource group.

  1. Prepare and configure resources

    After you activate EAS, the system automatically creates a public resource group.

  2. Deploy services

    When you deploy a service, leave the resource parameter empty in the JSON configuration file to use the public resource group. To configure the instance type in the public resource group, specify the cloud.computing.instance_type parameter. For more information, see Deploy model services by using EASCMD or DSW.

  3. Configure networks

    You can use Internet connections, VPC connections, or VPC direct connections. To use VPC direct connections, configure the cloud.networking parameter in the JSON configuration file. For more information, see Configure network connectivity.

  4. Enable log collection

    Enable and configure log collection in the Simple Log Service console. For more information, see Configure log collection for a resource group.

Dedicated resource group

  1. Prepare and configure resources

    On the Resource Groups tab of the EAS-Online Model Services page, create a dedicated resource group. For more information, see Work with dedicated resource groups.

  2. Deploy services

    When you deploy a service, select the dedicated resource group that you created. For more information, see Model service deployment by using the PAI console.

  3. Configure networks

    You can use Internet connections, VPC connections, or VPC direct connections. To enable the VPC direct connection feature, go to the details page of the dedicated resource group and turn on the VPC Direct Connect switch. For more information, see Configure network connectivity.

  4. Enable log collection

    On the details page of the dedicated resource group, turn on the Configure SLS switch. For more information, see Configure log collection for a resource group.

  1. Prepare and configure resources

    On the Resource Groups tab of the EAS-Online Model Services page, create a dedicated resource group. For more information, see Work with dedicated resource groups.

  2. Deploy services

    When you deploy a service, set the resource parameter to the name of the dedicated resource group in the JSON configuration file. For more information, see Deploy model services by using EASCMD or DSW.

  3. Configure networks

    You can use Internet connections, VPC connections, or VPC direct connections. To enable the VPC direct connection feature, go to the details page of the dedicated resource group and turn on the VPC Direct Connect switch. For more information, see Configure network connectivity.

  4. Enable log collection

    On the details page of the dedicated resource group, turn on the Configure SLS switch. For more information, see Configure log collection for a resource group.

References

  • The EAS module of PAI provides an end-to-end platform for model development and deployment. For more information, see EAS overview.

  • For information about the scenarios, billing, and usage of the public resource group, see Work with the public resource group.

  • For information about the types, operations, and management of dedicated resource groups, see Work with dedicated resource groups.

  • You can collect logs of an EAS service and store them in your Simple Log Service Logstore. For more information, see Configure log collection for a resource group.

  • After you configure networks for a resource group, the EAS service that is deployed by using the resource group can access other Alibaba Cloud services that reside in the same VPC, and users can access the EAS service. For more information about network configuration, see Configure network connectivity.