To meet the demand for processing increasing volumes of data stored in Object Storage Service (OSS), Alibaba Cloud provides comprehensive data lake solutions that can handle throughput rates exceeding 10 terabits per second (Tbps). In daily operations, parallel execution of tasks, such as data collection, preprocessing, AI model training, and debugging, on the same platform can lead to uneven resource distribution and access bottlenecks. To resolve these issues, OSS introduced the resource pool Quality of Service (QoS) feature. You can use the feature to dynamically change the throttling thresholds of buckets and requesters, including the bandwidth and queries per second (QPS). This way, resources can be preferentially allocated to key services and compute-intensive resources during peak hours, and the stability of the business is ensured.
Get started with resource pool QoS
Watch the following video for a quick introduction to resource pool QoS.
Resource pool QoS
Feature description
Change the bandwidth threshold of buckets
You can change the bandwidth threshold of one or more buckets that are added to a resource pool.
Change the bandwidth threshold of a requester
The resource pool QoS feature allows you to change the bandwidth threshold of a requester based on a bucket or resource pool.
Change the thresholds of multiple configuration items
You can change the thresholds of total read throughput, total write throughput, internal network read throughput, internal network write throughput, external network read throughput, and external network write throughput.
Configure alerts for throttling events
The resource pool QoS feature allows you to configure alerts for throttling events. When the specified throttling threshold is reached, the system immediately sends a notification to the administrator. For more information, see Use CloudMonitor to monitor OSS throttling information in real time.
Monitor throttling and performance
You can use CloudMonitor to obtain real-time information about the bandwidth setting and usage of a resource pool. For more information, see Use CloudMonitor.
Limits
You can create up to 100 resource pools for an Alibaba Cloud account.
You can add up to 100 buckets to a resource pool.
You can configure bandwidth thresholds for up to 300 RAM users in a resource pool.
Apply to use the resource pool QoS feature
Resource pool QoS is in invitational preview. If the throughput of your OSS buckets in a region has reached or exceeded 500 Gbps, you can contact technical support to apply for this feature.
What to do next
After you pass the application to use the resource pool QoS feature, you can use ossutil or call API operations to configure bandwidth thresholds in different dimensions. The configuration takes effect within 2 minutes.
Dimension | ossutil | API |
Dimension | ossutil | API |
Configure the bandwidth threshold of a bucket | ||
Configure bandwidth thresholds for requesters accessing buckets | ||
Configure bandwidth thresholds for requesters accessing resource pools |
