Solution Highlights

Efficient GPU Memory Isolation

Maximize GPU utilization and prevent memory conflicts by segmenting the memory and computing resources of a GPU and managing them as multiple containers based on the virtual GPU isolation technology of Alibaba Cloud's host kernel

Flexible GPU Resource Sharing and Scheduling

Allocate the memory and computing resources of GPUs to AI jobs with scheduling strategies for different business scenarios to maximize GPU utilization while maintaining high performance for containers

Customizable GPU Auto-Scaling

Increase GPU resource availability and guarantee AI task stability with automatic GPU scaling by setting key GPU metrics such as utilization ratio and memory usage to trigger the scale-ups and scale-downs of GPU instances

Real-Time Visualized GPU Monitoring

Maintain GPU instance health and balance source distribution based on real-time visualized information of key GPU metrics such as memory allocation and usage and GPU temperature from dashboards of clusters and nodes in Prometheus