Guide to selecting the right serverless GPU solution based on business requirements

In conventional GPU scenarios, users may face issues such as low resource utilization, high costs, and limited elasticity. In contrast, serverless GPU solutions offer a more flexible approach to utilizing GPU resources, allowing you to select GPU models and computing resources based on your actual needs. This topic outlines how to choose the GPU solution that best aligns with your business requirements.

The following flowchart illustrates the process for selecting the ideal serverless GPU solution. For more information about how to use the serverless GPU-accelerated instances of Function Compute in different scenarios, see the following topics:

• Quasi-real-time inference scenarios

• Real-time inference scenarios

• Offline asynchronous task scenarios