Compute Nest is a comprehensive cloud integration Platform-as-a-Service (PaaS) solution designed for Independent Software Vendors (ISVs), Systems Integrators (SIs), and Managed Service Providers (MSPs) to integrate their products and services with Alibaba Cloud seamlessly. With its unified service category and management platform, Compute Nest simplifies service integration and management, making it easier for service providers to deliver their offerings on Alibaba Cloud.
The Compute Nest infrastructure encompasses various components and features that enable smooth collaboration between service providers and Alibaba Cloud. These include secure connection, platform and data integration (User Access, RAM Access, API Access), account service, resource orchestration, license management, operation orchestration, API management, migration service, billing service, elastic orchestration, auditing, monitoring, and log management. By leveraging these capabilities, service providers can streamline their operations and offer a seamless user experience to their customers.
The collaboration between Alibaba Cloud and Compute Nest opens up several joint solutions and technical integration opportunities. This collaboration extends to both online and offline channels, allowing ISVs to directly integrate their solutions with Alibaba Cloud or distribute them through Alibaba Cloud Marketplace. This partnership enables ISVs to bring their solutions to a wider audience and provides them with access to Alibaba Cloud's vast customer base and distribution channels.
Compute Nest offers three different business model scenarios to cater to the diverse needs of service providers. In the first scenario, Private Deployment, service providers can simplify operations and maintenance and also earn additional revenues by reselling Alibaba Cloud products. This model provides service providers with the flexibility to customize and tailor their offerings to meet the specific requirements of their customers.
Another scenario, Fully Managed (Single Tenant), offers a cost-effective solution for service providers. By leveraging Alibaba Cloud's infrastructure, service providers can deliver fully managed services to their customers, ensuring simplified operations and maintenance. This model enables accurate cost management per tenant, allowing service providers to optimize resource allocation and deliver cost-effective solutions to their customers.
The third scenario, Fully Managed (Multi-tenant), provides service providers with simplified operations, maintenance, and cost-effective Alibaba Cloud infrastructure benefits. This model allows service providers to consolidate their resources and efficiently manage multiple customers on a shared infrastructure, resulting in increased efficiency and cost savings.
To create a service on Compute Nest, ISVs or MSPs can publish their service and upload Resource Orchestration Service (ROS) or Terraform templates for quick provisioning. End users can then subscribe to the service through the Alibaba Cloud Marketplace. With the end user's agreement, service providers gain privileged access to the end user's environment, enabling them to provide additional operation and maintenance support. This collaboration ensures that customers receive seamless service delivery and support from both the service provider and Alibaba Cloud.
Alibaba Cloud offers a comprehensive suite of cloud services to customers worldwide. These services encompass various domains, including Elastic Computing Services (ECS), databases, networking, security management, application services, big data analytics, machine learning, and IoT services. By leveraging Alibaba Cloud's services, users can access highly durable storage, efficient computing capabilities, high-performance databases, intelligent analytical tools, and more. The pay-as-you-go pricing model allows users to pay only for the resources they consume, helping enterprises lower their IT costs and scale their operations as needed. Feel free to try Compute Nest services here.
One of the prominent applications of generative AI is the development and deployment of large language models. Compute Nest facilitates running large language models like Llama 2 (Large Language Model) on Alibaba Cloud's cutting-edge infrastructure. Llama 2 enables the generation of highly accurate and contextually relevant text, making it ideal for a wide range of natural language processing tasks.
Compute Nest also offers seamless integration with Langchain, an advanced interface for managing and orchestrating generative AI models. With Langchain, service providers can easily navigate and control the flow of data and algorithms, enabling efficient management and deployment of generative AI models. Additionally, this Compute Nest service provides a simplified web UI that allows users to interact with generative AI models through an intuitive graphical interface, making it accessible to users without extensive programming knowledge.
Compute Nest leverages Alibaba Cloud's powerful analytic database, AnalyticDB for PostgreSQL, to ensure efficient storage and retrieval of metadata generated by generative AI models, Compute Nest leverages Alibaba Cloud's powerful analytic database, AnalyticDB for PostgreSQL. This robust database solution enables fast and scalable data analytics, providing service providers with real-time insights and efficient management of large volumes of data. Additionally, the Compute Nest service utilizes vector databases to effectively store and query complex vector representations, further enhancing the capabilities of generative AI models.
This Compute Nest service offers seamless integration with knowledge base systems and virtual assistants. With Alibaba Cloud's comprehensive suite of products, including the Platform for AI (PAI) and Elastic Algorithm Service (EAS), service providers can easily deploy and manage knowledge base systems and virtual assistants to enhance customer experiences and streamline information retrieval processes.
Those interested in getting started with Alibaba Cloud or learning more about its products and services can visit the Alibaba Cloud website or reach out to their nearest Alibaba Cloud representative. The Alibaba Cloud team is always ready to assist and support customers, ensuring a smooth and successful cloud journey. You can try this Generative AI service on Compute Nest by this link.
If successful, you will get a similar response as shown in the figure above. Then, the terminal can be closed.
You can find the endpoint in the details. By pressing the endpoint, you can see a simple web interface.
API endpoints:
<your public IP address>:5000/upload
<your public IP address>:5000/query
Ensure that you update the URLs in your application code or any other relevant places to use the correct API endpoints.
Here is an example CURL to run services for query and upload:
curl -X POST -H "Authorization: Bearer <JWT_TOKEN>" -F "file=@/path/to/file.txt" <your public IP address>:5000/upload
curl -X POST -H "Authorization: Bearer <JWT_TOKEN>" -H "Content-Type: application/json" -d '{"query": "Your query here"}' <your public IP address>:5000/query
Congratulations! You have successfully completed the step-by-step tutorial for setting up and running the LLM demo on Alibaba Cloud using ECS, PAI-EAS, AnalyticDB for PostgreSQL, and the Llama 2 project.
Compute Nest is a powerful cloud integration PaaS solution that empowers ISVs, SIs, and MSPs to seamlessly integrate their products and services with Alibaba Cloud. Alibaba Cloud Compute Nest empowers service providers to seamlessly integrate and collaborate with Alibaba Cloud's extensive range of products, including the Machine Learning Platform for AI (PAI) and Elastic Algorithm Service (EAS), to harness the power of generative AI and knowledge base systems. With the support of Compute Nest, service providers can leverage cutting-edge technologies such as large language models, Langchain, vector databases, and AnalyticDB for PostgreSQL to deliver innovative solutions and enhance customer experiences. By leveraging the unified service category and management platform, service providers can simplify their operations, deliver a superior user experience, and tap into the vast opportunities offered by Alibaba Cloud's extensive customer base and distribution channels. With Alibaba Cloud's comprehensive suite of cloud services, users gain access to cutting-edge technologies and resources that drive innovation, reduce costs, and accelerate business growth. Whether it's private deployment, fully managed solutions, or multi-tenant environments, Compute Nest, in collaboration with Alibaba Cloud, offers a scalable and flexible solution to meet the diverse needs of service providers and their customers.
Solution 1B: How to Use ECS + PAI + AnalyticDB for PostgreSQL to Build a Llama2 Solution
Alibaba Cloud Community - September 22, 2023
Alibaba Cloud Community - May 24, 2024
Farruh - July 18, 2024
Alibaba Cloud Community - January 30, 2024
Farruh - November 23, 2023
Alibaba Cloud Community - May 16, 2024
AnalyticDB for MySQL
AnalyticDB for MySQL is a real-time data warehousing service that can process petabytes of data with high concurrency and low latency.
Learn More
AnalyticDB for PostgreSQL
An online MPP warehousing service based on the Greenplum Database open source program
Learn More
Platform For AI
A platform that provides enterprise-level data modeling services based on machine learning algorithms to quickly meet your needs for data-driven operations.
Learn More
Offline Visual Intelligence Software Packages
Offline SDKs for visual production, such as image segmentation, video segmentation, and character recognition, based on deep learning technologies developed by Alibaba Cloud.
Learn MoreMore Posts by Farruh
