By Alibaba Cloud ApsaraVideo Team.
This blog is a recap of "The Guide to Alibaba Cloud Content Delivery Network (CDN) EdgeRoutine" video by Hong Xiaolong, Alibaba Cloud intelligent technology expert. In this blog, Hong will introduce EdgeRoutine (ER), providing detailed information about the background, functions, and case studies of EdgeRoutine and a step-by-step demonstration to acquaint users with the potential of EdgeRoutine in actual business operations.
Cloud-native has become a worldwide technology trend in recent years as enterprises are accelerating their cloud migration efforts. The implementation of cloud-native technologies has tremendous momentum in both public and private clouds and is expected to enter a phase of "explosive growth" according to analyst firms like Gartner.
Serverless and FaaS exhibit huge technical advantages and commercial potential with their soaring market shares. These technologies are now growing even faster than containers.
Edge computing is another emerging sector continuously gaining popularity. As an integral part of this technology, CDNs are the most effective facilitators since they are able to run computing services on their globally-deployed edge nodes. The most important benefit of edge computing is its ability to improve network performance by reducing latency. Gartner even predicts that by 2025, the promise of such low latency will attract three-quarters of enterprise-generated data to be created and processed at the edge. Currently, edge computing is permeating every aspect of our daily lives such as transportation, healthcare, and entertainment.
With traditional infrastructure as a service (IaaS), services are delivered using abstracted physical servers, such as Elastic Compute Service (ECS) instances, Elastic Container Instances (ECIs), or even higher-level architectures like serverless or FaaS. As the service boundary keeps moving up, isolation costs are falling. Therefore, now cloud customers enjoy better-performing auto scaling and flexible pay-as-you-go billing plans. Alibaba Cloud CDN has deployed more than 2,800 edge nodes worldwide. We draw upon the design thinking behind the two most popular technologies—cloud-native and edge computing—while also combining their applications. Currently, we are exploring the innovative technologies and products that could result from applying serverless computing at the edge.
One result of this exploration is Alibaba Cloud CDN EdgeRoutine.
EdgeRoutine is an edge computing application that uses the edge serverless architecture. It features a low latency, requires no maintenance, and uses a flexible pay-as-you-go billing plan.
Let's use a comparison matrix to visualize the differences between using physical servers and using cloud-native technologies. In terms of latency, an on-premises database solution suffers from high latency due to insufficient bandwidth or location restrictions, whereas serverless benefits from lower migration costs due to its lightweight nature and generally achieves mid-level latency with no strict restrictions on locations. Edge serverless, on the other hand, relies on the computing power of edge nodes and provides even lower latency. In terms of computing power, edge nodes generally have limited resources, and therefore, are a good lightweight solution with moderate computational capacity. They are more elastic and involve lower isolation costs compared with lower-layer containers, virtual machines, and physical servers. With respect to cost, serverless ranks high in cost-effectiveness, followed by containers, virtual machines, and physical servers. Serverless is second only to edge serverless. Based on the resource sharing feature of CDNs, edge serverless meets customer expectations for edge nodes by providing an optimal price-performance ratio.
EdgeRoutine provides services based on Alibaba Cloud CDN and is deployed in more than 70 countries across six continents for near-ubiquitous global coverage.
EdgeRoutine is an edge serverless computing environment developed by the Alibaba Cloud CDN team. EdgeRoutine makes it easy for users to run custom JavaScript or WebAssembly (not currently available) code on CDN edge nodes. This means you do not have to worry about hardware configurations, deployment regions, scheduling, or elastic scaling. After the code is deployed to the production environment, the system automatically runs and executes the code on all edge nodes globally. EdgeRoutine has the following four characteristics:
1) Lightweight
2) Low-latency
3) Comprehensive
4) Flexible
CDNs have a multi-level cache hierarchy that reduces latency for static content delivery by pulling and caching static assets from the origin to the CDN node closest to the client. The static content can be fetched directly from the cache instead of origin servers upon requests, which shortens the distance the data must travel and speeds up content delivery. Alibaba Cloud CDN offers a multi-level (two levels by default) cache hierarchy that significantly improves the cache hit ratio and cuts down on origin requests.
Based on the multi-level cache hierarchy of Alibaba Cloud CDN, EdgeRoutine is deployed at edge locations, which are at the same layer as edge gateways and edge caches. EdgeRoutine is an independent component and provides a stand-alone JavaScript runtime environment.
EdgeRoutine intelligently identifies the requests received by edge environments and edge gateways. If edge code is configured, these requests can also be forwarded directly to EdgeRoutine from the edge gateways via transparent proxies. In essence, the process by which EdgeRoutine takes over requests for edge code implementation is equivalent to the takeover of the request lifecycle with edge code.
Lightweight computing and related CDN functions are both supported within the request lifecycle. Users may leverage the high cache hit ratio by specifying a proxy with parameters such as cdnproxy:true to forward requests to edge gateways, from which requests proceed through the multi-level cache hierarchy of the CDN.
EdgeRoutine supports both the serverless implementation and the initiation of new fetch requests. These fetch requests are not main requests, but subrequests generated within customer code. Directly access domain names over the Internet with such subrequests, or use a CDN proxy to forward the requests to Alibaba Cloud CDN. For small- to medium-sized websites, simply host the static pages on edge caching servers without purchasing additional cloud services. This approach makes the most of the convenience of serverless computing and the advantages of CDN.
The following figure presents the scenarios where EdgeRoutine is applied:
This section demonstrates some of the typical applications of EdgeRoutine.
We've all had the annoying experience of visiting websites on 3G and 2G connections. Having a faster 4G connection has helped with the situation, and 5G will offer even higher speeds.
The main function of CDNs is to accelerate the loading of static content from websites. A CDN serves cached content to users from the nearest location, accelerating access to text, images, videos, and other static content forms.
However, this dispatching technique is not universally adaptable as we cannot use it to accelerate the delivery of dynamic content. Take Alibaba's international site as an example. Visitors to this site may be located in countries far from the site's origin servers, which slows down the network performance and creates a poor user experience.
The following figure illustrates the rendering performances of search attempts on the Alibaba.com app before and after EdgeRoutine is applied. The upper part shows conventional rendering, where a blank screen is displayed for the first second and then the full page suddenly appears. This is because the content, including the subresources like images, is completely rendered on the client-side only after multiple JavaScript requests are made via the front-end to obtain the necessary resources to render the page.
But is this worth a one-second delay?
Can we use EdgeRoutine for dynamic rendering? The answer is Yes.
With EdgeRoutine, rendering is more efficient and requires only one request from the client. We can render the business logic in the front-end as a stream, with the frames rendered first, followed by the gradual rendering of the static content. EdgeRoutine allows the assembly and stream output of all pictures and videos at the edge of the network, where we can even request multiple resources with an asynchronous concurrent request. We can see from the lower part of the figure that the page remains completely blank for the first 0.3 seconds, after which the overall frame appears within less than 0.1 seconds. All basic information, such as descriptions and prices, are shown in less than one second except for the largest images which are rendered at last.
The differences in time to first byte (TTFB) and content downloading signify a tremendous improvement in both the above-the-fold time and download time. Edge rendering and edge SSR are innovative application scenarios introduced by EdgeRoutine. EdgeRoutine can achieve rendering with performance similar to local rendering as long as the low-latency mode is enabled at the edge. In addition, CDN can be used to speed up the delivery of static files.
Computation occurs whenever we use mobile apps and desktop clients. The dynamic logic computing must be processed by virtual servers on the cloud. Even the simple operation of entering an account password requires data authentication by an origin server. These tasks generate high latency and a large number of queries per second (QPS), putting a great deal of stress on the origin servers.
Can we use edge computing to reduce the load on the origin servers?
Sure, we can. For instance, dynamic authentication can be implemented in an edge environment for reduced QPS, lower latency, and no need for back-to-source processing. We also employ CDN to cache both static resources and dynamic data for tasks that require the assembly and combination of these two types of content.
Faced with the hundreds of millions of connected smartphone devices, developers of popular apps generally need to evaluate client-side performance, use canary updates for multiple app versions, and A/B test new features to monitor performance and conversion rates. However, using the origin server alone to handle the requests from such a massive number of clients would undoubtedly generate an excessive QPS and crash the origin servers. Therefore, in most cases, only 3% or 5% of the total clients would be chosen as test samples.
EdgeRoutine relieves this pressure by dispersing the QPS load to globally-distributed CDN nodes, providing further support for backtracking by aggregating the analyzed data back to the enterprise data center.
Furthermore, the deployment of a personalized search algorithm is prohibitively expensive when origin pulls are involved. EdgeRoutine adopts a different approach where no decision is required from the origin server, and location-based recommendations can be directly computed on the edge nodes by matching the keywords between resources and user profiles.
We've built a command-line utility, edgeroutine-cli, that works on macOS, Windows, and Linux. It offers support for the debugging, uploading, canary testing, and canary release of code. Learn more about edgeroutine-cli at using the following links:
1) EdgeRoutine Demo: Hello World
2) EdgeRoutine Demo: Hello World Local Debugging
3) EdgeRoutine Demo: Webpack Bundling
The views expressed herein are for reference only and don't necessarily represent the official views of Alibaba Cloud.
The Iyiou Think Tank Report: Alibaba Cloud's DME Is the Preferred Solution in Chinese Dairy Industry
Making CDN Programmable: Use Cases, Script Overview, and EdgeScript Demos
2,599 posts | 762 followers
FollowAlibaba Clouder - July 27, 2020
Alibaba Clouder - November 10, 2020
Alibaba Cloud TC Content - August 5, 2021
Alibaba Clouder - November 25, 2020
Alibaba Container Service - April 28, 2020
coolriver - November 10, 2020
2,599 posts | 762 followers
Follow
Edge Network Acceleration
Establish high-speed dedicated networks for enterprises quickly
Learn More
Edge Security Acceleration (Original DCDN)
Edge Security Acceleration (ESA) provides capabilities for edge acceleration, edge security, and edge computing. ESA adopts an easy-to-use interactive design and accelerates and protects websites, applications, and APIs to improve the performance and experience of access to web applications.
Learn More
Networking Overview
Connect your business globally with our stable network anytime anywhere.
Learn More
Accelerated Global Networking Solution for Distance Learning
Alibaba Cloud offers an accelerated global networking solution that makes distance learning just the same as in-class teaching.
Learn MoreMore Posts by Alibaba Clouder
