By EMQ
In the Artificial Intelligence of Things (AIoT) era, quantitative changes brought about by data are being replaced by qualitative changes brought about by connected devices. The key to building a successful IoT solution in more diverse Internet of Things (IoT) scenarios is the ability to connect a vast number of devices to the cloud and generate insights from these connections.
EMQ Yingyun Technology (EMQ) is a leading provider of open-source IoT infrastructure software. EMQ provides out-of-the-box and highly reliable one-stop IoT data solutions that support high concurrency and provide high performance. EMQ helps enterprises and partners build an IoT infrastructure base that supports cloud-edge integration through real-time retrieval, movement, processing, and analysis of massive amounts of cloud-edge-device data.
EMQX (an MQTT broker provided by EMQ for large-scale distributed IoT) is integrated with Alibaba Cloud Compute Nest. EMQX is also integrated with Lindorm to provide an end-to-end data solution. This time, EMQX is integrated with the Apsara Luoshen Cloud Network Platform to provide NLB that supports hundreds of millions of concurrent connections and millions of requests per second.
EMQX (an MQTT broker provided by EMQ for large-scale distributed IoT) is used to verify the core metrics of a single NLB instance, including over 100 million concurrent connections and over 100 Gbit/s of throughput. EMQX can manage over 100 million devices and support the smooth scale-out of services for each NLB instance. EMQX is also used to verify the performance of NLB in scenarios that have high requirements (such as Internet of Vehicles (IoV) and Industrial Internet of Things (IIoT) scenarios).
Performance tests used to verify the core metrics of NLB are completed. The staging environment is deployed in the Germany (Frankfurt) region of Alibaba Cloud. The following figure describes the network topology:
-The EMQX control cluster consists of three ECS instances of the hfc6.16xlarge specification. These ECS instances are deployed in Frankfurt Zone B and used to manage configuration changes and monitor traffic. They do not forward requests.
The EMQX client establishes persistent MQTT connections at a rate of 35,000 new connections per second. After 50 minutes, the monitoring data in the NLB console shows that the number of concurrent connections reaches 100 million. The following figure shows the monitoring data:
The monitoring data on the dashboard of EMQX also shows the number of concurrent connections is maintained at 100 million.
Stress tests are performed to verify that the throughput of each NLB instance reaches 100 Gbit/s. The following figure of the NLB console shows that the throughput of a single NLB instance reaches over 320 Gbit/s.
The Apsara Luoshen Cloud Network Platform is an ultra-large-scale virtual network built based on the global infrastructure of Alibaba Cloud to improve network reliability, connectivity, and elasticity.
After more than ten years of development, the Apsara Luoshen Cloud Network Platform supports millions of virtual private clouds (VPCs) in each region, millions of compute nodes in each VPC, 51.2 Tbit/s of bandwidth for connections between on-premises networks and Alibaba Cloud, 35 million MPS for eRDMA, service delivery within minutes for 200 GbE networks, and SLB instances that can scale to process up to millions of queries per second. With these capabilities, the Apsara Luoshen Cloud Network Platform supports various types of connections from global users in different industries.
NLB is a new generation load balancing service provided by the Apsara Luoshen Cloud Network Platform for the Internet of Everything (IoE). NLB provides ultra-high performance and auto scaling capabilities. Users do not need to specify or modify the specifications of NLB instances because NLB instances automatically scale to meet business requirements. NLB instances adopt a multi-level disaster recovery architecture to ensure service availability. After users connect to the cloud, NLB balances the load to ensure network elasticity. NLB helps users build secure IoT platforms and applications that support high concurrency.
NLB is used in various IoT scenarios (such as IoV, smart homes, smart parking, and video surveillance). As a service ingress, NLB supports high concurrency, SSL offloading for TCP traffic, and connection rate throttling. These capabilities ensure the security and reliability of IoT services.
EMQX is an open-source MQTT broker provided by EMQ for the IoT. With over 10 million downloads, EMQX provides a one-stop solution for connecting devices to the cloud. EMQX connects over 100 million IoT devices to the cloud in a scalable, secure, and reliable manner and moves and processes massive amounts of data in real-time. EMQX is one of the most scalable open-source MQTT brokers in the world. Each cluster of EMQX supports 100 million devices, millions of messages per second, and message distribution within milliseconds.
EMQ has developed the following services based on EMQX: HStreamDB (a cloud-native streaming database that supports the storage and real-time analysis of large-scale streaming data), NanoMQ (an ultra-lightweight MQTT broker running at the edge of the IoT), Neuron (an industrial gateway software for industrial protocol parsing and conversion), and eKuiper (a lightweight IoT edge analysis and streaming engine that can run on various resource-constrained edge devices). These services constitute the future-oriented IoT data infrastructure of EMQ.
In the future, EMQ will continue to work with the Apsara Luoshen Cloud Network Platform to explore in-depth IoT infrastructure solutions in key scenarios (such as the IoV) and help the Apsara Luoshen Cloud Network Platform serve enterprises better and build secure and reliable IoT applications that support high concurrency.
Alibaba Cloud Experts Column | Alibaba Cloud's Discovery and Practice in Japanese Market
1,042 posts | 256 followers
FollowAlibaba Cloud Community - December 1, 2022
Alibaba Cloud Community - February 9, 2022
AlibabaCloud_Network - December 19, 2018
Alibaba Cloud Community - June 5, 2023
AlibabaCloud_Network - April 19, 2019
AlibabaCloud_Network - June 30, 2021
1,042 posts | 256 followers
Follow
Elastic High Performance Computing Solution
High Performance Computing (HPC) and AI technology helps scientific research institutions to perform viral gene sequencing, conduct new drug research and development, and shorten the research and development cycle.
Learn More
Elastic High Performance Computing
A HPCaaS cloud platform providing an all-in-one high-performance public computing service
Learn More
Remote Rendering Solution
Connect your on-premises render farm to the cloud with Alibaba Cloud Elastic High Performance Computing (E-HPC) power and continue business success in a post-pandemic world
Learn More
AliwareMQ for IoT
A message service designed for IoT and mobile Internet (MI).
Learn MoreMore Posts by Alibaba Cloud Community
