Alibaba Cloud has announced today the launch of a new system that aims to optimize the storage performance of hyper-scale infrastructure in addressing increasing demands from usage of artificial intelligence (AI) and cloud computing.
A Dual-mode SSD (Solid State Drive), a storage device which supports both Open-Channel Mode and native NVMe mode, has been developed by the Alibaba Infrastructure Services team, and an optimal software/hardware integrated solution based on the Dual-mode SSD is currently being deployed to Alibaba's internal servers. It is expected this novel storage system will lead to a 75% reduction in read latency and enhance the overall storage performance of data centers by as many as five times.
.
"The increasing proliferation of AI and cloud computing has led to more sophisticated demands in data centers, while traditional storage systems face severe limitation in meeting such demands.In light of these challenges, Alibaba has pioneered the research and development of a new storage system, the Dual-mode SSD infrastructure. This underscores our commitment to driving the innovation and optimization of technology infrastructure in a new AI and cloud era," said Shu Li, Senior Staff Engineer at Alibaba Infrastructure Services.
"By creating and sharing the Dual-mode SSD specification, we are also working with different manufacturers on related firmware and hardware products, leading to the fast development of SSD-centered infrastructure and ecosystems."
With the proliferation of new applications like artificial intelligence, Internet of Things (IoT), big data, and cloud computing, today’s hyper-scale data centers run far more diversified and complex workloads than ever before. These different applications can have drastically different I/O patterns, performance or Quality of Service (QoS) targets, usage models, and sometimes require different set of features from storage devices.
Traditional storage architecture is designed around standardized hardware that provides generic block I/O interface, and software stack that is built on top of such abstract, generic block device. While this architecture has advantages of portability and backward compatibility,it is, however, facing serious challenges in today’s hyper-scale data centers.
Taking Alibaba Cloud as an example, we have numerous different applications serving our business units and customers, such as E-Commerce, Search, Online Promotion, Multimedia, Financial Service, Logistic Service, and Cloud Computing. Some of our applications demand features that are not available in standard SSDs. Our application requirements also change frequently, therefore storage system must be agile and quick-responding.
Alibaba Cloud tackled these challenges with hardware/software co-design approach using the Dual-Mode SSD. We combine in-house SSD hardware with first-hand understanding of applications and use cases, and work closely with business teams to design and optimize the entire I/O stack. The result is a set of hardware/software integrated solutions that are highly optimized for applications in our data center.
The dual-mode SSD demonstrates Alibaba Cloud's consistent effort to pursue performance improvements in hyperscale data centers with hard-ware/software co-design approach. We develop the in-house dual-mode SSD that supports both NVMe device-based mode and Open Channel mode. On software side, we develop User-Space Open Channel I/O stack that closely integrates SSD hardware, firmware, driver, operation system together with our applications.
Furthermore, dual-mode SSD demonstrates the promising potential of hardware/software jointed optimization with the use case of advanced I/O scheduling. Evaluation results show the proposed dual-mode SSD deployed in hyperscale infrastructure reduces access latency by 75%, and improves 99th percentile latency by 5.8 times.
Three Reasons to Add Alibaba Cloud to Your Multi-Cloud Strategy
2,599 posts | 762 followers
FollowAlibaba Clouder - August 12, 2019
Alibaba Clouder - September 20, 2019
Alibaba Clouder - February 13, 2021
Alibaba Clouder - November 23, 2017
Alibaba Clouder - August 8, 2019
Alibaba Clouder - August 28, 2019
The right approach as we have so many makes of SSDs and standards are a concern
2,599 posts | 762 followers
Follow
Alibaba Cloud Drive Solution
Build your cloud drive to store, share, and manage photos and files online for your enterprise customers
Learn More
Storage Capacity Unit
Plan and optimize your storage budget with flexible storage services
Learn More
Hybrid Cloud Storage
A cost-effective, efficient and easy-to-manage hybrid cloud storage solution.
Learn More
Hybrid Cloud Distributed Storage
Provides scalable, distributed, and high-performance block storage and object storage services in a software-defined manner.
Learn MoreMore Posts by Alibaba Clouder
Raja_KT February 20, 2019 at 12:08 am
The right approach as we have so many makes of SSDs and standards are a concern