1.1 Technical implementation

1. Breakthrough in local storage limitations: GroundPool hard disk cache device effectively solves the problem of insufficient number of PCIe channels in local computing servers through its unique "NVMe oF SSD Direct mounting technology". This technology converts limited PCIe channels into RDMA network protocol transmission, and uses a single PCIe X16 channel to mount up to 24 SSD hard disk devices. This allows a stand-alone computing server to take full advantage of the total capacity and performance of the superimposed SSD hard disk in the form of a local SSD hard disk to build a larger-capacity and higher-performance local SSD hard disk cache system. This innovative storage solution significantly improves the cache hit rate of a single computing server, thereby releasing valuable computing resources and providing a solid foundation for high-performance computing.

2. Breakthrough in file system performance bottlenecks: Traditional file systems mostly use software protocols such as NFS, CIFS, and POSIX for external output. These protocols need to be processed at multiple levels such as the CPU, memory (MEM), and kernel (Kernel) during the data processing process. This not only increases the complexity of the system, but also leads to significant performance losses. This phenomenon is called the "data center tax." In order to solve this problem, DeepSeek large model API hard disk caching technology adopts an innovative storage strategy.

This technology stores the hottest data (Cache Key) directly in the local SSD hard drive, and uses the LUISUAN Technology GroundPool device to achieve a breakthrough in local storage limitations, thereby ensuring fast reading of high-frequency access data. For warm data (older Cache Key), it is stored in the external file system so that the token can be quickly reloaded when needed. This tiered storage strategy not only optimizes data access efficiency, but also significantly reduces dependence on traditional file systems, thereby breaking through file system performance bottlenecks and improving overall system performance and response speed.

3. Breakthrough in reasoning delay problem: By solving the limitations of the hard disk cache of a single computing device, the LUISUAN Technology GroundPool hard disk cache device can effectively improve the performance of DeepSeek's large model API hard disk cache technology, which is particularly effective in scenarios where the model will not be replaced after the model is deployed. However, in scenarios such as IDC intelligent computing centers, in order to improve the utilization of computing power, reduce the idle time of computing power cards and improve overselling efficiency, rapid switching of different user models has become a key requirement. The GroundPool hard disk cache device implements a shared model loading mode, allowing models to be shared between multiple computing devices and computing cards, and building a model shared cache (Cache), thereby greatly accelerating the loading speed of the model and effectively solving this problem.