NVIDIA HBM in Short Supply, Next-Gen GPUs Limited, but This Storage Drive Steals the Spotlight
The article discusses how AI Agents are transforming storage from a passive repository into an active component within AI inference and operation loops. As Agents perform continuous tasks involving models, memory, tools, and logs, data storage needs to evolve beyond simple block devices. The concept of "functional SSDs" is introduced, where capabilities like automatic encryption, compression, indexing, and memory management are embedded closer to the storage medium. This shift is driven by the need to handle Agent-specific data chains—including context, tool trajectories, and long-term memory—more efficiently.
The piece analyzes current trends like AI SSDs from companies such as Phison (aiDAPTIV), Longsys (SPU+iSA), and Maxio, which are beginning to participate in the AI data path by managing model weights, KV cache, and prefetching. It further explores the future re-division of labor across the memory hierarchy: HBM for core compute, emerging High Bandwidth Flash (HBF) for read-intensive workloads, DRAM/CXL for mutable state, and functional SSDs for persistent, governed objects like Agent Memory.
The conclusion is that storage will become integral to Agent capability, moving from just saving data to enabling next-step actions. The industry is poised to develop along three paths: functionalized SSDs, storage nodes tailored for Agents, and a re-architected, tiered memory system optimized for access patterns, security, and cost-per-token efficiency.
marsbit43 dk önce
