NVIDIA HBM in Short Supply, Next-Gen GPUs Limited, but This Storage Drive Steals the Spotlight

marsbitОпубліковано о 2026-08-11Востаннє оновлено о 2026-08-11

Анотація

The article discusses how AI Agents are transforming storage from a passive repository into an active component within AI inference and operation loops. As Agents perform continuous tasks involving models, memory, tools, and logs, data storage needs to evolve beyond simple block devices. The concept of "functional SSDs" is introduced, where capabilities like automatic encryption, compression, indexing, and memory management are embedded closer to the storage medium. This shift is driven by the need to handle Agent-specific data chains—including context, tool trajectories, and long-term memory—more efficiently. The piece analyzes current trends like AI SSDs from companies such as Phison (aiDAPTIV), Longsys (SPU+iSA), and Maxio, which are beginning to participate in the AI data path by managing model weights, KV cache, and prefetching. It further explores the future re-division of labor across the memory hierarchy: HBM for core compute, emerging High Bandwidth Flash (HBF) for read-intensive workloads, DRAM/CXL for mutable state, and functional SSDs for persistent, governed objects like Agent Memory. The conclusion is that storage will become integral to Agent capability, moving from just saving data to enabling next-step actions. The industry is poised to develop along three paths: functionalized SSDs, storage nodes tailored for Agents, and a re-architected, tiered memory system optimized for access patterns, security, and cost-per-token efficiency.

As encryption, compression, indexing, memory, and context services move closer to the storage medium, the value boundaries of SSD, DRAM, HBM, and HBF will be redrawn.

AI Agents are transforming computers from systems that "complete a model call after receiving a problem" into running systems that continuously observe, reason, call tools, modify the environment, and maintain state.

A single task might continuously access models, memory, vector indices, business databases, object storage, and web services, while also constantly writing back tool results, execution traces, user preferences, temporary context, and audit logs. The longer an Agent runs, the more its value depends on whether data can be securely saved, correctly retrieved, timely updated, and reused at low cost [1].

This means storage is no longer just the endpoint where data lands after an Agent finishes its work. It is progressively entering the Agent's perception, memory, and decision loops. AI SSDs have already shown the first directions: storing models and adapters, hosting KV Cache evicted from memory, reducing cold start times, and expanding deployable model capacity. Taking a step further, SSDs may also perform encryption, compression, deduplication, tagging, indexing, version maintenance, and lifecycle governance when data is written, and provide long-term capacity for Agent Memory.

This change hasn't appeared out of thin air. Self-encrypting drives can already transparently encrypt and decrypt data within the controller; computational storage standards list compression, encryption, regular expression filtering, and erasure coding as functions that can be executed by the storage side; products like Samsung's SmartSSD have offloaded database scans and video processing to the drive side [4][5][7]. What's new in the Agent era is that these capabilities are no longer solely serving general-purpose data processing but are starting to be reorganized around agent identity, context, memory, tool traces, and token cost.

Future markets might see products named "Secure SSD," "Compression SSD," "Retrieval SSD," "Memory SSD," or "Context SSD," or perhaps these won't form distinct hardware categories but will converge into programmable functional SSDs: the base form remains compatible with standard storage, while upper-layer software discovers and invokes device functions based on the scenario.

NVMe has already formed command sets like Computational Programs and Subsystem Local Memory, providing a standardized path for discovering, configuring, and executing device-side programs [6]. The real industry question is not just whether a processor can be placed inside the drive, but who defines the data semantics, functional boundaries, and end-to-end outcomes.

An Agent is Not a Single Call

But a Continuously Written Data Chain

The primary persistent object for traditional chatbots is conversation history, whereas Agents will generate more complex data graphs. They need to save observations, tool outputs, plans and reflections, intermediate task states, user profiles, environment snapshots, retrieved evidence, and execution logs; the model side also generates KV Cache, Prefix Cache, Adapters, expert weights, and Checkpoints. These objects have different update frequencies, reuse scopes, and security levels, yet collectively determine whether subsequent reasoning can continue.

Agent Memory is also not simply stuffing all historical conversations into a vector database. Recent systematic research on Agent Memory from a data management perspective breaks it down into four modules: representation & storage, information extraction, retrieval & routing, and maintenance, noting that no single architecture excels across all workloads [9].

Systems like Mem0 similarly emphasize converting raw conversations into more compact, reusable long-term memory to reduce input tokens and retrieval burden in long sessions [10]. This implies that the storage layer in the future must not only store content but also store how the content is organized, updated, and forgotten.

Therefore, Agent data persistence requires a richer contract than "write succeeded." A memory object should carry attributes like user/agent identity, tenant, source, time, version, permission, trustworthiness, retention period, and deletability; model context also needs to bind to model version, tokenizer, positional encoding, and adapter. Only when namespaces and lifecycles are explicitly defined can subsequent compression, indexing, caching, and sharing avoid breaking semantic boundaries.

The appropriate role for a functional SSD in this data chain is not to independently judge whether an experience is worth remembering, but to execute deterministic work close to the data once the Runtime has provided the object and policy. For example, selecting keys per tenant, placing data according to lifecycle, compressing and deduplicating eligible objects, maintaining index pages and metadata, prioritizing the reload of data about to be used for inference, and providing feedback on tail latency, write amplification, and media health to the upper layer. Semantic decisions stay with the Agent and Runtime, while data execution gets as close to the medium as possible.

Figure 1. The capability spectrum of functional SSDs in the Agent era. Security, content reduction, indexing, memory, inference context, and governance functions can be solidified in the device or co-executed by downloadable programs, Runtime, and storage nodes. The figure is an industry mechanism inference; computational storage and security capability boundaries refer to SNIA and NVMe specifications [4][5][6].

Key Judgment: The SSD upgrade in the Agent era is not simply about adding in-drive compute power, but about combining standard block devices, discoverable near-data functions, object semantics, and lifecycle governance. Functions closer to the medium should be more deterministic, auditable, and isolatable; decisions closer to the model need to remain in the Runtime.

Automatic Encryption Already Exists; the Change is that Policies are Starting to Follow Agents

"Automatically encrypting data on write" is not a futuristic concept. Self-encrypting drives (SEDs) use dedicated hardware in the controller to encrypt data on writes and decrypt on reads, achieving transparent data-at-rest protection through key management and policy control [5].

For Agent systems, the new requirement is that the encryption granularity evolves from the entire drive or a single namespace to a finer level of user, agent, task, and object: personal memory and application cache on the same endpoint device must not be able to breach each other's boundaries, and shared context for multi-tenant Agents on the cloud side must clearly define what is reusable and what is readable only within a single permission domain.

The NVMe specification has already introduced capabilities like host-managed keys and Key Per I/O [6], laying the foundation for carrying different security contexts with each I/O. Future security-focused SSDs may also combine data provenance, timestamps, access records, integrity verification, and secure deletion, enabling an Agent to not only answer "what do I remember" but also "where did this memory come from, has it been modified, who read it, and when must it be deleted." For finance, healthcare, enterprise knowledge bases, and personal AI, the chain of evidence can be as crucial as retrieval speed.

Encryption also changes the sequence of other near-data functions. Encrypted byte streams are typically difficult to compress and deduplicate effectively, so content reduction should generally precede encryption [5]; indexing needs to distinguish between plaintext features, protected metadata, and searchable ciphertext boundaries. The competitiveness of a functional SSD lies not only in how many functions it has but also in whether it can correctly orchestrate compression, indexing, encryption, persistence, and deletion with a verifiable pipeline, while avoiding expanding the attack surface at any step.

Compression, Indexing, and Memory Maintenance Could Become the Next Set of SSD Functions

Compression is one of the functions easiest to form a commercial closed loop. Agents repeatedly write text, JSON, logs, vectors, checkpoints, and multimedia intermediate results, a significant portion of which has structural redundancy. If compression is completed before data enters the network or NAND, it can reduce transmission, physical writes, capacity usage, and indirectly lower energy consumption and media wear. However, compression ratio, added latency, CPU savings, and write amplification must be weighed together; for already quantized or highly compressed model weights, further compression may offer limited benefit.

The indexing function has a more direct relationship with Agents because memory only has value if correctly recalled. KIOXIA's AiSAQ places vectors and index structures on the SSD, using SSD-friendly clustering and graph search to reduce DRAM footprint, and has demonstrated tens of billions of vector scale retrieval on a single server [8]. It is crucial to distinguish that AiSAQ is primarily a software technology using SSDs as the main index carrier; it does not mean ordinary SSDs will automatically generate embeddings or understand semantics. A more likely industry path is that GPUs, NPUs, or CPUs are responsible for generating representations, while SSDs and near-data programs handle organizing indexes, filtering candidates, and returning smaller result sets.

Memory maintenance is more complex than indexing. Long-term Agent Memory involves addition, merging, conflict, revision, deprioritization, expiration, and forgetting; the same fact may also exist simultaneously as raw record, summary, vector, and knowledge graph representation [9]. Future "Memory SSDs" could provide atomic updates, logs, TTLs, hot/cold placement, and secure deletion for these versions, but they cannot determine what constitutes true memory based solely on similarity. Memory quality still depends on upper-layer extraction, routing, conflict resolution, and evaluation.

From a product perspective, these functions may not require every drive to run complex models. Compression, encryption, hashing, filtering, index page maintenance, and object lifecycle management are suitable for deterministic dedicated circuitry or lightweight programs; embedding generation, reranking, summarization, and memory consolidation are likely performed by the host or independent accelerators.

The key for functional SSDs is to connect these two types of work using unified object IDs and observable interfaces, thereby reducing data movement, rather than cramming all AI computation into the drive.

Edge-side: SSDs Could Become the Long-Term State Layer for Personal Agents

Edge-side Agents continuously interact with personal documents, photos, emails, schedules, application states, browsing history, and device sensor data. Unified memory is only suitable for retaining the current working set, while SSDs can store larger local model libraries, adapters, vector indices, personal memory, and tool traces. As long as they maintain the standard NVMe form factor, functional SSDs can first be directly installed as ordinary system drives in AI PCs and workstations, then gradually enable security, indexing, and context capabilities through drivers, runtime, and firmware.

Their value to consumers isn't "the hard drive can think," but that local AI can remember longer, continue working in weak network conditions, and reduce the amount of raw data and input tokens uploaded to the cloud per task. A meeting Agent can retain audio, summaries, and task state; a programming Agent can maintain repository indices and change history; a home Agent can share authorized photos, documents, and device statuses across devices. The SSD keeps this state near the device, while a Router decides whether to process locally or call the cloud based on quality, privacy, power consumption, and network conditions.

The edge market might also expand from a single drive to small storage nodes. AI PCs, home servers, or storefront edge boxes could provide local model images, personal memory, vector libraries, and encrypted archives for phones, tablets, robots, and cameras, preventing each device from redundantly storing the same data set. The business model could evolve from capacity upgrades to AI PC premiums, local Agent subscriptions, model & skill pack management, and private AI nodes for homes and small businesses.

Local storage does not automatically equal privacy. If applications can arbitrarily read memory, indices cannot delete old versions, or keys are disconnected from device identity, more features could mean a larger attack surface. Edge functional SSDs must treat application isolation, user consent, retention periods, verifiable deletion, and key revocation upon device loss as product capabilities, not just marketing slogans.

Cloud-side: SSDs Will Evolve from Devices to Agent Storage Nodes

Cloud-side Agent state is larger in scale and more in need of sharing. A complex request may chain multiple model calls, tool executions, memory accesses, and network transfers; multi-agent collaboration also generates shared plans, messages, evidence, and execution logs [1]. Node-local SSDs can store models, checkpoints, and high-frequency indices; rack or pod-level flash tiers can host KV, prefix, adapters, and shared memory reused across GPUs; general-purpose object storage continues to hold cold data and long-term fact sources.

Mooncake has already organized CPUs, DRAM, SSDs, and RDMA/NIC into a distributed KV Cache pool, letting the scheduler decide request paths based on cache location and TTFT/TBT targets [3]. NVIDIA's CMX establishes a pod-level flash context layer for KV Cache between HBM, host memory, and general-purpose shared storage, integrating shared storage nodes into the inference data path [2]. The end-to-end benefits of these systems cannot be attributed to a single SSD, but they indicate that "storage nodes participating in token production" is moving from concept to infrastructure product.

The next generation of Agent storage nodes might simultaneously provide context, memory, and governance services. It could maintain shared prefix and KV directories, pre-warm models and adapters, store vector and graph indices, compress and encrypt data per tenant, log tool calls and evidence chains, and expose hit rate, P99 latency, write amplification, energy consumption, and media health to the scheduler. Customers would be buying not just drive capacity and bandwidth, but GPU utilization, SLO goodput, Tokens/$, Tokens/Watt, QPS/$, and audit response speed.

This will also change the business model. Single drives can still be sold based on capacity, endurance, and performance; storage nodes could generate combined revenue as multi-drive appliances, control plane software, runtime licenses, long-term support, and SLAs; higher up, services might be billed based on effective context capacity, memory object count, retrieval throughput, or effective tokens. Once functional SSDs become accountable for end-to-end outcomes, their value boundary expands from semiconductor components to data infrastructure.

Figure 2. Typical division of labor for edge and cloud Agent storage. Edge emphasizes personal data, local models, offline capability, and privacy control; cloud emphasizes shared context, multi-tenant governance, GPU utilization, and token economics. The figure illustrates product form factor inferences; cluster-side references include Mooncake and CMX [2][3].

The Value Boundaries of HBM, HBF, DRAM, and SSD Will Be Redrawn

The storage restructuring brought by Agents should not be interpreted as SSDs replacing memory. The tiered memory concept proposed by SK hynix at FMS 2026 connects HBM, DRAM, NAND/HBF, and SSD by speed, capacity, and cost, focusing on reducing data movement [11]. This aligns with the reality of Agent systems: data required for the current token, data needed within a few milliseconds, data potentially reusable across sessions, and long-term archived data need to be handled by different media.

HBM remains the core layer closest to GPU compute, hosting current weights, activations, hot KV cache, and intermediate operator states, with metrics being Tokens/s, bandwidth, and compute utilization. Agents' long context and multi-model collaboration will further increase HBM demand, not diminish its value. The constraints for HBM are capacity cost and supply, so systems need to move data not immediately needed to lower-cost tiers and accurately pre-fetch it before use.

HBF, or High Bandwidth Flash, is a new tier that has rapidly taken shape since 2025. The first open specifications disclosed by SK hynix and SanDisk in August 2026 cover capacities up to 512GB, bandwidth divided into three levels from ~0.4TB/s to 3.0TB/s, and UCIe connectivity to processors [12]. HBF uses NAND to achieve larger capacity than HBM, aiming to host large, read-intensive inference working sets between HBM and SSDs. It is still in the early stages of standardization and productization; official specs don't equate to widespread production performance, nor do they eliminate NAND's limitations in latency, write endurance, and variable state access.

The H3 research suggests a clearer division of labor: place read-only data in HBF and keep other data in HBM, building a hybrid inference system leveraging the strengths of both [13]. For Agents, HBF is more suitable for model weights, MoE experts, and large working sets dominated by reads; frequently updated KV cache, activations, and runtime states are still more suitable for HBM or DRAM. If HBF matures, it might reduce the need to add more GPU/HBM for capacity reasons, but more likely it will complement rather than replace them.

DRAM and CXL occupy the middle ground for mutable state and shared capacity. Host KV, index hot sets, prefetch buffers, and Agent runtime states require low latency and frequent modification; CXL expansion, pooling, and sharing can reduce memory islands and provide more flexible capacity to multiple hosts [14]. SK hynix also demonstrated CXL pooled memory and DRAM-SSD hybrid solutions for KV sharing, prediction, and prefetching at FMS 2026, but these are specific demo results requiring validation on more platforms [11].

Functional SSDs handle larger, more persistent, and more governance-intensive warm/cold objects: models, adapters, KV/prefix, vector indices, Agent Memory, logs, and checkpoints. Compared to HBF, SSDs are farther from compute but possess standard form factors, mature ecosystems, capacity and cost advantages, and are better suited for node-level sharing. Future competition won't revolve solely around media bandwidth but around who can deliver the right object within the right deadline and be accountable for effective tokens, retrieval throughput, and data governance.

Figure 3. Re-division of labor among HBM, HBF, DRAM/CXL, functional SSDs, and shared storage in the Agent era. HBF specifications use the first open standard specifications disclosed by SK hynix and SanDisk in August 2026 [12]; tiering logic references FMS 2026 Tiered Memory, H3, and CXL materials [11][13][14].

AI SSDs are the First Industrial Examples of Functional SSDs

Current AI SSDs generally enter this trend from two ends. One end is enterprise SSDs optimized for AI workloads, providing a medium foundation for model caching, checkpoints, and vector indices through low latency, high IOPS, sustained bandwidth, endurance, and capacity density. Representatives in this category include Yingren Technology's Dongting N3X and Huawei's OceanDisk LC 560 [19][20]. They primarily address whether AI data can be stably hosted, continuously written, and promptly recalled. They don't automatically possess Agent Memory, indexing, or context semantics just because they are AI-oriented. The other end actively participates in the inference data path: SSDs no longer merely receive generic block requests from the OS but, through middleware, runtime, or storage-side processing capabilities, gradually identify AI objects like model weights, experts, KV cache, and prefetch windows. Phison, Longsys, and Innopeak-Lianyung are three representative research and development approaches in this direction.

Phison's aiDAPTIV adopts a "mature SSD capabilities + middleware + complete toolchain" approach. aiDAPTIVLink manages memory between GPU VRAM and flash, slicing model weights at runtime, prioritizing active weights in VRAM, offloading inactive weights to aiDAPTIVCache SSD, and potentially saving evicted KV cache to avoid recomputation when context is discarded [15]. The commercial value of this path lies in combining SSD, software license, deployment tools, and system support into a deliverable solution: customers can expand usable model and context capacity on workstations or local servers without redesigning compute chips. Its technical focus is compatibility with existing GPU and AI software ecosystems, leveraging mature controllers, firmware, endurance design, and platform partnerships to turn flash into a stable capacity layer alongside VRAM.

Longsys's SPU+iSA is closer to a "storage execution layer + software decision layer" combination. The SPU handles lossless compression, HLC advanced caching, and data scheduling between different NAND media on the device side; iSA makes decisions around MoE expert offloading, KV cache lifecycle, and Device Smart Prefetch, translating AI workload characteristics into prefetch, backfill, compression, and hot/cold migration actions [16]. Thus, it focuses not only on fitting more data into the SSD but also on reducing DRAM footprint, increasing effective capacity, and aligning storage-side processing with endpoint inference rhythm. This path shows that when the controller vicinity possesses stronger execution capabilities, SSDs can evolve from block devices into near-data processing nodes capable of handling compression, caching, and object scheduling.

The Innopeak-Lianyung approach adopts a compute-storage co-defined route. Innopeak starts from model architecture, runtime, OS, CPU/GPU/DRAM synergy, and system reference designs to observe expert activation, KV lifecycle, data precision, and compute windows; Lianyung maps these requirements onto SSD controller, firmware, cache partitioning, queues, NAND adaptation, and mass production systems [17][18]. This allows product definition to reason backward from token latency, model capacity, and system SLO to determine when data should enter the SSD, at what granularity to save it, how to prefetch, and which operations are suitable to offload near the controller, rather than just optimizing existing block I/O. Compared to the previous two paths, this cross-compute-storage collaboration requires deeper system synergy but is more likely to identify new data path problems early and form new device interfaces as model architectures and inference infrastructure continuously evolve.

These three paths are not mutually exclusive. Phison's strength lies in packaging capabilities into deployable solutions rapidly through mature controllers, SSD products, and software toolchains; Longsys attempts to place more processing and scheduling on the storage side with SPU and iSA; Innopeak-Lianyung reverse-engineers device definitions from the junction of compute semantics and storage execution. Together, they illustrate that the core innovation of AI SSDs has shifted from "replacing the drive with a faster one for AI" to "re-partitioning responsibilities between Runtime, memory hierarchy, controller, and flash." This is also why AI SSDs can serve as precursors to functional SSDs: once software can convey object type, priority, lifecycle, and service deadline to the device, the SSD gains the foundation to host more deterministic functions.

Similar R&D approaches could very well migrate to next-generation functional SSDs. Following Phison's path, vendors could add encryption, compression, indexing, and memory service modules managed per Agent or tenant within the SSD+middleware combo, lowering deployment barriers through software compatibility and delivery tools. Following Longsys's path, compression, hot/cold scheduling, index scans, or data consolidation could be executed by the storage processing unit, with policies issued by an upper-layer intelligent scheduler. Following Innopeak-Lianyung's path, one could start from Agent runtime requirements for long-term memory, permissions, TTL, retrieval SLO, and token cost, then co-define controller commands, object metadata, firmware queues, and media layout. The first two paths excel in productization and device-side execution, respectively. The latter path, because it understands both how compute systems consume data and how storage systems organize data, potentially has greater design space when exploring new functions not yet standardized.

This cross-domain background will be even more significant in the Agent era. Many future storage functions are not purely in-drive algorithms: encryption needs to understand permission boundaries for agents, users, and tasks; compression needs to know when data will be used for computation again; indexing needs to collaborate with embedding generators, retrievers, and model routers; Agent Memory also involves writing, merging, forgetting, versioning, and evidence chains. Starting solely from the medium side can easily reduce the problem to bandwidth, capacity, or single operators; starting solely from the model side may overlook FTL, write amplification, tail latency, power-loss protection, and mass production constraints. Collaborative R&D approaches like Innopeak-Lianyung's are precisely positioned to find implementable interfaces between these two sets of constraints, thus having the potential to form differentiated technology paths when developing new functional SSDs, AI storage nodes, and even Agent data infrastructure.

From the functional SSD perspective, the importance of these schemes lies not just in whether they can expand a specific model's capacity, but in that they establish channels for software to exchange information with the medium. Today, they convey model layers, experts, KV blocks, and prefetch hints; tomorrow, they could extend to Agent identity, memory objects, versions, TTLs, access policies, indexing hints, and deadlines. Whoever can solidify functions into stable interfaces, rather than customizing one-off paths for a single model, is more likely to transcend model generations and expand single-drive revenue into runtime licenses, storage nodes, context services, and data services billed per effective token.

Beware of concept inflation. Auto-compression doesn't mean all data saves the same capacity; on-drive indexing doesn't mean the SSD understands semantics; Agent Memory isn't moving a vector database into firmware. Each function should be proven by end-to-end metrics, including compression ratio vs. added latency, recall rate vs. QPS/$, P99 vs. SLO, write amplification vs. endurance, key isolation vs. deletion verification, and ultimately, Tokens/$ and Tokens/Watt.

Figure 4. Representative products of AI workload-optimized enterprise SSDs: Yingren Technology's Dongting N3X and Huawei's OceanDisk LC 560. Original images retained; product information from [19][20].

Figure 5. Explorations in inference-participatory AI SSDs: Phison aiDAPTIV, Longsys SPU+iSA, and Innopeak-Lianyung AI SSD approach. Original images retained; path information from [15][16][17][18].

Figure 6. The role of AI SSDs in the LLM inference path and major vendor technology paths summarized in the original article. Original image retained; the added perspectives of encryption, compression, indexing, Agent Memory, HBF, and tiered storage are industry extensions based on this, not altering the existing logic in the figure.

The Future Industry May Develop Along Three Directions Simultaneously

The first direction is the functionalization of SSDs. General-purpose drives will continue to exist, but capabilities like security, compression, retrieval, memory, and context will enter products as fixed functions, downloadable programs, or software-defined configurations. The end market may not need five different SSD types but rather a framework of discoverable, composable, and isolatable functions, with consumer, enterprise, and cloud service products choosing different capability combinations.

The second direction is the nodalization of storage. Single drives solve local capacity and near-data processing, while AI storage nodes combine multiple drives, networking, object directories, keys, indices, context services, and observability, being accountable for end-to-end SLO. Edge nodes serve individuals and device fleets; cloud nodes serve GPU clusters and multi-agent systems. The competitive unit will expand from "per drive" to "how many effective tokens and retrieval requests can a site, rack, or POD deliver."

The third direction is the re-composition of the memory hierarchy. HBM continues to pursue peak bandwidth, HBF attempts to provide larger read-intensive capacity near the package using NAND, DRAM and CXL handle mutable state, expansion, and pooling, functional SSDs provide persistent objects and near-data services, and shared storage holds global cold fact sources. The most valuable system capability will be enabling routers and runtimes to simultaneously see compute power, data location, permissions, deadlines, and media state, orchestrating across multiple tiers instead of relentlessly stacking a single medium.

This will redraw industry barriers. Media vendors control capacity, bandwidth, and efficiency; controller and firmware vendors determine if functions can be stably implemented; runtimes and Agent platforms control object semantics and scheduling; OEMs, cloud providers, and system integrators decide how functions enter real products. Companies that can cross these boundaries, establish standard interfaces, and prove customer outcomes with token economics are more likely to propel SSDs from data containers to the foundational data layer of the Agent era.

Conclusion: Storage Will Become Part of Agent Capability

AI Agents extend storage's value from "preserving the past" to "enabling the next action." Models need weights, inference needs context, Agents need long-term memory and trustworthy evidence, and enterprises need security, compliance, auditing, and cost control. The closer encryption, compression, indexing, memory maintenance, and context services are to the data, the greater the opportunity to reduce movement, recomputation, and DRAM footprint, but the greater the need for clear permission, semantic, and responsibility boundaries.

Therefore, AI SSDs are just the starting point. The future may see more SSDs with specific functions, or converge into unified programmable functional SSDs and Agent storage nodes. Meanwhile, HBM, HBF, DRAM, CXL, and SSDs won't evolve along a simple substitution chain but will re-divide labor based on access frequency, mutability, sharing scope, and retention period. The real industrial opportunity lies in translating the advantages of each medium into lower token cost, higher Agent continuity, and more trustworthy data lifecycle.

References:

[1] NVIDIA, "Scaling Agentic AI Factories Through Extreme Co-Design with NVIDIA BlueField," 2026.https://developer.nvidia.com/blog/scaling-agentic-ai-factories-through-extreme-co-design-with-nvidia-bluefield/

[2] NVIDIA, "Introducing NVIDIA BlueField-4-Powered CMX Context Memory Storage Platform for the Next Frontier of AI," 2026.https://developer.nvidia.com/blog/introducing-nvidia-bluefield-4-powered-inference-context-memory-storage-platform-for-the-next-frontier-of-ai/

[3] R. Qin et al., "Mooncake: Trading More Storage for Less Computation—A KVCache-centric Architecture for Serving LLM Chatbot," USENIX FAST ’25, 2025.https://www.usenix.org/conference/fast25/presentation/qin

[4] SNIA, "Computational Storage Architecture and Programming Model, Version 1.0," 2022.https://www.snia.org/sites/default/files/technical-work/computational/release/SNIA-Computational-Storage-Architecture-and-Programming-Model-1.0.pdf

[5] SNIA, "Storage Security: Encryption and Key Management," 2023.https://www.snia.org/sites/default/files/technical-work/whitepapers/SNIA-Encryption-KM-WP-2023-09-05.pdf

[6] NVM Express, "NVM Express Releases Specifications to Unify AI, Cloud, Client and Enterprise Storage," 2024.https://nvmexpress.org/nvm-express-releases-nvm-express-specifications-to-unify-ai-cloud-client-and-enterprise-storage/

[7] Samsung Electronics, "Samsung Electronics Develops Second-Generation SmartSSD Computational Storage Drive," 2022.https://news.samsung.com/global/samsung-electronics-develops-second-generation-smartssd-computational-storage-drive-with-upgraded-processing-functionality

[8] KIOXIA, "AiSAQ Achieves 4.8 Billion High-Dimensional Vector Search Database on a Single Server," 2026.https://americas.kioxia.com/en-us/business/news/2026/ssd-20260316-2.html

[9] Y. Wang et al., "Are We Ready for an Agent-Native Memory System?," arXiv:2606.24775, 2026.https://arxiv.org/abs/2606.24775

[10] P. Chhikara et al., "Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory," arXiv:2504.19413, 2025.https://arxiv.org/abs/2504.19413

[11] SK hynix, "The Next-Generation Memory Architecture in the AI Era? SK hynix Charts the Direction at FMS 2026," 2026.https://news.skhynix.com/en/fms-2026/

[12] SK hynix, "SK hynix Unveils First HBF Standard Specifications with Sandisk," 2026.https://news.skhynix.com/en/hbf-at-fms-2026/

[13] M. Ha, E. Kim, and H. Kim, "H3: Hybrid Architecture Using High Bandwidth Memory and High Bandwidth Flash for Cost-Efficient LLM Inference," IEEE Computer Architecture Letters, 2026.https://ieeexplore.ieee.org/document/11371745

[14] Compute Express Link Consortium, "Overcoming the AI Memory Wall: How CXL Memory Pooling Powers Scalable AI Computing," 2025.https://computeexpresslink.org/blog/overcoming-the-ai-memory-wall-how-cxl-memory-pooling-powers-the-next-leap-in-scalable-ai-computing-4267/

[15] Phison Electronics, "How aiDAPTIV+ Works," official product documentation.https://phisonaidaptiv.com/zh-tw/how-aidaptiv-works/

[16] Longsys, "SPU & iSA", 2026. https://cn.longsys.com/about/news/13353.html

[17] Lianyung Technology, "CFMS 2026|AI Inference Era, the Value Leap of Storage Controller Chips", 2026. https://www.maxio-tech.com/news/11645/13048.html

[18] Economic Observer, "Innopeak Partners with AMD to Launch Infplane Mini AI Workstation: Hilbert", 2025. https://www.eeo.com.cn/2025/1222/774317.shtml

[19] Yingren Technology, "From N3X to Gen6: How Yingren Technology Builds Domestic AI SSDs with Three Key Factors", 2026. https://www.yingren.cn/news/%E4%BB%8En3x%E5%88%B0gen6%EF%BC%9A%E8%8B%B1%E9%9F%A7%E7%A7%91%E6%8A%80%E5%A6%82%E4%BD%95%E7%94%A8%E4%B8%89%E5%A4%A7%E8%A6%81%E7%B4%A0%E6%89%93%E9%80%A0%E5%9B%BD%E4%BA%A7ai-ssd/

[20] Huawei, "Huawei OceanDisk LC 560 SSD Data Sheet," 2025. https://e.huawei.com/en/documents/products/storage/97dc7a1dc98f4d3d90b268db03235cf7

This article comes from WeChat public account "Xinzhiyuan", author: ASI Apocalypse, editor: Solomon

Трендові криптовалюти

Пов'язані питання

QWhat is the core idea behind 'Functional SSDs' in the era of AI Agents, according to the article?

AThe core idea is that SSDs will evolve beyond simple block storage devices by integrating functions like encryption, compression, indexing, memory maintenance, and context services directly near the storage medium. These 'Functional SSDs' aim to manage data with awareness of its semantic context (like Agent identity, user permissions, and lifecycle) to reduce data movement, improve efficiency, and lower the overall cost per token in AI operations.

QHow does the role of storage change with the transition from traditional AI models to AI Agents?

AWith AI Agents, storage transforms from being a passive endpoint for saving final results into an active component within the Agent's perception, memory, and decision-making loop. It continuously writes and retrieves complex data like tool outputs, execution logs, user preferences, context, and memory states, which are crucial for the Agent's persistent operation and stateful reasoning.

QWhat is the proposed division of labor between different storage hierarchies (HBM, HBF, DRAM/CXL, SSD) in AI Agent systems?

AThe article proposes a tiered approach: HBM handles current computations and hot data; HBF (High Bandwidth Flash) provides high-bandwidth, read-intensive capacity for model weights and large datasets; DRAM/CXL manages variable states and shared memory pools; and Functional SSDs offer persistent, cost-effective storage for long-term Agent memory, models, indexes, and data requiring governance (encryption, compression, lifecycle management).

QWhat are the three main industrial directions for the future of storage as outlined in the article?

A1. Functionalization of SSDs: Integrating specific, discoverable functions (security, compression, etc.) into SSD products or a unified programmable framework. 2. Nodification of Storage: Combining multiple drives, networking, and services into AI storage nodes (for edge or cloud) that deliver end-to-end service-level objectives (SLOs). 3. Reorganization of Memory Hierarchy: Coordinating different storage tiers (HBM, HBF, DRAM/CXL, SSD) based on data heat, mutability, sharing scope, and access deadlines to optimize system efficiency and token economics.

QWhat are some key challenges or risks mentioned regarding the development of advanced 'Functional SSDs' for AI Agents?

AKey challenges include: defining clear boundaries for data semantics and accountability between the Runtime/Agent and the storage device; ensuring functions like compression, indexing, and memory maintenance are provably effective with measurable metrics (like latency, recall rate, write amplification); and managing increased security risks and attack surfaces, especially regarding privacy, data isolation, and verifiable deletion for sensitive Agent memories.

Пов'язані матеріали

U.S. Stock Market Trend (August 11): Oil Prices Surge, Treasury Yields Rise, Tech Stocks Under Pressure, Optical Communication Plummets

U.S. Stock Market Trends (August 11): Oil Surge and Rising Bond Yields Pressure Tech; Optical Communication Stocks Plunge. U.S. stock indices closed slightly lower on Monday, with the S&P 500 and Dow Jones retreating from recent record highs. The primary market pressures were a significant oil price jump of over 5% amid unresolved negotiations to reopen the Strait of Hormuz and a consequent rise in U.S. Treasury yields, which weighed on growth stock valuations. The technology sector faced pressure, with Nvidia falling nearly 3% despite news of its pursuit of a $500 billion AI infrastructure financing consortium with major Wall Street firms. The optical communication sector saw a sharp sell-off, with Coherent dropping over 14%. In contrast, Chinese stocks listed in the U.S. were a notable bright spot, as the Nasdaq Golden Dragon China Index rose nearly 2%. Gold prices advanced for a second consecutive session on inflation hedging demand, while Bitcoin fell below $64,000. Key market movers included surging oil prices (WTI and Brent up ~5%) due to stalled Strait of Hormuz talks and heightened supply concerns, pushing the 10-year Treasury yield near 4.71%. Major tech stocks were mixed. Beyond Nvidia's decline, Intel fell over 4% on a new share offering plan. The Philadelphia Semiconductor Index dropped approximately 1.2%. Market attention remains on oil price dynamics, the impact of rising yields, and the forthcoming U.S. CPI data.

marsbit4 хв тому

U.S. Stock Market Trend (August 11): Oil Prices Surge, Treasury Yields Rise, Tech Stocks Under Pressure, Optical Communication Plummets

marsbit4 хв тому

JP Morgan Research Report Analysis: SK Hynix Fell 15% Last Week, Concerns Over HBM Pricing Overblown and Shareholder Returns to Land Ahead of Schedule

JPMorgan Research Report Interpretation: Addressing Concerns on SK Hynix's Recent Share Price Decline SK Hynix's stock fell 15% last week, underperforming the KOSPI (-5%) and Samsung (-9%). Key investor concerns centered on HBM pricing uncertainty, unclear shareholder return timelines, and a recently disclosed ₩54 trillion capital expenditure plan. JPMorgan's August 9 report addresses each point. Regarding HBM, JPMorgan refutes inaccurate media reports suggesting potential 50% price discounts for HBM4 in 2027. The firm's conservative model assumes <40% average HBM price growth by 2027, based on factors including memory suppliers prioritizing high-margin DDR5/LPDDR5/NAND in LTA allocations and the long-term partnership with key customer NVIDIA. The most significant near-term catalyst is shareholder returns. SK Hynix has committed to announcing additional shareholder return measures before the end of Q3 (September), earlier than its prior "year-end" guidance. JPMorgan anticipates a progressive policy, supported by an estimated cumulative free cash flow exceeding ₩800 trillion over three years and proceeds from the Kioxia stake sale. The substantial ₩54 trillion capex plan is for two new memory fabs to support its 2030 roadmap, not short-term aggressive expansion. The Yongin Y2 DRAM fab (₩35.2tn) and Cheongju M17 NAND fab (₩19.1tn) have construction starts scheduled for 2027, with clean room completion and investments stretching to 2028-2031. JPMorgan sees limited strategic value in a potential IPO for subsidiary Solidigm, noting SK Hynix's strong internal cash flow can fund capex without dilution, and an IPO might trigger dual-listing rule constraints in Korea. The report concludes last week's sell-off was an overreaction. JPMorgan maintains its Overweight rating and ₩2.75 million price target (~7x avg. 2026-2027 EPS), asserting the memory super-cycle thesis and SK Hynix's fundamentals remain intact.

marsbit7 хв тому

JP Morgan Research Report Analysis: SK Hynix Fell 15% Last Week, Concerns Over HBM Pricing Overblown and Shareholder Returns to Land Ahead of Schedule

marsbit7 хв тому

The Post-Crypto Era Outlook: Asset Valuation Returns to Fundamentals, What to Watch for the Next Decade?

Cryptoeconomy at a Turning Point: Valuations Reset, Focus Shifts to Real Value The cryptoeconomy is undergoing its most significant transformation yet, moving from speculative excess to a focus on sustainable, value-generating applications. After the 2021 hype cycle, which saw unsustainable valuations, the market has experienced a prolonged "reversion to the mean." Structural issues like cyclical revenues, regulatory uncertainty, and misaligned incentives between equity and token holders led to widespread fatigue. However, these problems are now widely recognized and are being addressed. A key shift is the emergence of applications demonstrating real, compounding growth independent of token prices. These include peer-to-peer internet platforms, global digital dollars, permissionless exchanges, novel derivatives, global collateral markets, and open financing platforms. Leading blockchains like Ethereum and Solana are solidifying their positions as foundational monetary and financial layers for the internet. Simultaneously, traditional financial and tech institutions are accelerating their blockchain integration with production-grade products, moving beyond mere experiments. Clearer regulations are enabling a shift from compliance concerns to exploring new business models. While the broader cryptoeconomy's emergence appears inevitable—driven by declining institutional trust, monetary devaluation, and a desire for fairer systems—intense competition means only a few native projects will become the dominant winners. The current phase offers a unique opportunity for investors, as leading projects are potentially undervalued after years of consolidation. The task is no longer to debate the technology's viability but to identify and capitalize on the real value being built for the next decade.

marsbit7 хв тому

The Post-Crypto Era Outlook: Asset Valuation Returns to Fundamentals, What to Watch for the Next Decade?

marsbit7 хв тому

Outlook for the Post-Encryption Era: Asset Valuation Returns, What to Watch in the Next Decade?

The crypto economy is undergoing its most significant transformation in eight years, characterized by a shift from speculative frenzy to fundamental-driven growth. After the extreme overvaluation and unrealistic expectations of 2021, asset prices, including Bitcoin relative to gold, have corrected significantly. This reset has exposed structural industry weaknesses such as cyclical revenues, regulatory uncertainty, misaligned incentives between equity and token holders, poor disclosure, and a lack of common valuation frameworks, leading to widespread investor fatigue. However, this correction is healthy and has set the stage for a more mature phase. Numerous real-world use cases have emerged and are exhibiting compound growth, independent of token prices. These include peer-to-peer internet platforms, global digital dollars, permissionless exchanges, novel derivatives, global collateral markets, democratized asset creation, open fundraising platforms, and decentralized physical infrastructure networks. Key issues like dual-token models are being resolved, disclosure is improving, and a consensus is forming that most assets must generate cash flow. The leading blockchains (e.g., Ethereum, Solana) are becoming the monetary and financial base layer of the internet, with entrenched network effects. Established Wall Street and Silicon Valley institutions are now launching production-grade products on public chains, a shift accelerated by clearer regulations. While valuations have reset and growth models remain conservative, the potential for exponential growth remains. The broader macro environment—declining institutional trust, unsustainable sovereign debt, currency debasement, deglobalization, and a generational wealth transfer—is uniquely favorable for crypto's adoption. The market is not uniformly maturing; it consists of various products at different adoption stages where speculation will persist in cycles. The core opportunity lies in identifying the few native projects that will become foundational winners as the world rebuilds its economic systems. The current period of disillusionment conceals a generational opportunity for those betting on the new paradigm rather than mourning the old one.

Odaily星球日报41 хв тому

Outlook for the Post-Encryption Era: Asset Valuation Returns, What to Watch in the Next Decade?

Odaily星球日报41 хв тому

Cache hit rate reaches 99.93%, the best Harness for DeepSeek is here, GitHub pulls in 86k Stars

The open-source programming agent "Pi" has surged in popularity on GitHub, amassing around 86,000 stars, largely due to its exceptional efficiency when paired with DeepSeek's models. A key highlight is its remarkably high cache hit rate of approximately 99.93% for input tokens when using DeepSeek. This minimal cache miss rate of 0.07% means most repeated context is reused, drastically reducing computational costs. In a benchmark test by Composio comparing eight major agent harnesses running DeepSeek V4 Flash, Pi achieved the lowest average cost per successful task at about $0.028, significantly outperforming others like Claude Code, which was nearly seven times more expensive. Pi functions as a streamlined "harness" or workspace for AI models, providing core tools like file read/write and command execution while allowing users to add extensions. Its simplicity and specific adaptation for DeepSeek's API—handling its unique reasoning content and tool call formats—make it highly compatible. This design maximizes the efficiency of DeepSeek's low-cost tokens and powerful caching mechanism, as the agent's linear workflow avoids unnecessary changes to earlier prompt sections. While DeepSeek has officially announced its own harness project targeting Claude Code, Pi remains a versatile, user-customizable platform supporting multiple AI providers. It offers developers a cost-effective and flexible alternative, setting a high bar for future official solutions.

marsbit1 год тому

Cache hit rate reaches 99.93%, the best Harness for DeepSeek is here, GitHub pulls in 86k Stars

marsbit1 год тому

Торгівля

Спот

Популярні статті

Як купити T

Ласкаво просимо до HTX.com! Ми зробили покупку Threshold Network Token (T) простою та зручною. Дотримуйтесь нашої покрокової інструкції, щоб розпочати свою криптовалютну подорож.Крок 1: Створіть обліковий запис на HTXВикористовуйте свою електронну пошту або номер телефону, щоб зареєструвати обліковий запис на HTX безплатно. Пройдіть безпроблемну реєстрацію й отримайте доступ до всіх функцій.ЗареєструватисьКрок 2: Перейдіть до розділу Купити крипту і виберіть спосіб оплатиКредитна/дебетова картка: використовуйте вашу картку Visa або Mastercard, щоб миттєво купити Threshold Network Token (T).Баланс: використовуйте кошти з балансу вашого рахунку HTX для безперешкодної торгівлі.Треті особи: ми додали популярні способи оплати, такі як Google Pay та Apple Pay, щоб підвищити зручність.P2P: Торгуйте безпосередньо з іншими користувачами на HTX.Позабіржова торгівля (OTC): ми пропонуємо індивідуальні послуги та конкурентні обмінні курси для трейдерів.Крок 3: Зберігайте свої Threshold Network Token (T)Після придбання Threshold Network Token (T) збережіть його у своєму обліковому записі на HTX. Крім того, ви можете відправити його в інше місце за допомогою блокчейн-переказу або використовувати його для торгівлі іншими криптовалютами.Крок 4: Торгівля Threshold Network Token (T)Легко торгуйте Threshold Network Token (T) на спотовому ринку HTX. Просто увійдіть до свого облікового запису, виберіть торгову пару, укладайте угоди та спостерігайте за ними в режимі реального часу. Ми пропонуємо зручний досвід як для початківців, так і для досвідчених трейдерів.

721 переглядів усьогоОпубліковано 2024.12.10Оновлено 2026.06.02

Як купити T

Обговорення

Ласкаво просимо до спільноти HTX. Тут ви можете бути в курсі останніх подій розвитку платформи та отримати доступ до професійної ринкової інформації. Нижче представлені думки користувачів щодо ціни T (T).

活动图片