A Memory Reduction Report Triggers a Plunge: Is It an Overreaction?

marsbitPublished on 2026-06-05Last updated on 2026-06-05

Abstract

A supply chain report regarding NVIDIA's Rubin platform's system memory configuration triggered a significant sell-off in AI memory stocks. The report suggested a potential reduction in per-rack CPU-side system memory (SOCAMM/LPDDR) from ~55TB to ~28TB, impacting the perceived value per cabinet. This led to sharp declines for Micron and SK Hynix, as the market broadly reacted to the negative headline of "memory cut," without initially distinguishing between CPU system memory and GPU-side HBM4. The article clarifies that the reported adjustment primarily affects the CPU-side system memory profit pool, not the HBM4 demand tied directly to GPUs, which remains a critical and supply-constrained component. The sell-off is interpreted as a high-position, sentiment-driven reaction in a crowded trade, rather than a fundamental reassessment of HBM. While the cost reduction per cabinet could theoretically boost overall rack shipments, this remains speculative. The key going forward is concrete data on final Rubin BOMs, actual shipment volumes, and revenue splits for companies like Micron (exposed to SOCAMM/DRAM) and SK Hynix (focused on HBM). The event highlights a market shift from buying a broad AI memory narrative to scrutinizing specific profit pools within the AI hardware chain.

A supply chain report regarding NVIDIA's Rubin rack caused a first-round decline in the AI memory sector.

The report mentioned that single-rack memory capacity might drop from approximately 55TB to about 28TB. Subsequently, Micron fell about 7.7% in a single day, and SK Hynix opened down more than 8% the next day. More subtly, the report's author, Dylan Patel, later clarified that many reposts only captured the most eye-catching part, and this was not a "catastrophic bearish" report.

The reason for such a significant reaction is that it touched the most sensitive point of the current AI hardware trend. Over the past period, the market has been trading not on an ordinary memory cycle, but on the expectation that after the Rubin platform enters mass production, AI racks will continue to drive demand for HBM and supporting memory, thereby re-elevating memory suppliers' revenue and pricing power. Since GTC earlier this year, themes like HBM4, SK Hynix's market share, and Micron catching up in AI memory have been repeatedly traded in the market.

However, the phrase "memory being cut" is too crude.

The adjustments disclosed by SemiAnalysis primarily refer to changes in the configuration of SOCAMM and LPDDR on the CPU side within the Rubin NVL72 rack. Most systems might adopt 96GB modules instead of higher-capacity 192GB modules, reducing single-rack memory capacity from a planned ~55TB to ~28TB. This change affects the system memory value per rack but cannot directly imply that HBM4 demand on the GPU side has been simultaneously downgraded.

What really needs to be dissected is which profit pool this adjustment affects and which expectation the market is currently trading on.

Why Did AI Memory Stocks Plunge Collectively?

The market sold off based on a positioning reaction when a high-flying theme encountered negative keywords.

Currently, the confirmed part is that the market reaction was heavy, but the event itself remains at the level of a supply chain report. SemiAnalysis disclosed that NVIDIA might downgrade the CPU-side SOCAMM configuration to ensure the delivery schedule for the Rubin NVL72. The numbers mentioned in the report include single-rack memory capacity dropping from ~55TB to ~28TB, and rack cost decreasing from ~$7.6 million to ~$6.8 million. These numbers should be understood as the reporting perspective of SemiAnalysis, not yet the final confirmed BOM (Bill of Materials) from NVIDIA.

Over the past few quarters, the rise of AI memory stocks relied on a very smooth narrative: the more AI racks, the greater the shortage of advanced memory, and the thicker the profits for suppliers.

The simpler this story, the greater the killing power of a negative headline. Once "memory capacity halved" appeared, the market would first downgrade the memory value per rack, rarely distinguishing immediately which type of memory was being adjusted.

Micron's reaction is most illustrative.

It is both a traditional DRAM supplier and a beneficiary of AI server memory upgrades. Much of the upside previously priced in by the market came from the repricing notion that "AI memory is no longer just a cyclical product." If Rubin's per-rack system memory capacity declines, capital would immediately worry whether expectations for Micron's per-rack revenue from SOCAMM and LPDDR segments were set too high.

SK Hynix also followed the decline, indicating the shock has extended beyond a single supplier.

It is stronger in the HBM field, and the market had previously circulated rumors that it secured the majority of HBM orders related to Vera Rubin. But when AI memory trading becomes crowded, capital does not wait to verify all details before acting. The synchronous decline of memory stocks reflects a contraction in sector risk appetite, not that each company suffered the same fundamental shock.

Dylan Patel's subsequent clarification also points to this. He stated the report was not intended to create a "disaster" narrative, and many missed the context.

Translated into market language, capital did not fully trade on a supply chain analysis but rather on a rapid position reduction after a high-flying sector encountered negative keywords.

AI Memory Begins Redividing Profit Pools

What was primarily downgraded this time is the CPU-side system memory, not the GPU-adjacent HBM4.

Memory in a Rubin rack cannot be summarized with one word. The simplest breakdown is into two layers:

The first layer is GPU-side HBM4, serving the accelerator chip itself;

The second layer is CPU-side SOCAMM and LPDDR, more akin to the system RAM for the entire machine.

The former determines the speed at which data is fed to the GPU, while the latter affects overall machine scheduling, maintenance, and the performance of some workloads.

The "55TB to 28TB" mentioned by SemiAnalysis primarily falls on CPU-side system memory.

It might change the quantity, capacity, and procurement cost of SOCAMM modules per Rubin NVL72 rack. If most systems shift from 192GB modules to 96GB modules, the per-unit value of high-capacity SOCAMM indeed decreases, pressuring the revenue upside for related suppliers.

But GPU-side HBM4 is another line.

The Rubin platform still revolves around the Rubin GPU and Vera CPU, and HBM4 remains the core memory component for GPU packaging and computing power release. Current information does not show that HBM4 capacity or Rubin GPU shipments have been simultaneously downgraded. Previous multi-party predictions still regard HBM as one of the tightest and most pricing-powerful segments in AI servers, with SK Hynix also seen by the market as a primary beneficiary.

Think of an AI rack as an extremely expensive high-performance server.

HBM is closer to high-speed memory attached next to the GPU, while SOCAMM is closer to replaceable system memory for the whole machine. This adjustment mainly targets the latter.

For holdings, the distinction is very direct: if Micron has greater exposure in the SOCAMM segment, the downgrade in per-unit value would hit its expectations first; SK Hynix's HBM logic is relatively independent but would also be dragged down by sector sentiment in crowded trading.

Extrapolating system memory reduction directly into a breakdown of HBM4 demand lacks sufficient evidence.

A more reasonable breakdown is that the CPU-side profit pool indeed faces downward revision pressure, while the GPU-side HBM still depends on total Rubin shipments and HBM4 order cadence.

The AI memory theme can no longer be covered by a single line of "all memory is strong." Micron, SK Hynix, and Samsung Electronics have different exposures in HBM, SOCAMM, traditional DRAM, and NAND. Different types of memory within the same rack also correspond to different prices, margins, and supply-demand constraints.

Can Cost Reduction Translate to More Rack Shipments?

An optimistic interpretation stems from cost and delivery cadence.

SemiAnalysis's calculations show that the Rubin NVL72 rack cost might drop from ~$7.6 million to ~$6.8 million, a reduction of ~$800,000.

For cloud vendors like Microsoft, Google, Amazon, and Meta, AI racks are not just hardware purchases but involve calculating hourly computing costs, delivery time, and stability of large-scale deployment.

If a reduced configuration allows Rubin to be delivered faster, some per-unit value decline might be offset by more racks.

The logic is not complicated. If high-capacity SOCAMM supply is tight, NVIDIA choosing a more readily available configuration can lower the BOM per rack and reduce the risk of a single component delaying overall machine delivery.

For buyers, if a lower system memory configuration does not significantly impact core workloads, getting racks earlier might be more attractive than waiting for fully configured versions.

The problem is that this step remains speculative for now.

Cost reduction does not automatically equal increased orders. For "per-unit value decline" to be offset by "increased total rack volume," NVIDIA needs to deliver more Rubin NVL72 racks, and cloud vendors also need to add or advance purchases.

Existing materials lack public orders, quarterly guidance, or actual shipment data to prove this.

To understand with a simple scenario: if a certain SOCAMM capacity is nearly halved per rack, then total rack shipments need to increase significantly for the total Bit demand in this segment to return to previous expectations.

Even with a ~10% cost reduction, one cannot directly conclude that customers will buy enough extra racks. Large cloud vendor procurement is also influenced by power, data center construction, GPU supply, advanced packaging, and networking equipment; a single BOM reduction is just one variable.

The HBM situation is relatively more stable but not completely immune.

If total Rubin shipments remain robust, HBM4 will still be one of the most direct beneficiaries; if subsequent evidence shows overall machine delivery is hampered by other bottlenecks, HBM would also be affected by the platform's shipment cadence.

The difference is that this report did not directly downgrade HBM4 configuration. What the market awaits is total rack shipment volume, not just focusing on SOCAMM capacity numbers.

Shipment Data is the True Pricing Anchor

The current biggest risk is that the market first revalues based on profit pool breakdown, but subsequent data fails to back the optimistic interpretation.

If NVIDIA or the supply chain ultimately confirms that Rubin NVL72 will long-term adopt lower SOCAMM configurations, while total rack shipments are not significantly revised upward, CPU-side system memory suppliers will face more lasting compression of revenue expectations.

For Micron, the key is not just the overall label of "benefiting from AI memory," but the revenue breakdown of different products.

In subsequent earnings reports and conference calls, it's necessary to see if management discloses growth cadence for AI server-related DRAM, SOCAMM, HBM, and whether margins change due to specifications, prices, or customer bargaining power.

If the company only provides optimistic statements on overall demand but cannot explain the impact of SOCAMM configuration adjustments, the market may continue to discount it.

For SK Hynix, the verification point leans more towards HBM.

If its HBM4 order share, shipment cadence, and pricing maintain strength, this pullback resembles more of a sector sentiment fluctuation; if subsequent Rubin total shipments or HBM delivery cadence also show downgrades, the market would then extend the shock from SOCAMM to the HBM theme.

This is also a typical evolution as the AI memory theme reaches its mid-stage.

Early on, the market bought the direction: more AI racks are being built, and advanced memory is getting scarcer.

Now, representative stocks have accumulated significant gains, and capital is beginning to scrutinize whether each piece of profit is truly materializing. A single supply chain detail can trigger a 7%-8% intraday swing, indicating sector trading has become somewhat crowded, making negative information easier to amplify.

Before actual shipment and earnings breakdowns emerge, labeling this pullback as "bad news fully priced in" or "AI demand collapse" is premature.

A more prudent view is to acknowledge the pressure of per-unit value downgrade on the CPU side, while pricing HBM4 and SOCAMM separately.

What can most change the judgment next is still whether NVIDIA confirms the final BOM for Rubin NVL72, whether actual Rubin rack shipment plans can be revised upward, and the revenue exposure and margin changes for Micron, SK Hynix, and Samsung Electronics in HBM versus SOCAMM/LPDDR.

Related Questions

QWhat triggered the sharp decline in the AI memory stock market according to the article?

AThe decline was triggered by a supply chain report from SemiAnalysis, which suggested a potential reduction in CPU-side system memory (SOCAMM/LPDDR) capacity per Nvidia Rubin NVL72 rack, from about 55TB to about 28TB. The report's alarming headline caused a market panic, despite later clarifications that it was not a 'disastrous bearish' report.

QAccording to the article, what is the key distinction between the two main types of memory in an AI server rack, and which one was reportedly impacted by the configuration change?

AThe two main types are GPU-side HBM (High Bandwidth Memory, like HBM4) and CPU-side system memory (like SOCAMM and LPDDR). The reported configuration change primarily impacted the CPU-side system memory (SOCAMM/LPDDR), potentially reducing its capacity and value per rack. The article states there is no confirmed change to the GPU-side HBM4 configuration.

QWhy did stocks like Micron and SK Hynix both fall significantly, even though their exposure to the affected memory segment might differ?

ABoth stocks fell due to a sharp contraction in sector risk appetite and a crowded trade. When the negative headline about 'memory capacity being halved' hit, investors reacted quickly by reducing exposure to the entire AI memory theme without initially distinguishing between the different memory types (HBM vs. system memory). This caused a broad sell-off before details were fully digested.

QWhat is the potential positive interpretation of the reported memory configuration change for the Rubin rack, as mentioned in the article?

AThe potential positive interpretation is that reducing the CPU-side memory specification could lower the overall cost and complexity of the Rubin NVL72 rack, potentially improving its delivery timeline and reliability. If this leads to increased total rack shipments by Nvidia, the reduction in per-unit value for certain memory components could be offset by higher volume.

QWhat does the article suggest is the most important factor for determining the true impact on memory suppliers following this report?

AThe article suggests that actual shipment data and financial breakdowns are the key determinants. For a final assessment, the market needs to see: Nvidia's confirmed final BOM for Rubin racks, the actual shipment plans for Rubin platforms, and detailed revenue/earnings breakdowns from suppliers like Micron and SK Hynix showing their exposure and margin trends for HBM versus SOCAMM/LPDDR products.

Related Reads

Silicon Valley 'Startup Guru' Steve Hoffman: Web3 + AI Could Be a Trap

Silicon Valley investor and "Godfather of Startups" Steve Hoffman warns that combining Web3 with AI is likely a trap, not a promising venture. In an interview, Hoffman argues that while AI is a foundational technology touching all industries, Web3 adds complexity, friction, and regulatory risk without solving mainstream consumer or business needs. He advises founders to focus on deep, specialized applications where startups can out-iterate giants, rather than on generic features easily replicated by large tech companies. Hoffman observes that Silicon Valley will lead foundational AI research, while China excels at rapid, large-scale application and commercialization, particularly in robotics. He stresses that AI-driven autonomous agents capable of collaborative, multi-step tasks are 2-4 years away, which will cause significant job displacement. The solution is not to slow AI but to redesign business models around human-AI collaboration and reform social systems like education and retraining. For startups, Hoffman recommends focusing on vertical, expertise-heavy domains to build defensibility. He sees major opportunities in AI fraud detection and cybersecurity. Key founder mindsets include systemic thinking over feature-focus, relentless customer centricity, building adaptive teams, and deeply understanding AI's capabilities and limits. Hoffman is also leading a non-profit initiative to establish university centers aimed at training future leaders in responsible, human-value-aligned AI innovation.

marsbit9m ago

Silicon Valley 'Startup Guru' Steve Hoffman: Web3 + AI Could Be a Trap

marsbit9m ago

Token Inefficient, Economy Tokenless

The article "Tokens Aren't Economical, Economics Aren't Tokenized" analyzes a pivotal shift in the AI industry from a technology-driven narrative to one dominated by capital efficiency. It highlights two concurrent trends: a severe capital shortage due to the exorbitant and recurring costs of compute (e.g., OpenAI's high burn rate) and a wave of corporate spin-offs where major tech companies are separating their AI units (like Kuaishou's Kling and Baidu's Kunlunxin). The core argument is that AI's "anti-internet" business model, where user growth increases costs rather than profits, has created a disconnect between high valuations and actual cash flow. Spin-offs address this by allowing AI assets to be valued independently. Within a parent company, they are seen as cost centers, but as standalone entities, they are priced based on their growth potential and scarcity in the primary market, leading to massive valuation premiums (e.g., Kling's estimated value tripling post-spin-off). The industry is at an inflection point, moving from "model worship" to "value realization." The competition is evolving from a pure compute (GPU) race to a broader focus on systemic efficiency and full-stack engineering (involving CPUs and orchestration) to achieve viable commercialization. The year 2026 is framed as a critical moment where the industry must definitively answer how to economically translate AI capability into tangible business value, reshaping the sector's future power structure.

marsbit14m ago

Token Inefficient, Economy Tokenless

marsbit14m ago

Crossing the 'Memory Wall': The Wafer-Level Revolution and Computing Power Routes in the AI Inference Era

In 2026, a historic shift occurred in AI as major cloud providers' inference spending surpassed training spending for the first time, signaling a move from "building large models" to "using large models." This shifts the core challenge from computing power to the "memory wall"—the bottleneck of data movement (model weights, activations, KV Cache) between external DRAM and processors, where energy and latency from data transfer far exceed computation itself. Companies like Nvidia face GPU idle time due to bandwidth limits. In contrast, Cerebras Systems adopts a radical "wafer-scale" approach with its Wafer-Scale Engine (WSE). Instead of cutting a silicon wafer into many chips, Cerebras uses almost the entire wafer as one massive chip (WSE-3). This design provides 44GB of on-chip SRAM, delivering memory bandwidth thousands of times higher than traditional HBM (e.g., 21 PB/s vs. Nvidia B200). For LLM inference, weights are streamed layer-by-layer from external MemoryX storage to the chip, avoiding HBM bottlenecks. This results in token generation speeds 1.5–5 times faster than Nvidia's B200 in some models and significant advantages in first-token latency and long-context tasks. Additionally, Cerebras's architecture offers much lower interconnect power consumption (0.15 pJ/bit vs. GPU's ~10 pJ/bit). However, Cerebras faces challenges: SRAM scaling has slowed with advanced nodes, limiting future capacity gains; the chip requires specialized liquid cooling and custom software stacks; and its external I/O bandwidth (150 GB/s) is low compared to NVLink, hindering multi-system scaling for very large models. Competition is intensifying. Major players are pursuing three paths: 1) Developing proprietary inference ASICs (e.g., Google TPU, Microsoft Maia), 2) Leveraging advanced packaging (e.g., TSMC's SoW) to democratize wafer-scale-like integration, potentially eroding Cerebras's process advantage within a few years, and 3) Exploring optical interconnects for ultimate bandwidth. Commercially, Cerebras is transitioning from a hardware vendor to a service provider, facing the immense challenge of building high-power, specialized data centers to meet large contracts (e.g., 250MW/year from 2026–2028). In conclusion, the AI inference era presents a fundamental architectural trade-off. Cerebras opts for extreme physical optimization for low-latency, single-task performance, while Nvidia prioritizes versatility and massive cluster throughput. The path forward remains uncertain, with technology and business models still evolving in the race toward advanced AI.

marsbit20m ago

Crossing the 'Memory Wall': The Wafer-Level Revolution and Computing Power Routes in the AI Inference Era

marsbit20m ago

Has Bitcoin's 'Rebound Ended', Officially Entering the Late Bear Market Phase?

**Title: Has Bitcoin's Rebound Ended, Entering the Late Bear Market Phase?** **Summary:** Bitcoin's price has declined by 13% this week, signaling a potential return to late-stage bear market conditions. The price fell to around $67k, positioned between the Realized Price and Realized Cap Weighted Average. For the first time since early 2022, the Short-Term Holder cost basis has dropped below this key average, confirming a hallmark of late-cycle bear markets. Profitability metrics have collapsed sharply. The 7-day average of the Realized Profit/Loss ratio plummeted from a local high of 3.16 to 0.29, mirroring the February panic sell-off. Critically, the 90-day average never breached the threshold of 2, indicating the recent rally to $82k was a bear market bounce, not a structural shift. Realized losses surged to $1.35 billion daily, with $770 million coming from Long-Term Holders selling at a loss. This accelerating redistribution of supply from weak to strong hands is a necessary but ongoing process for a market bottom. The rally stalled almost precisely at the aggregate cost basis (~$83k) of US spot Bitcoin ETF investors, turning that level into strong resistance and leaving the average ETF holder underwater again. Spot market flows have turned decisively negative, showing sellers are dominating order books despite the price drop. While a significant futures long liquidation event cleared over $400 million in leverage, providing a potential reset, sustained spot demand is yet to materialize. Options markets continue to price in higher future volatility (Implied Volatility) than recent price action (Realized Volatility) has shown, with a persistent skew towards put options, indicating ongoing demand for downside protection. In conclusion, multiple metrics point to a fragile market structure. Resistance at the ETF cost basis, accelerating realized losses, dominant spot selling, and cautious options pricing all suggest the bear market trend persists. A sustainable recovery likely requires a resurgence of spot demand, ETF holders returning to profit, and a clear reduction in selling pressure.

marsbit20m ago

Has Bitcoin's 'Rebound Ended', Officially Entering the Late Bear Market Phase?

marsbit20m ago

TechFlow Intelligence Agency: Anthropic Calls for Global Pause in AI Development While Preparing for Trillion-Dollar IPO; SpaceX IPO Roadshow Heats Up, But S&P 500 Rejects Fast-Track Inclusion

In today's TechFlow Intelligence Briefing, several major tech stories highlight a growing theme of trust and credibility gaps across AI, crypto, and finance. AI company Anthropic has publicly called for a global pause in AI development, citing risks from Claude's "recursive self-improvement." Ironically, this coincides with reports the company is preparing for a massive IPO targeting a near $1 trillion valuation. This perceived hypocrisy, coupled with widespread user complaints about Claude's declining performance, is sparking debate over whether the safety warning is genuine or a competitive tactic. Meanwhile, in a substantive security move, Anthropic open-sourced a framework for AI-powered vulnerability discovery. In the crypto market, Bitcoin's price drop below $61,000 triggered over $1.16 billion in liquidations, flipping the market into a state where more BTC is held at a loss than at a profit, a historical bearish signal. On the corporate front, SpaceX's highly anticipated IPO is generating immense Wall Street excitement, with Goldman Sachs projecting 100x revenue growth by 2030. However, the S&P 500 has refused to fast-track the company's inclusion post-IPO, potentially limiting immediate institutional demand. Separately, ByteDance's AI app Doubao lost over 6 million monthly active users after introducing a subscription model, highlighting the challenges of AI monetization. Other notable developments include Nvidia certifying HBM4 memory from Samsung, SK Hynix, and Micron; Cloudflare's acquisition of front-end tooling company VoidZero; and its CEO warning that bot traffic now exceeds human traffic online. The underlying narrative connects these events: a trust crisis. From AI firms' contradictory actions and crypto volatility to the clash between SpaceX's hyped narrative and institutional rules, a pattern is emerging where stated intentions and actual practices are increasingly misaligned.

marsbit35m ago

TechFlow Intelligence Agency: Anthropic Calls for Global Pause in AI Development While Preparing for Trillion-Dollar IPO; SpaceX IPO Roadshow Heats Up, But S&P 500 Rejects Fast-Track Inclusion

marsbit35m ago

Trading

Spot
Futures

Hot Articles

Discussions

Welcome to the HTX Community. Here, you can stay informed about the latest platform developments and gain access to professional market insights. Users' opinions on the price of S (S) are presented below.

活动图片