NVIDIA's Jensen Huang Latest Article: The 'Five-Layer Cake' of AI

marsbitPublished on 2026-03-10Last updated on 2026-03-10

Abstract

NVIDIA's Jensen Huang articulates AI not merely as a software application but as a fundamental infrastructure, comparable to electricity or the internet, in a layered "five-layer cake" structure. This stack begins with **Energy** as the foundational constraint, powering real-time intelligence generation. Above it, **Chips** convert energy into computational power efficiently. The **Infrastructure** layer comprises data centers and systems that function as "AI factories." **Models** form the next layer, processing diverse data types like language, biology, and physics. At the top, **Applications**—such as drug discovery, autonomous vehicles, and robotics—create economic value. Huang emphasizes that AI is an industrial-scale transformation, driving massive global infrastructure expansion requiring trillions in investment and a skilled workforce—from electricians to network technicians—beyond just computer scientists. He notes that AI has recently crossed a threshold: models are now reliable enough for widespread use, reducing hallucinations and improving reasoning, which accelerates real-world applications. Open-source models, like DeepSeek-R1, further propel growth across the entire stack. This infrastructure revolution will reshape energy consumption, manufacturing, labor, and economic growth. Every company and country will participate, though the field remains early-stage, with vast opportunities and responsibilities ahead.

Editor's Note: Artificial intelligence is evolving from a cutting-edge technology into a foundational infrastructure supporting the modern economy. In its first long-form article published on its official account, NVIDIA attempts to systematically deconstruct the AI industry structure from first principles: from energy and chips, to data center infrastructure, then to models and applications, forming a complete five-layer technology stack.

The article points out that AI is not just a competition in software or models, but a global industrial endeavor involving energy, computing power, manufacturing, and applications, with a scale that could become one of the largest infrastructure expansions in human history. Through this 'five-layer cake' perspective, NVIDIA aims to illustrate that the true significance of AI is not just smarter software, but an infrastructure revolution on par with electricity and the internet.

Below is the original text:

Artificial intelligence is one of the most powerful forces shaping the world today. It is not merely a clever application, nor a single model, but an infrastructure, as crucial as electricity and the internet.

AI runs on real hardware, real energy, and a real economic system. It transforms raw materials into mass-produced 'intelligence.' Every company will use it, every country will build it.

To understand why AI is unfolding in this manner, it is helpful to start from first principles and examine the fundamental changes occurring in computing.

From 'Pre-Made Software' to 'Real-Time Generated Intelligence'

For the vast majority of computing history, software has been 'pre-made.' Humans first define an algorithm, and then the computer executes the commands. Data must be meticulously structured, stored in tables, and retrieved through precise queries. SQL is indispensable because it enables this entire system to function.

AI shatters this paradigm.

For the first time, we have computers that can understand unstructured information. They can see images, read text, listen to sounds, and comprehend their meaning; they can reason about context and intent. More importantly, they can generate intelligence in real-time.

Every response is a new generation. Every answer depends on the context you provide. This is no longer software retrieving pre-written instructions from a database; it is software reasoning in real-time and generating intelligence on demand.

Because intelligence is generated in real-time, the entire computing technology stack that supports it must be reinvented.

AI as Infrastructure

Viewing AI from an industry perspective, it can actually be broken down into a five-layer structure.

Energy

The foundational layer is energy.

Real-time generated intelligence requires real-time generated electricity. The production of every token means electrons are moving, heat is being managed, and energy is being converted into computing power.

There is no abstraction below this layer. Energy is the first principle of AI infrastructure and the fundamental constraint determining how much intelligence the system can produce.

Chips

Above energy are chips. These processors are designed to convert energy into computing power with extreme efficiency and at massive scale.

AI workloads require immense parallel computing power, high-bandwidth memory, and high-speed interconnects. Advancements at the chip layer determine the speed of AI scaling and ultimately how cheap 'intelligence' will become.

Infrastructure

Above chips is infrastructure. This includes land, power delivery, cooling systems, construction engineering, networking systems, and scheduling systems that organize tens of thousands of processors into a single machine.

These systems are essentially AI factories. They are not designed to store information, but to manufacture intelligence.

Models

Above infrastructure are models. AI models can understand various types of information: language, biology, chemistry, physics, finance, medicine, and the real world itself.

Language models are just one category. Some of the most transformative work is happening in areas of: Protein AI, Chemistry AI, Physics Simulation, Robotics, Autonomous Systems

Applications

The top layer is the application layer, where real economic value is generated. Examples include drug discovery platforms, industrial robots, legal copilots, and autonomous vehicles.

An autonomous vehicle is essentially 'an AI application carried by a machine'; a humanoid robot is 'an AI application embodied in a physical form.' The underlying technology stack is the same, only the final form differs.

Thus, this is the five-layer structure of AI: Energy → Chips → Infrastructure → Models → Applications. Every successful application pulls demand through all the layers below it, down to the power plant that supplies its electricity.

An Infrastructure Buildout Still in Its Early Stages

We have only just begun this buildout. Current investment is merely in the scale of hundreds of billions of dollars, while trillions more in infrastructure will need to be built in the future.

Globally, we are witnessing: Chip factories, Computer assembly plants, AI factories.

Being constructed at an unprecedented scale. This is becoming one of the largest infrastructure construction projects in human history.

Labor Demand in the AI Era

The labor force required to support this construction is enormous.

AI factories need: Electricians, Plumbers, Pipefitters, Steelworkers, Network technicians, Equipment installers, Operations and maintenance personnel

These are skilled, well-paying jobs, and there is currently a severe shortage. Participating in this transformation does not necessarily require a PhD in computer science.

Simultaneously, AI is driving productivity gains in the knowledge economy. Take radiology as an example. AI has begun assisting in medical image interpretation, yet the demand for radiologists is still growing.

This is not a contradiction.

The real duty of a radiologist is patient care, and reading images is just one part of that work. As AI takes over more repetitive tasks, doctors can devote more time to judgment, communication, and treatment.

Improved hospital efficiency allows them to serve more patients, consequently requiring more staff. Productivity creates capacity, and capacity creates growth.

What Changed in the Past Year?

Over the past year, AI crossed a critical threshold.

Models have become good enough to be truly useful at scale.

· Reasoning capabilities improved significantly

· Hallucinations reduced markedly

· 'Grounding' in the real world enhanced substantially

For the first time, AI-based applications are starting to create real economic value.

Clear product-market fit has emerged in areas such as: Drug discovery, Logistics, Customer service, Software development, Manufacturing

These applications are powerfully pulling the entire underlying technology stack.

The Role of Open-Source Models

Open-source models play a key role here. The vast majority of the world's AI models are free. Researchers, startups, enterprises, and even entire nations rely on open-source models to compete in advanced AI.

When open-source models reach the technological frontier, they not only change software but also activate demand across the entire technology stack.

DeepSeek‐R1 is a prime example. By making a powerful reasoning model widely available, it spurred rapid growth at the application layer, while also increasing demand for training compute, infrastructure, chips, and energy.

What Does This Mean?

When you view AI as infrastructure, everything becomes clear. AI may have started with Transformers and large language models, but it is far more than that.

It is an industrial-scale transformation that will reshape:

· How energy is produced and consumed

· How factories are built

· How work is organized

· The patterns of economic growth

AI factories are being built because intelligence can now be generated in real-time. Chips are being redesigned because efficiency determines the speed of intelligence scaling. Energy is core because it determines the maximum amount of intelligence the system can produce. Applications are exploding because models have finally crossed the 'viable at scale' threshold.

Each layer reinforces the others.

This is why the scale of this buildout is so vast, why it impacts so many industries simultaneously, and why it will not be confined to one country or one domain.

Every company will use AI.

Every country will build AI.

We are still in the early stages.

Vast infrastructure remains unbuilt, a massive workforce remains untrained, and countless opportunities remain unrealized.

But the direction is very clear.

Artificial intelligence is becoming the foundational infrastructure of the modern world.

And the choices we make today—the speed of construction, the breadth of participation, and the responsibility of deployment—will determine what this era ultimately becomes.

Related Questions

QWhat are the five layers of the AI technology stack as described by Jensen Huang in the article?

AThe five layers of the AI technology stack are: 1. Energy, 2. Chips, 3. Infrastructure, 4. Models, and 5. Applications.

QAccording to the article, how does AI fundamentally differ from traditional software?

AAI differs from traditional software because it is not 'pre-made' software that retrieves instructions from a database. Instead, it is a system that understands unstructured information and generates intelligence in real-time through reasoning based on the context provided.

QWhat is the role of the 'Infrastructure' layer in the AI stack?

AThe 'Infrastructure' layer refers to the AI factories, which include land, power delivery, cooling systems, construction engineering, networking, and scheduling systems that organize tens of thousands of processors into a single machine. They are designed not to store information, but to manufacture intelligence.

QWhy does the article claim that the demand for radiologists is still growing even with the adoption of AI?

AThe demand for radiologists is growing because AI is taking over repetitive tasks like reading scans, which allows doctors to focus more on judgment, communication, and treatment. This increases hospital efficiency, enabling them to serve more patients, which in turn creates a need for more staff.

QWhat key threshold did AI cross in the past year, according to the article?

AIn the past year, AI models crossed the key threshold of being 'good enough' to be truly useful at scale. This is marked by significant improvements in reasoning capabilities, a major reduction in hallucinations, and a substantial enhancement in grounding with the real world, allowing AI applications to create real economic value.

Related Reads

Fu Peng's First Public Speech in 2026: What Exactly Are Crypto Assets? Why Did I Join the Crypto Asset Industry?

Fu Peng, a renowned macroeconomist and now Chief Economist at New火 Group, delivered his first public speech of 2026 at the Hong Kong Web3 Festival. He explained his perspective on crypto assets and why he joined the industry, framing it within the context of macroeconomic trends and financial evolution. Fu emphasized that crypto assets are transitioning from an early, belief-driven phase to a mature, institutionally integrated asset class. He drew parallels to the 1970s-80s, when technological advances (like computing) revolutionized traditional finance, leading to the rise of FICC (Fixed Income, Currencies, and Commodities). Similarly, current advancements in AI, data, and blockchain are reshaping finance, with crypto assets becoming part of a new "FICC + C" (C for Crypto) framework. He noted that institutional capital, including traditional hedge funds, avoided early crypto due to its speculative nature but are now engaging as regulatory clarity emerges (e.g., stablecoin laws, CFTC classifying crypto as a commodity). Fu predicted that 2025-2026 marks a turning point where crypto becomes a standardized, financially viable asset for diversified portfolios, akin to commodities or derivatives in traditional finance. Fu defined Bitcoin not as "digital gold" in a simplistic sense but as a value-preserving, financially tradable asset. He highlighted that crypto's future lies in regulated, institutional adoption, moving away from retail-dominated trading. His entry into crypto signals this maturation, where traditional finance integrates crypto into mainstream asset management.

marsbit10m ago

Fu Peng's First Public Speech in 2026: What Exactly Are Crypto Assets? Why Did I Join the Crypto Asset Industry?

marsbit10m ago

Justin Sun Sues Trump Family: What $75 Million Bought Was Only a Blacklist

Justin Sun, founder of Tron, has filed a lawsuit in federal court against World Liberty Financial (WLF), alleging he was made the "primary target of a fraudulent scheme" after investing $75 million. Sun claims the investment secured him an advisor title and WLFI tokens, which were later frozen by WLF, causing "hundreds of millions in losses." The dispute began in late 2024 when Sun's investment helped revive WLF's struggling token sale, which ultimately raised $550 million. Shortly after, the SEC dropped its lawsuit against Sun following Donald Trump's inauguration. However, relations soured when Sun refused WLF's demands for additional funding. In August 2025, WLF added a "blacklist" function to its smart contract, allowing it to unilaterally freeze tokens. Sun's holdings, worth approximately $107 million, were frozen, and he was threatened with token destruction. The lawsuit highlights WLF's structure, which directs 75% of token sale profits to the Trump family, who had earned $1 billion by December 2025. WLF's CEO is Zach Witkoff, son of U.S. Middle East envoy Steve Witkoff. The project faces scrutiny for opaque operations, including a controversial loan arrangement on the Dolomite platform, co-founded by a WLF advisor. Despite Sun's history with the SEC, the case underscores centralization risks within DeFi, as WLF controls governance and holds powers to freeze assets arbitrarily. Sun's tokens remain frozen as legal proceedings begin.

marsbit18m ago

Justin Sun Sues Trump Family: What $75 Million Bought Was Only a Blacklist

marsbit18m ago

$500 to Buy OpenAI Stock: Silicon Valley's Most Respectable Liquidity Invitation

Silicon Valley's largest venture capital platform, AngelList, has launched a new fund called USVC, allowing U.S. retail investors to buy into high-profile AI companies like OpenAI, Anthropic, and xAI with a minimum investment of $500—no accredited investor status required. Promoted by AngelList co-founder Naval Ravikant, the fund is framed as an opportunity for ordinary people to access high-growth private tech investments traditionally reserved for VCs. However, critics argue it functions more like an exit vehicle for early insiders. USVC acquires shares not through primary rounds but largely via secondary transactions—purchasing stakes from early investors, VC funds, and employees looking to cash out at peak valuations. With companies like xAI heavily weighted in the portfolio, the fund effectively channels retail money into providing liquidity for insiders who entered at much lower valuations. The fund’s structure raises concerns: shares are illiquid, with no secondary market, and buybacks are limited and discretionary. The actual annual fee reaches 3.61%, far above the advertised 1% management fee. This model parallels the "low float, high fully diluted valuation" strategy seen in crypto, where early investors profit by selling to latecomers at inflated prices. The timing—alongside similar moves by platforms like Robinhood—suggests that Silicon Valley’s sudden interest in retail inclusion may be less about democratizing access and more about securing exits for insiders.

marsbit49m ago

$500 to Buy OpenAI Stock: Silicon Valley's Most Respectable Liquidity Invitation

marsbit49m ago

Trading

Spot
Futures

Hot Articles

How to Buy LAYER

Welcome to HTX.com! We've made purchasing Solayer (LAYER) simple and convenient. Follow our step-by-step guide to embark on your crypto journey.Step 1: Create Your HTX AccountUse your email or phone number to sign up for a free account on HTX. Experience a hassle-free registration journey and unlock all features.Get My AccountStep 2: Go to Buy Crypto and Choose Your Payment MethodCredit/Debit Card: Use your Visa or Mastercard to buy Solayer (LAYER) instantly.Balance: Use funds from your HTX account balance to trade seamlessly.Third Parties: We've added popular payment methods such as Google Pay and Apple Pay to enhance convenience.P2P: Trade directly with other users on HTX.Over-the-Counter (OTC): We offer tailor-made services and competitive exchange rates for traders.Step 3: Store Your Solayer (LAYER)After purchasing your Solayer (LAYER), store it in your HTX account. Alternatively, you can send it elsewhere via blockchain transfer or use it to trade other cryptocurrencies.Step 4: Trade Solayer (LAYER)Easily trade Solayer (LAYER) on HTX's spot market. Simply access your account, select your trading pair, execute your trades, and monitor in real-time. We offer a user-friendly experience for both beginners and seasoned traders.

3.7k Total ViewsPublished 2025.02.11Updated 2025.03.21

How to Buy LAYER

Discussions

Welcome to the HTX Community. Here, you can stay informed about the latest platform developments and gain access to professional market insights. Users' opinions on the price of LAYER (LAYER) are presented below.

活动图片