Silicon Valley's New FDE Role Gains Popularity: What Kind of AI Talent Do Enterprises Need?

marsbitPubblicato 2026-06-02Pubblicato ultima volta 2026-06-02

Introduzione

The Silicon Valley job market is seeing a resurgence of the Forward Deployed Engineer (FDE) role, originally pioneered by Palantir, now focused on AI. Companies like OpenAI and Anthropic are deploying AI FDEs to client sites to customize general-purpose large language models into specific Agent workflows for business processes. However, the article argues that the broader and more significant trend is the rise of the in-house "AI Engineer." These professionals, needed in far greater numbers than external FDEs, integrate AI capabilities—like prompt engineering, Agent frameworks, and evaluation systems—directly into a company's own software and operations, often using AI coding tools. This evolution suggests AI's impact on employment is not simply about replacement but about creating new, generalist roles that will later specialize, much like software engineering split into front-end, back-end, and DevOps. The future is likely to see a proliferation of specialized AI engineering roles (e.g., LLMOps, Evals Engineer), but the current and critical demand is for engineers who blend technical skill with business understanding to embed AI effectively, ensuring companies retain flexibility in their technology choices.

Editor's Note: As companies like OpenAI and Anthropic begin to form AI Forward Deployed Engineer (FDE) teams, an old role originating from Palantir is regaining popularity in Silicon Valley. The core value of an FDE is to work on-site with clients, transforming general-purpose large language models into customized Agent workflows that fit specific business processes.

However, what this article truly discusses is not just the new FDE profession, but rather how job structures are being redefined in the AI era. The author believes that compared to a small number of FDEs stationed within client organizations to facilitate the implementation of specific vendor products, there will be a greater future demand for companies' own AI Engineers. They need to understand prompts, Agent frameworks, and evaluation systems, and also know how to use AI programming tools like Claude Code, Codex, etc., to truly embed AI capabilities into software and business systems.

This also implies that the impact of AI on the job market may not be a simple "replacement." It is more likely to first create a batch of new generalist roles, and then, much like how software engineers diversified into front-end, back-end, mobile, and DevOps in the past, continue to evolve into more specialized professions such as LLMOps, Evals Engineer, and AI Data Engineer. What will be truly scarce are those who understand both engineering implementation and business scenarios.

Here is the original text:

A new role has recently emerged in Silicon Valley drawing significant attention: the AI Forward Deployed Engineer (FDE). These engineers are deployed within client organizations to help customize solutions, such as building and fine-tuning Agent workflows that meet the client's specific needs. Since OpenAI and Anthropic started forming new teams to deploy FDEs into client organizations, I've heard many people refocusing on this career path.

The rise of the FDE role driven by AI workloads is an example of AI creating new jobs. It also shows that the narrative of an impending "jobpocalypse"—a collapse of the job market—is unfounded; there will still be plenty of AI and non-AI related jobs in the future. However, as explained below, I believe the number of AI Engineer positions will far exceed that of FDEs.

The FDE role was pioneered about two decades ago by Palantir. Back then, Palantir would send engineers to work on-site at government agencies, often in secure, air-gapped environments. Beyond strong technical skills, FDEs also needed communication abilities and sometimes business acumen. For example, they might need to communicate with clients to understand needs, strategize project prioritization, explain complex technology, and provide respectful yet firm feedback when clients propose unrealistic requests. The renewed focus on FDEs today is largely because truly embedding an off-the-shelf large language model into business operations and customizing it into Agent workflows tailored to specific needs requires extensive hands-on implementation work.

Nevertheless, I believe the scale of the AI Engineer role will be much larger. A company might accept a few FDEs for internal collaboration, but most companies will want more of their own employees involved in project development. At my organization, for instance, we do hire FDEs, but we hire many more AI Engineers. Additionally, a common concern among clients is the difficulty in finding truly "vendor-neutral" FDEs. After all, the FDE's mission is inherently to deeply integrate a specific vendor's product into enterprise systems. At this stage, it's hard to predict which AI service will be the best choice a year from now, so "optionality"—the ability for an enterprise to choose the most suitable vendor in the future—is crucial. In contrast, having FDEs deeply tie a company's business processes to one vendor significantly reduces this optionality.

Currently, I see market demand for AI Engineers rising rapidly. These engineers can build applications using AI software components such as LLM prompts, Agent frameworks, and evaluation systems; they can also efficiently use AI programming Agents like Claude Code, Codex, Antigravity CLI, and OpenCode. As the AI Engineer role matures, I expect it to further split into more specialized positions. This is similar to how the general "Software Engineer" role decades ago gradually diversified into front-end, back-end, mobile, data engineering, DevOps, and others.

What specialized AI engineering roles will emerge in the future? I'm not certain yet. There might be AI FDEs, LLMOps Engineers, Evaluation Engineers, AI Data Engineers, Harness Engineers, and some new roles we haven't named yet. But for now, at least, many generalist AI Engineers are already creating significant value. Excellent AI Engineers are in high demand and short supply. As this field continues to mature over the next decade, I also look forward to more specialization within AI engineering, creating further new employment opportunities.

Domande pertinenti

QWhat is the newly popularized role of 'FDE' in Silicon Valley, as mentioned in the article, and what is its core function?

AThe newly popularized role is AI Forward Deployed Engineer (FDE). Its core function is to go on-site with clients to transform general-purpose large language models (LLMs) into customized Agent workflows that fit specific business processes.

QAccording to the author, which type of role is predicted to have a larger future demand compared to FDEs, and what skills are essential for it?

AThe author predicts that a company's own AI Engineer role will have larger future demand. Essential skills include understanding prompts, Agent frameworks, evaluation systems, and the ability to use AI programming tools like Claude Code and Codex to embed AI capabilities into software and business systems.

QWhat is one major concern that clients might have regarding relying on FDEs from specific AI service providers?

AA major concern is the lack of 'vendor neutrality.' Since FDEs are tasked with deeply integrating a specific supplier's product into a company's systems, it can lock the company into that vendor and reduce its future flexibility or 'optionality' to switch to potentially better services later.

QHow does the article compare the evolution of the 'AI Engineer' role to the historical evolution of the 'Software Engineer' role?

AThe article compares it by stating that just as the generic 'Software Engineer' role evolved into specialized roles like front-end, back-end, mobile, data engineering, and DevOps, the 'AI Engineer' role is also expected to mature and split into more specialized positions in the future.

QWhat specific example does the article provide to argue against the 'jobpocalypse' narrative regarding AI's impact on employment?

AThe article argues against the 'jobpocalypse' narrative by citing the emergence and rise of new AI-related roles like the AI Forward Deployed Engineer (FDE) and, more broadly, AI Engineers, as examples of how AI is creating new jobs rather than solely causing massive job displacement.

Letture associate

Can DeepSeek Save China One Trillion Dollars?

"DeepSeek and the $1 Trillion Infrastructure Question" The article examines whether DeepSeek's AI optimization breakthroughs could potentially save China $1 trillion in future AI infrastructure costs. The analysis begins with Nvidia's upcoming Vera Rubin AI platform, costing ~$7.8 million, where memory (HBM4/LPDDR5X) constitutes $2 million—a 435% cost increase in one year, highlighting how AI hardware spending is shifting toward expensive memory components. DeepSeek's approach works in the opposite direction. Through three key technical innovations showcased in DeepSeek V4, the company dramatically improves hardware efficiency: 1. **Memory Compression (MLA)**: Re-engineers the attention mechanism to compress long-context memory (KV Cache) by over 90%, drastically reducing expensive HBM usage. 2. **Selective Activation (MoE)**: Employs Mixture-of-Experts architecture where only a small fraction of parameters (e.g., 49B out of 1.6T in V4-Pro) are activated per token, allowing most parameters to reside in cheaper memory/SSD. 3. **Computation Caching**: Reuses previously computed results via cache hits, replacing expensive GPU computations with cheap memory reads. Combined, these optimizations allow the same hardware to produce approximately 4x more tokens, effectively reducing required hardware investment by 75%. DeepSeek's pricing reflects this: a 10-billion token workload costs ~$522 monthly versus ~$9,000-$10,000 for competitors. The $1 trillion savings projection stems from McKinsey's estimate that global AI infrastructure will require ~$5.2 trillion investment by 2030. As China's daily token consumption grows toward quadrillions, even marginal efficiency gains scale massively. With a conservative 4x throughput improvement, China could avoid building tens of thousands of AI data centers equivalent to ~7 trillion RMB ($1 trillion) in saved investment. Critically, this strategy shifts dependency from scarce, expensive GPU/HBM—where China lags—toward more accessible storage, caching, and systems engineering where domestic suppliers like CXMT are gaining strength. Rather than "replacing Nvidia," DeepSeek rebalances AI's value chain away from monolithic hardware dependency. Ultimately, DeepSeek's technical breakthroughs could lower the barrier to AI adoption across Chinese industries by making advanced capabilities affordable at scale—transforming who can access next-generation AI.

marsbit31 min fa

Can DeepSeek Save China One Trillion Dollars?

marsbit31 min fa

Overturning the Mainstream Approach to Hallucinations: Metacognition is the New Solution for Large Models to Break the Hallucination Barrier

This paper, "Hallucinations Undermine Trust; Metacognition is a Way Forward," proposes a paradigm shift in combating AI hallucination. It argues that the current mainstream approaches—striving for omniscience by scaling data/models or having AI abstain from uncertain answers—are fundamentally flawed. The former has inevitable knowledge gaps, while the latter imposes a crippling "utility tax," requiring the rejection of many correct answers to achieve high accuracy, due to models' poor "discrimination" (the ability to distinguish correct from incorrect answers internally). The core contribution is redefining hallucination not as "being wrong," but as "expressing false information with unwarranted certainty." The proposed solution is **Faithful Uncertainty** or **Metacognition**: enabling AI to accurately perceive its internal uncertainty and honestly express it in its language (e.g., using hedging phrases when unsure). This creates a more reliable assistant that provides useful information while signaling its confidence, minimizing harm from errors. The paper emphasizes that metacognition is critical for the era of AI Agents. Without it, Agents cannot intelligently decide when to use tools like search engines, leading to inefficiency and misuse. Key implementation challenges are highlighted: the "bootstrapping paradox" of training with static uncertainty data, the "alignment distortion signal" where human preference training suppresses internal uncertainty cues, and the difficulty of causally evaluating true metacognition vs. its superficial imitation. The paper concludes that the goal should not be an infallible AI, but one that is honest about the limits of its knowledge, thereby building user trust through transparent communication of its certainty.

marsbit36 min fa

Overturning the Mainstream Approach to Hallucinations: Metacognition is the New Solution for Large Models to Break the Hallucination Barrier

marsbit36 min fa

Hedge by Buying Gold and Oil, Chase Soaring Returns with AI. ‘Dated’ Bitcoin Enters a Bear Market

Bitcoin has recently declined, hitting a two-month low near $66,123, while Ethereum fell to a three-month low around $1,837. Analysts suggest the drop is not merely due to factors like ETF outflows or MicroStrategy's selling but reflects a deeper issue: Bitcoin is losing a broader asset competition. In a near-zero interest rate environment, Bitcoin previously thrived as an outlet for investor dissatisfaction with inflation and limited options. However, the market landscape has shifted. Bitcoin now occupies an "awkward middle ground," facing competition on three fronts. For inflation hedging, investors prefer gold, energy stocks, and commodity producers—assets with tangible backing and clearer pricing power. For growth exposure, AI-related companies with actual revenues and profits are more attractive. Even within crypto, investors can choose stablecoins, exchanges, or infrastructure firms tied directly to adoption, offering clearer business models and leverage. Thus, Bitcoin is no longer the top choice for hedging, growth, or crypto exposure. This shift is evident in market reactions: despite recent warnings about persistent inflation from a Fed official, Bitcoin did not rally as it might have in the past. Instead, capital flowed to assets with direct commodity or energy exposure. The recent ETF outflows and MicroStrategy sales are symptoms, not causes, of this new reality. Investors are becoming more selective, demanding clearer value propositions beyond mere scarcity. The emerging bear case for Bitcoin is not about it being a bubble or failed technology, but that scarcity alone is no longer sufficient.

华尔街日报39 min fa

Hedge by Buying Gold and Oil, Chase Soaring Returns with AI. ‘Dated’ Bitcoin Enters a Bear Market

华尔街日报39 min fa

Trading

Spot
Futures
活动图片