# Harness Related Articles

HTX News Center provides the latest articles and in-depth analysis on "Harness", covering market trends, project updates, tech developments, and regulatory policies in the crypto industry.

How Token-Hungry is Claude Code? A Comparative Experiment Shows Up to 30x Difference Across Three Frameworks

Claude Code's Token Consumption Exposed: Comparison Experiment Shows Up to 30x Difference Between Frameworks A recent experiment by the Composio team tested the same model (Kimi K3) across three different agent frameworks (Claude Code, Hermes, and Kimi Code) on 28 identical tasks. While task completion rates were similar, token consumption varied dramatically. The median token usage was approximately 61k for Kimi Code, 67k for Hermes, and a staggering 340k for Claude Code – about 6 times more than Kimi Code. For individual tasks, the maximum difference reached 30x. In terms of cost, using Claude Code averaged $2 per task compared to $0.22 for Kimi Code and $0.28 for Hermes (based on Kimi K3 pricing). Speed also differed, with Hermes being the fastest. Analysis suggests Claude Code's high token usage stems from its harness repeatedly feeding extensive context (previous messages, tool calls, command outputs, file contents) back into the model across multiple interaction rounds, significantly inflating input tokens rather than generating longer outputs. This highlights a crucial trend: the agent framework (harness) is becoming as important as the model itself for cost and efficiency. A separate study from Writer showed that simply switching the orchestration layer to their optimized harness reduced average task cost by 41% and latency by 44% across various models without sacrificing quality. The conclusion is clear: for cost-effective AI agents, optimizing the harness may yield greater savings than changing the model. The future of agent competition may hinge not just on capability ("can it do it?") but on efficiency ("who does it for less?").

marsbit07/31 12:26

How Token-Hungry is Claude Code? A Comparative Experiment Shows Up to 30x Difference Across Three Frameworks

marsbit07/31 12:26

Weng Li's New Blog Proposes 'Self-Evolution Should Start from Harness', DeepSeek's Cui Tianyi Endorses with Repost

Lilian Weng, former OpenAI security VP and co-founder of Thinking Machines Lab, has published a new blog post titled "Harness Engineering for Self-Improvement," proposing a pragmatic path for AI self-evolution. She argues that Recursive Self-Improvement (RSI) may practically begin at the "Harness" layer—the external runtime system governing how models use tools, manage context, and execute tasks—rather than directly from the model rewriting its own weights. The blog outlines a progression from optimizing prompts (Context Engineering) to designing workflows, and ultimately to Self-Improving Harness systems. These systems can identify their own weaknesses, propose targeted, verifiable modifications to the harness code, and validate improvements. Works like Self-Harness and Darwin Gödel Machine (DGM) demonstrate significant performance gains on benchmarks like SWE-bench through such automated harness evolution, rivaling handcrafted agents. DeepSeek researcher Tianyi Cui endorsed the view, noting harness-based self-evolution is as promising as model-based approaches. Weng emphasizes this is complementary to model training, with both reinforcing each other. However, key challenges remain: weak evaluators for subjective tasks, reward hacking, diversity collapse, managing long-term system health versus short-term success, and defining the human oversight role. The consensus is growing: the harness is a critical variable, as the same model can exhibit vastly different capabilities within different harness systems.

marsbit07/08 10:25

Weng Li's New Blog Proposes 'Self-Evolution Should Start from Harness', DeepSeek's Cui Tianyi Endorses with Repost

marsbit07/08 10:25

Beyond the Model Lies the Harness: Deepseek Enters the Arena, Why Has the Main Battlefield of China's AI Competition Shifted?

In mid-to-late May 2026, Deepseek internally established a new Harness team focused on code agent products, internally benchmarked against Anthropic's Claude Code. This move, marked by the formula "Model + Harness = Agent" in their job postings, signals a major shift in China's AI competition: the main battlefield is transitioning from developing large models to building toolchains and achieving workplace integration. Deepseek's direct involvement in Harness development aims to secure control over interface design and training data feedback loops, moving beyond open-sourcing powerful models. Harness, the runtime infrastructure for AI agents, handles everything beyond model reasoning—task orchestration, tool calling, context management, safety checks, and error recovery. It is crucial because agent products are not just outputs of model capability but also training grounds for it. Real-world task failures recorded by Harness can feed back into model training, creating a flywheel effect. Engineering Harness is more critical than optimizing prompts, as poor context management or error handling can drastically reduce agent success rates in multi-step, real-world scenarios. This shift is not isolated. Other major Chinese tech companies are also pursuing differentiated toolchain strategies. Tencent leverages its enterprise ecosystem (WeChat Work, Tencent Cloud) to build connectors for organizational-level AI collaboration and complex task delivery. Alibaba focuses on lowering automation barriers on the web with a front-end, browser-based GUI Agent framework, PageAgent. This diversification shows the industry recognizes that success lies not in a perfect general agent, but in vertically focused solutions built with robust engineering. The trend is validated by overseas success, such as Poland's Viktor, an AI coworker on Slack achieving $20M ARR by autonomously executing complex, multi-step tasks. This proves a shift in enterprise willingness to pay—from "AI-assisted generation" to "AI-autonomous execution." As Harness matures to provide safety guards and reliability, AI transitions from a human-supervised intern to an independent outsourcer. The competition now faces key engineering challenges: preventing "token explosion" through intelligent context compression, and building "thick frameworks" with features like sandbox isolation and checkpoint recovery for enterprise-grade stability. Geopolitical restrictions on tools like Claude Code further create a significant market vacuum for domestic solutions like Deepseek's Harness. For enterprises and developers, the focus must shift from comparing model benchmarks to evaluating a vendor's engineering capabilities, error recovery mechanisms, context management, and ecosystem compatibility when choosing AI products and platforms.

marsbit06/22 06:05

Beyond the Model Lies the Harness: Deepseek Enters the Arena, Why Has the Main Battlefield of China's AI Competition Shifted?

marsbit06/22 06:05

Tremble Humans, AI Continues Its Accelerated Sprint

Trembling, Humans: AI Continues Its Accelerated Sprint Yes, AI is still rapidly accelerating. While deep learning seemed to stall quickly in its early years, large models after years of development show no sign of hitting their ceiling. At the Zhiyuan Conference 2026, the focus is on enabling AI to move from the digital world into the physical world. Scaling Law remains effective, continuing to drive advancements in both large language models and multimodal models. The industry is now entering a phase of pursuing World Models, though unresolved technical paths and data issues mean this exploration may take 3-5 more years. Concurrently, breakthroughs in Agents are accelerating AI's real-world application in fields like healthcare and meetings. Making Agents truly useful requires key hardware-software co-design, evident from the strong presence of chip vendors at the conference. We stand at a new historical threshold where AI is becoming a foundational force reshaping the world. The first day of the conference highlighted AI's evolution from "knowing how to chat" to "knowing how to work." Scaling Law persists, World Models are the next key battleground, and Agents are transitioning from usable to好用 (user-friendly). Scaling Law is not ending but diversifying. New models like Anthropic's Fable 5 demonstrate scaling through parameter size, synthetic data, and reinforcement learning. Advancements in AI Coding and Agent deployment are enabling a trend of AI self-evolution, potentially allowing AI to take over digital world iterations. World Models represent the next frontier for large models extending into the physical realm, but no current model is truly impressive at solving real-world problems. Technical consensus is lacking, with debates on data sources (video, simulation, real-world). Different approaches are emerging: language-centric, pixel-centric, 3D-structure-centric, and visual-representation-centric models. Zhiyuan Institute is exploring a fifth path: unified latent space modeling fusing language and visual representations, and introduced its own under-development World Model, Physis-v0.1. On the product side, Agents are key to bringing AI into daily life. Since 2025, the "Year of the Agent," products have become more proactive and capable of complex tasks. Zhiyuan showcased four vertical Agents for cardiac diagnosis, autonomous research, meeting summarization, and protein risk discovery. However, technical challenges remain, particularly in context engineering like memory and orchestration. "Harness" – the engineering framework around an Agent – is crucial for maximizing its capabilities by clarifying intent, designing workflows, and incorporating validation and feedback. In summary, AI's breakneck pace continues on multiple fronts: foundational model scaling, the ambitious pursuit of World Models for physical understanding, and the ongoing refinement of practical Agents. The journey from capable to truly reliable and useful AI systems is well underway.

marsbit06/13 02:51

Tremble Humans, AI Continues Its Accelerated Sprint

marsbit06/13 02:51

Insider: DeepSeek Is Forming a Harness Team to Benchmark Against Claude Code

DeepSeek is reportedly forming a dedicated "Harness" team to develop a code agent product, directly targeting Anthropic's Claude Code. According to internal sources and a social media post by DeepSeek senior researcher Chen Deli, the team will focus on building "DeepSeek Code Harness." The initiative involves recruiting for key roles like Harness Product Manager and Harness R&D Engineer in Beijing. DeepSeek defines its approach with the core formula: Model + Harness = Agent. This signifies a strategic shift from merely offering a powerful coding model to creating the essential middleware that connects the model to real-world developer workflows. The Harness will handle context management, tool calls, task planning, file operations, code editing, terminal execution, and feedback loops. The move highlights that competition in AI-assisted coding is evolving from pure model capability to ownership of the developer workflow entry point. While DeepSeek has strong foundational models (e.g., DeepSeek-Coder series), it has lacked an integrated, productized agent experience. The popularity of a community-built project, DeepSeek-TUI, demonstrated developer demand for a Claude Code-like tool using DeepSeek's models, but also revealed the limitations of unofficial solutions. By building its official Code Harness, DeepSeek aims to leverage its unique advantages: direct collaboration with its model training team, control over APIs and design, the ability to create a data feedback loop for model improvement, and access to real internal task scenarios. This step is seen as crucial for DeepSeek to transform its advanced models into a leading agent product that can deeply integrate into and enhance the actual software development process.

链捕手05/22 02:14

Insider: DeepSeek Is Forming a Harness Team to Benchmark Against Claude Code

链捕手05/22 02:14

Five Core Forms of AI Agent in YC's Eyes

The article outlines five core architectural patterns for effective AI Agents, emerging from tools like Codex and Claude, that move beyond simple prompts towards reusable, process-based capabilities. 1. **Skills**: Reusable, parameterized workflows that function like method calls, allowing a single process (e.g., "/investigate") to handle various tasks based on input parameters. 2. **Thin Harness**: A lightweight execution framework (~200 lines) that manages the AI model's "hands and feet"—handling loops, file I/O, and context—without becoming bloated. 3. **Resolvers**: Routing tables that map tasks to specific Skills, preventing "context corruption" when managing dozens of Skills and ensuring outputs go to the correct locations. 4. **Latent vs. Deterministic Layer**: A critical separation where LLMs handle judgment, synthesis, and pattern recognition, while deterministic code handles tasks requiring precision, consistency, and low cost (like calculations). 5. **Memory**: A persistent, accumulating knowledge base (e.g., a markdown folder) with a "current trusted conclusion" section and an append-only timeline, enabling the system to learn and retain context over time. Together, these patterns create a "process power"—a durable competitive advantage. Unlike one-off prompt-based applications whose value quickly commoditizes, a well-designed AI Agent system encodes experience into reusable, parameterized workflows, offloads stable rules to code, and continuously learns through memory. This creates a structured, hard-to-replicate capability that can provide sustained value for individuals or businesses, such as an accountant automating client reviews while preserving privacy and accumulating expertise.

marsbit05/20 07:46

Five Core Forms of AI Agent in YC's Eyes

marsbit05/20 07:46

Agents Have Entered the Harness-Driven Era

The article discusses the significance of the leaked Claude Code from Anthropic, highlighting its revelation of advanced Agent engineering practices centered on "Harness" design. Rather than relying solely on model capabilities, modern AI systems now depend on a structured engineering framework—the Harness—to maximize performance. This framework includes six core components: multi-layered System Prompts, Tool Schema, Tool Call Loop (with Plan and Execute modes), Context Manager, Sub-Agent coordination, and Verification Hooks. The Harness enables tighter integration between training and inference, supports long-chain tool execution, and improves reliability through objective verification. It also drives six key training directions: behavior alignment via System Prompt, end-to-end tool-use training, integrated plan-execute training, memory compression, sub-agent orchestration, and multi-objective reinforcement learning. The shift to Harness-driven development reduces the emphasis on pure prompt engineering, favoring instead multidisciplinary talent with skills in AI, backend engineering, and infrastructure. The market is evolving toward more secure, private, and vertically integrated Agent deployments, with "model shell" companies needing either strong infrastructure or deep domain expertise to compete. Claude Code’s leak underscores that future AI advancements will be shaped by engineering architecture as much as by algorithmic innovation.

marsbit04/15 10:11

Agents Have Entered the Harness-Driven Era

marsbit04/15 10:11

Thin Harness, Fat Skills: The True Source of 100x AI Productivity

The article "Thin Harness, Fat Skills: The True Source of 100x AI Productivity" argues that the key to massive productivity gains in AI is not more advanced models, but a superior system architecture. This framework, "fat skills + thin harness," decouples intelligence from execution. Core components are defined: 1. **Skill Files:** Reusable markdown documents that teach a model *how* to perform a process, acting like parameterized function calls. 2. **Harness:** A thin runtime layer that manages the model's execution loop, context, and security, staying minimal and fast. 3. **Resolver:** A context router that loads the correct documentation or skill at the right time, preventing context window pollution. 4. **Latent vs. Deterministic:** A strict separation between tasks requiring AI judgment (latent space) and those needing predictable, repeatable results (deterministic). 5. **Diarization:** The critical process where the model reads all materials on a topic and synthesizes a structured, one-page summary, capturing nuanced intelligence. The architecture prioritizes pushing intelligence into reusable skills and execution into deterministic tools, with a thin harness in between. This allows the system to learn and improve over time, as demonstrated by a YC system that matches startup founders. Skills like `/enrich-founder` and `/match` perform complex analysis and matching that pure embedding searches cannot. A learning loop allows skills to rewrite themselves based on feedback, creating a compound improvement effect without code changes. The conclusion is that 10x to 1000x efficiency gains come from this disciplined system design, not just smarter models. Skills represent permanent upgrades that automatically improve with each new model release.

marsbit04/13 04:19

Thin Harness, Fat Skills: The True Source of 100x AI Productivity

marsbit04/13 04:19

活动图片