China's Chips, the Hidden Intersection of DeepSeek and Kimi

marsbitDipublikasikan tanggal 2026-04-22Terakhir diperbarui pada 2026-04-22

Abstrak

China's AI startup Kimi has released its latest open-source model, K2.6, featuring significant improvements in coding and agent capabilities. This version enhances long-context processing, supports up to 4,000 lines of code generation, and improves API accuracy and multi-agent collaboration, allowing up to 300 sub-agents to work in parallel. Kimi also introduced architectural innovations like MuonClip, Kimi Linear, and Attention Residuals to optimize scaling and efficiency. A key development is the "Prefill-as-a-Service" (PrfaaS) approach, which decouples prefill and decode tasks across data centers using heterogeneous hardware, significantly reducing latency and cost per token. This strategy not only improves performance but also creates opportunities for integration with domestic AI chips, as reliance on Chinese hardware grows due to export restrictions. Both Kimi and DeepSeek are increasingly aligning with local semiconductor advancements, shaping a new ecosystem for AI development in China.

"K2.6 is our strongest code model to date," Kimi wrote on its official account.

On the evening of April 20th, Kimi officially launched the open-source model K2.6, which demonstrates stronger programming and Agent capabilities, about a quarter after the release of version K2.5.

There was also a minor episode: rumors suggested that DeepSeek V4 would be released this week. If everything proceeds as expected by the outside world, this would be the Nth time Kimi and DeepSeek have coincided. But at a more fundamental infrastructure level, there is an underlying thread: Kimi and DeepSeek, these two large model startups, are ultimately destined to step into the same river—advancing together with domestic chip startups.

Rewind to March 2026, when Yang Zhilin took the stage at NVIDIA's GTC conference to discuss Kimi's technical roadmap. He said, "Many of the commonly used technical standards today are essentially products from eight or nine years ago, gradually becoming a bottleneck for Scaling."

To address such issues, Kimi has contributed to the open-source community the first large-scale application of the second-order optimizer MuonClip, the Kimi Linear architecture that makes large models more efficient at processing long contexts, and Attention Residuals, which optimizes the connections between deep neural network layers.

Kimi's Scaling Strategy

Yang Zhilin believes that Kimi's evolution logic can be summarized as the "merger" of Token efficiency, long context, and Agent clusters. The newly launched Kimi K2.6 can be understood as a new assignment submitted by Yang Zhilin along this Scaling path.

Kimi's official website has integrated K2.6

Code, Agent, and What Else?

As one of the most easily standardized capabilities, code is a must-win area for cutting-edge models.

From K2 to K2.5 to K2.6, Kimi has maintained an iteration rhythm of about one quarter on several open-source models. However, since this is a minor version number, it hints that Yang Zhilin may have more cards up his sleeve.

"K2.6 has significantly improved long-range coding capabilities, able to code uninterrupted for 13 hours in tests, writing or modifying over 4,000 lines of code," Kimi wrote in a promotional material. "On the Kimi Code Bench, Kimi's internal strict code evaluation benchmark covering various complex end-to-end tasks, K2.6's score improved by about 20% compared to K2.5."

It's worth noting that K2.5 was already a very "capable model," topping the OpenRouter charts in February. A source close to Kimi posted a screenshot of co-founder Zhang Yutao's朋友圈 at the time, saying, "He seemed very satisfied with this version."

K2.6's performance on general Agent, programming, and visual Agent benchmarks

For Agent frameworks like OpenClaw and Hermes, K2.6's core improvements focus on the accuracy of API calls and the stability of long-running operations—one enhances the cost of task execution, while the other optimizes the efficiency of task execution.

In the K2.5 version launched in January, Kimi introduced the concept of "Agent clusters," breaking down a task into multiple sub-tasks and automatically assigning them to different specialized Agents for processing, thereby reducing task processing time and avoiding the risk of entire project failure under serial task flows.

Demonstration of Kimi K2.6's Agent cluster capability

In the new K2.6 version, this capability is further amplified, integrating and parallelizing breadth search with in-depth research, large-scale document analysis and long-form writing, and multi-format content generation, supporting up to 300 sub-Agents completing 4,000 collaborative steps in parallel.

To summarize the highlights of Kimi K2.6 in one sentence, they大致包括: evolution in code and long-range task capabilities, evolution of Agent cluster capabilities, and optimization for mainstream Agent frameworks.

If I had to pick a personal preference from the above features, I believe the Agent cluster is the most valuable capability—it directly embodies the explosive power of parallel computing. Whether it's code or the stability of long-range tasks, these are things that model iteration must address. More importantly, based on these capability improvements, they drive innovation in Agent working methods, efficiency, and even interaction modes.

After all, as a user, what I want is not for it to tell me what it can do, but for it to drive Agents to solve my real problems and form effective productivity.

When K2.5 was launched, an academic researcher began using this model for scientific research projects. His evaluation at the time was that it had no weaknesses and could serve as a research assistant.

"The multi-Agent provided by the official is indeed effective; many domestic Agents last year were still toys."

If Kimi K2.5 received positive evaluations both internally and externally, how effective will K2.6, which goes a step further, be?

On the Artifacial Analysis intelligence leaderboard, Kimi K2.6 ranks仅次于 three closed-source models and leads the open-source model weight leaderboard

The "New Story" in the Roadmap

Kimi always occasionally brings something new to the industry, including the MuonClip, Kimi Linear, and Attention Residuals mentioned in Yang Zhilin's roadmap speech. Some explorations have also received positive recognition from industry top players.

In mid-March, Kimi published a paper on Attention Residuals, proposing the use of attention mechanisms to改造残差连接. Musk directly tweeted that this was "an impressive breakthrough by Kimi."

Last weekend, Kimi published a new paper titled "Prefill-as-a-Service: KVCache of Next-Generation Models Could Go Cross-Datacenter" (PrfaaS, Prefill-as-a-Service), mentioning Kimi's new exploration in architecture,核心讨论的仍然是 PD separation (Prefill and Decode).

PD separation is not a new topic—the Prefill stage of model inference is a computationally intensive task, while the Decode stage relies on memory bandwidth, with memory repeatedly reading and writing KV Cache. This architecture aims to decouple compute-intensive tasks from bandwidth-intensive tasks, improving compute utilization and throughput, thereby reducing costs and increasing efficiency.

Although PD separation is good, there is a sticking point: it must be based on RDMA high-speed networks within the same data center.

The core point of Kimi's PrfaaS paper is: based on a hybrid model (Kimi Linear), it significantly reduces the KV cache size, and then completely decouples Prefill and Decode into different heterogeneous clusters.

The experimental example mentioned in the paper shows that the PrfaaS dedicated prefill cluster uses 32 H200 GPUs focused on high compute power; the local PD decoding cluster uses 64 H20 GPUs interconnected via RDMA internal network; the two clusters are connected via VPC dedicated line, with a total cross-cluster bandwidth of about 100Gbps. The test model is a 1T parameter Kimi Linear hybrid attention model.

Actual test results show that the PrfaaS-PD cross-data center solution, compared to the 96-card H20 same PD cluster solution, improves throughput by 54%, reduces P90 TTFT (the waiting time for 90% of users from sending a request to seeing the first character returned) from 9.73s to 3.51s, a reduction of 64%, and the cross-data center KV cache transmission bandwidth only占用 13% of the total 100Gbps bandwidth.

Comparison of KV throughput between hybrid architecture models and dense models under different context lengths

To demonstrate the advantages of the hybrid model architecture, the paper mentions a set of experiments: under an 8-card H200 and SGLang v0.5.9 inference framework, benchmark tests were conducted on several mainstream models. At a context length of 32K, the KV throughput of the MiMo-V2-Flash model using hybrid attention was only 4.66Gbps, while the similarly scaled dense attention model MiniMax-M2.5 reached 59.93Gbps, directly proving that the hybrid attention architecture can reduce KV cache transmission requirements to within the range manageable by ordinary Ethernet.

"Cross-data center + heterogeneous hardware unlocks the potential to significantly reduce per-token cost," Kimi said on its official account.

Regarding token cost reduction, I mentioned in the article "The People Miss DeepSeek" that there is room for optimization at both the model and hardware levels. Professor Hu Yanping from Shanghai University of Finance and Economics specifically posted a朋友圈, emphasizing that cost reduction cannot rely on DeepSeek alone. "The solution depends on the cost efficiency of compute power supply,跨代提升 of model quality, continuous advancement of intelligence paradigms, and the放大效应 of workflow and scenario integration."

From this perspective, Kimi has told the industry a new story about token cost reduction.

Chinese Models Summon Chinese Chips

In the Prefill-as-a-Service paper, more people only noticed the cross-data center narrative, while overlooking the point about heterogeneous hardware.

It is important to note that H200 and H20 are still based on the Hopper architecture in terms of chip design. The heterogeneity mentioned in the paper refers to heterogeneity in bandwidth and compute power. Its启示 is: we can use一部分 compute-powerful domestic cards for Prefill, or bandwidth-strong domestic cards for Decode, and of course, they can also be mixed with overseas cards to achieve cost reduction and efficiency improvement.

It can be said that this is a door opened by Kimi for Chinese chips in large model inference.

In the view of a domestic compute power insider, to catch this wave of traffic benefits brought by the Prefill-as-a-Service solution, they still have to face the old problem of ecosystem.

Over the past few years, Chinese large models have been stuck outside domestic compute power due to ecosystem challenges, but there is another unnoticed detail: products like the H20 have been断供 for a year. In other words, in the short term, there is only one option for inference chips: domestic.

As inference demand surges, compared to supply, ecosystem challenges will switch to secondary issues—the dependence of Chinese large models on domestic compute power has changed from optional to不得不使用. Because of this, many predictions are discussing that DeepSeek V4 is adapting to domestic compute power.

In my article with Professor Hu Yanping, "The Last Urging Letter to DeepSeek," we said that adapting to domestic compute power is a very difficult road for domestic models, but in the longer term, it has to be done. Something that must be done always needs a starting point, and perhaps DeepSeek V4 is that starting point.

Now, DeepSeek V4 has not yet arrived, but Kimi has already used its own practice to explore a feasible path for the combination of Chinese models + Chinese chips.

Kimi has taken the lead as a model representative in extending an olive branch; the problem now lies with domestic chip startups.

Does everyone remember Huang Renxun's reaction when asked about the chip export ban to China in the latest episode of "the Dwarkesh Podcast"? He said that chips are not uranium enrichment, and禁售 cannot stop the progress of Chinese chips; they can still develop models by暴力堆叠 domestic chips.

Why did Huang Renxun say this? The next step for DeepSeek and Kimi is the standard answer.

This article is from the WeChat public account "Tencent Technology," author: Su Yang, editor: Xu Qingyang

Pertanyaan Terkait

QWhat are the key improvements in Kimi's K2.6 model compared to K2.5?

AKimi's K2.6 model shows significant improvements in long-range coding capabilities, allowing uninterrupted coding for up to 13 hours and handling over 4000 lines of code. It also enhances API call accuracy and long-running stability for Agent frameworks, and expands Agent cluster capabilities to support up to 300 sub-agents performing 4000 collaborative steps in parallel. Overall, it achieves a 20% performance boost on Kimi's internal code benchmark compared to K2.5.

QHow does Kimi's Prefill-as-a-Service (PrfaaS) architecture improve efficiency?

AKimi's PrfaaS architecture decouples the Prefill (compute-intensive) and Decode (memory bandwidth-intensive) stages of model inference across different heterogeneous clusters, even across data centers. By using a hybrid attention model (Kimi Linear) to reduce KV cache size, it allows the use of high-compute chips (e.g., H200) for Prefill and high-bandwidth chips (e.g., H20) for Decode, connected via VPC dedicated lines. This approach increases throughput by 54%, reduces latency (P90 TTFT) by 64%, and significantly lowers token costs.

QWhat role do Chinese chips play in the future of AI companies like Kimi and DeepSeek?

AChinese chips are becoming a critical infrastructure for AI companies like Kimi and DeepSeek due to export restrictions on high-end GPUs like NVIDIA's H20. Kimi's PrfaaS architecture demonstrates how heterogeneous hardware—including domestic chips—can be used for Prefill and Decode tasks, offering a viable path for cost-efficient inference. As推理 demand grows, reliance on domestic chips shifts from optional to necessary, pushing Chinese AI firms to adapt and collaborate with local chip startups.

QWhat did Elon Musk say about Kimi's research contribution?

AElon Musk tweeted that Kimi's work on Attention Residuals—a technique using attention mechanisms to modify residual connections—was 'an impressive breakthrough by Kimi.'

QHow does Kimi's Agent cluster capability enhance productivity?

AKimi's Agent cluster capability breaks down complex tasks into sub-tasks distributed among specialized agents, enabling parallel processing. This reduces task failure rates and improves efficiency by avoiding serial bottlenecks. In K2.6, it integrates breadth-depth search, large-scale document analysis, long-form writing, and multi-format content generation, supporting up to 300 sub-agents and 4000 collaborative steps, making it a concrete productivity tool for users.

Bacaan Terkait

Di Ethereum Terbentuk Antrian Staking Selama 43 Hari: Namun, Menurut Seorang Ahli, Ini Bukan Sinyal Bullish Sejati

Antrian untuk staking di Ethereum telah mencapai waktu tunggu sekitar 43 hari, dengan sekitar 2,5 juta ETH menunggu aktivasi. Lonjakan ini disebabkan oleh peningkatan minat validator, termasuk dari investor institusional. Namun, Thomas Brunner dari Sygnum Bank menyatakan bahwa antrian panjang ini bukanlah sinyal bullish langsung bagi harga ETH. Brunner menjelaskan bahwa antrian tersebut tidak hanya mencerminkan permintaan baru, tetapi juga dipengaruhi oleh mekanisme protokol Ethereum. Setelah pembaruan Dencun, kapasitas aktivasi validator dibatasi sekitar 57.600 ETH per hari, dan batas ini tidak dinaikkan dalam pembaruan Pectra. Pectra memungkinkan validator menambah hingga 2.048 ETH ke akun yang ada, tetapi transaksi tambahan ini tetap masuk ke antrian aktivasi yang sama, sehingga berkontribusi pada penumpukan. Menurutnya, sinyal pasar yang lebih kuat justru adalah antrian penarikan dana yang hampir kosong. Hal ini menunjukkan bahwa validator yang ada mempertahankan posisi mereka, yang mencerminkan kepercayaan terhadap jaringan. Saat ini, sekitar 41,2 juta ETH (33,8% dari total pasokan) telah di-stake. Brunner juga mencatat bahwa meskipun harga ETH melemah, minat institusional terhadap staking tetap kuat karena dianggap sebagai fitur fundamental. Namun, tantangan privasi masih menjadi hambatan besar, karena alamat validator dan transaksi dapat dilacak di blockchain, membuat investor institusi berhati-hati dalam meningkatkan operasi staking mereka.

cryptonews.ru1j yang lalu

Di Ethereum Terbentuk Antrian Staking Selama 43 Hari: Namun, Menurut Seorang Ahli, Ini Bukan Sinyal Bullish Sejati

cryptonews.ru1j yang lalu

NKCBFU Membuka Detail Persiapan RUU tentang Kriptocurrency

Kepala Komisi Nasional untuk Sekuritas dan Pasar Modal Ukraina (НКЦБФР), Alexey Semenyuk, mengungkapkan bahwa rancangan undang-undang mengenai regulasi aset virtual di Ukraina telah 90% selesai dan ditargetkan rampung pada Agustus mendatang. Namun, beberapa isu kunci masih belum terselesaikan, termasuk aspek perpajakan dan status hukum aset kripto dalam proses pidana serta eksekusi. Poin-poin yang telah disepakati meliputi pembagian kewenangan regulator, dengan НКЦБФР sebagai regulator utama pasar aset virtual dan daftar tugas yang jelas untuk Bank Nasional. Klasifikasi aset virtual juga telah disetujui sesuai dengan regulasi Eropa MiCA, mencakup token terkait aset, token uang elektronik, dan aset virtual lainnya. Persyaratan perizinan untuk penyedia layanan, aturan prudensial (seperti modal dan penyimpanan aset klien), serta rezim khusus selama keadaan perang telah disepakati. Namun, negosiasi masih berlangsung mengenai detail perpajakan (tarif, dasar pengenaan, waktu kewajiban pajak, periode keringanan) dan status hukum aset virtual dalam konteks hukum pidana dan eksekutif. Masa transisi setelah undang-undang berlaku juga masih dibahas. Proses legislasi ini telah berlangsung selama beberapa tahun. RUU tersebut telah melewati pembacaan pertama di parlemen pada September 2025, namun mengalami banyak amandemen. Otoritas berharap draf final siap pada Agustus, dengan target implementasi per 1 Januari 2027.

cryptonews.ru2j yang lalu

NKCBFU Membuka Detail Persiapan RUU tentang Kriptocurrency

cryptonews.ru2j yang lalu

Pemimpin Perusahaan Penambang Besar Nilai Profitabilitas AI Sepuluh Kali Lipat dari Penambangan

Kepala perusahaan penambangan Kanada, HIVE Digital Technologies, Frank Holmes, menyatakan percepatan pengembangan arah komputasi untuk kecerdasan buatan dalam sebuah wawancara. HIVE termasuk di antara penambang publik terbesar dan mengontrol sekitar 2% dari hashrate Bitcoin global. Menurut Holmes, porsi pendapatan perusahaan dari AI diperkirakan meningkat dari sekitar 10% menjadi lebih dari 50% tahun ini. Dia mencatat bahwa saat ini, penambang ASIC menghasilkan sekitar $0,12–0,14 per jam, sedangkan satu unit GPU Nvidia H100 dapat menghasilkan hampir $2 per jam. Bahkan GPU yang lebih tua menghasilkan sekitar $1,4 per jam, sekitar sepuluh kali lipat lebih banyak daripada peralatan penambangan. Banyak penambang besar seperti Riot Platforms, Cipher Digital, MARA, dan TeraWulf meminimalkan kerugian dengan beralih dari penambangan kripto ke mendukung komputasi AI di pusat data mereka atau menggabungkan kedua aktivitas tersebut. Awal Juli, penambang terbesar di AS, MARA Holdings, membeli lahan untuk pusat data AI dan penambangan seharga $600 juta. Bahkan pada November lalu, CEO MARA Fred Thiel menyatakan bahwa tanpa kenaikan harga Bitcoin minimal 50% per tahun, model penambangan saat ini akan menjadi tidak menguntungkan. Biaya produksi satu Bitcoin tidak dapat dihitung secara tepat, namun secara umum, menurut berbagai model estimasi, pada musim panas 2026 biaya tersebut sekitar $78 ribu. Harga Bitcoin telah bertahan di bawah level ini selama beberapa bulan, dan beberapa penambang mulai mematikan peralatan mereka ketika kompleksitas meningkat karena kenaikan biaya.

cryptonews.ru2j yang lalu

Pemimpin Perusahaan Penambang Besar Nilai Profitabilitas AI Sepuluh Kali Lipat dari Penambangan

cryptonews.ru2j yang lalu

Trading

Spot
活动图片