7*24

Hot topic

Market

Activities

According to monitoring by Dongcha Beating, Yifan Zhang, a PhD student at Princeton, revealed that the next-generation flagship V4 of the Chinese AI company DeepSeek will be released next week. In a follow-up post, he listed three architectural components: Sparse Multi-Query Attention (Sparse MQA), Fused MoE Mega Kernel, and Hyper-Connections. Zhang completed his undergraduate studies at Peking University's Yuanpei College and his master's at Tsinghua University's Yao Class. He is currently a Fellow at Princeton AI Lab and previously worked as a research intern in the foundational model team at ByteDance Seed. He is not currently employed by DeepSeek, and the company has not confirmed the release schedule. Each of the three components corresponds to an independent direction in LLM optimization. Sparse MQA introduces sparsity based on multi-query attention to further reduce inference computational power and memory usage in long-context scenarios. The Fused MoE Mega Kernel integrates the routing judgment of MoE with expert matrix multiplication into the same GPU kernel, eliminating significant kernel startup and memory transfer overhead during the inference phase. Hyper-Connections generalize residual connections by replacing single residual addition with multiple learnable weighted pathways.

[DeepSeek V4 to be Released Next Week, Yifan Zhang Reveals Three Architectural Components]According to monitoring by Dongcha Beating, Yifan Zhang, a PhD student at Princeton, revealed that the next-generation flagship V4 of the Chinese AI company DeepSeek will be released next week. In a follow-up post, he listed three architectural components: Sparse Multi-Query Attention (Sparse MQA), Fused MoE Mega Kernel, and Hyper-Connections. Zhang completed his undergraduate studies at Peking University's Yuanpei College and his master's at Tsinghua University's Yao Class. He is currently a Fellow at Princeton AI Lab and previously worked as a research intern in the foundational model team at ByteDance Seed. He is not currently employed by DeepSeek, and the company has not confirmed the release schedule. Each of the three components corresponds to an independent direction in LLM optimization. Sparse MQA introduces sparsity based on multi-query attention to further reduce inference computational power and memory usage in long-context scenarios. The Fused MoE Mega Kernel integrates the routing judgment of MoE with expert matrix multiplication into the same GPU kernel, eliminating significant kernel startup and memory transfer overhead during the inference phase. Hyper-Connections generalize residual connections by replacing single residual addition with multiple learnable weighted pathways.

DeepSeek V4 to be Released Next Week, Yifan Zhang Reveals Three Architectural Components

On April 19, according to HTX data, RAVE has fallen below $1, currently priced at $0.98, with a decline of over 96% in the last 24 hours.

[RAVE Falls Below $1, Drops Over 96% in 24 Hours]On April 19, according to HTX data, RAVE has fallen below $1, currently priced at $0.98, with a decline of over 96% in the last 24 hours.

RAVE Falls Below $1, Drops Over 96% in 24 Hours

On April 19, data from Defillama showed that the KelpDAO hacker borrowed a large amount of ETH from Aave. As a precautionary measure, many whales withdrew their funds from Aave. As a result, Aave's Total Value Locked (TVL) fell to $21.966 billion, a decrease of 16.78% from yesterday's $26.396 billion.

[KelpDAO Incident Triggers Whales to Withdraw from Aave, TVL Drops 16.78% in One Day]On April 19, data from Defillama showed that the KelpDAO hacker borrowed a large amount of ETH from Aave. As a precautionary measure, many whales withdrew their funds from Aave. As a result, Aave's Total Value Locked (TVL) fell to $21.966 billion, a decrease of 16.78% from yesterday's $26.396 billion.

KelpDAO Incident Triggers Whales to Withdraw from Aave, TVL Drops 16.78% in One Day

cfg Surges 20.39% in 24H, Currently at 0.2704 USDT

【cfg currently trades at 0.2704 USDT, up 20.39% in 24h, according to HTX market data.】cfg Surges 20.39% in 24H, Currently at 0.2704 USDT

cfg currently trades at 0.2704 USDT, up 20.39% in 24h, according to HTX market data.

cfg Surges 10.27% in 24H, Currently at 0.2492 USDT

【cfg currently trades at 0.2492 USDT, up 10.27% in 24h, according to HTX market data.】cfg Surges 10.27% in 24H, Currently at 0.2492 USDT

cfg currently trades at 0.2492 USDT, up 10.27% in 24h, according to HTX market data.

HTX data showed that AAVE fell below 100  USDT and is now at 99.924 USDT, with a decrease of 15.07% in 24H.

[AAVE fell below 100  USDT] HTX data showed that AAVE fell below 100  USDT and is now at 99.924 USDT, with a decrease of 15.07% in 24H.

AAVE fell below 100  USDT

HTX data showed that TRX broke through 0.33  USDT and is now at 0.330012 USDT, with a increase of 1.06% in 24H.

[TRX broke through 0.33  USDT] HTX data showed that TRX broke through 0.33  USDT and is now at 0.330012 USDT, with a increase of 1.06% in 24H.

TRX broke through 0.33  USDT

HTX data showed that XMR broke through 350  USDT and is now at 350.02 USDT, with a increase of 0.11% in 24H.

[XMR broke through 350  USDT] HTX data showed that XMR broke through 350  USDT and is now at 350.02 USDT, with a increase of 0.11% in 24H.

XMR broke through 350  USDT

HTX data showed that BTC fell below 76000  USDT and is now at 75937.23 USDT, with a decrease of 2.43% in 24H.

[BTC fell below 76000  USDT] HTX data showed that BTC fell below 76000  USDT and is now at 75937.23 USDT, with a decrease of 2.43% in 24H.

BTC fell below 76000  USDT

June 30 (Huobi) -Gitcoin announced the closure of the old website and cGrants platform, and users can retrieve data from the old platform until July 30, 2023. Gitcoin will partner with AlloProtocol, gitcoinpassport and grantsstack for a more dynamic future. Meanwhile, the buidlbox team is upgrading the old bounty platform. Please note that personal information will no longer be accessible after July 30, 2023.

[Gitcoin Announced That the Old Website and cGrants Platform Will Be Closed on July 30, 2023, and the Old Bounty Platform Will Be Upgraded at the Same Time]June 30 (Huobi) -Gitcoin announced the closure of the old website and cGrants platform, and users can retrieve data from the old platform until July 30, 2023. Gitcoin will partner with AlloProtocol, gitcoinpassport and grantsstack for a more dynamic future. Meanwhile, the buidlbox team is upgrading the old bounty platform. Please note that personal information will no longer be accessible after July 30, 2023.

Gitcoin Announced That the Old Website and cGrants Platform Will Be Closed on July 30, 2023, and the Old Bounty Platform Will Be Upgraded at the Same Time

How to Protect Your Digital Assets? A 15-Step Checklist from an OpenAI Co-founder

Norman Chan: Steadily Developing Hong Kong's Compliant Stablecoin Ecosystem

US Stablecoins Welcome New Regulations: Interpreting the FDIC Draft, How Bank-Issued Stablecoins Should Operate According to the Rules

Anthropic's 'Cry' Sparks Wall Street Panic! 27-Year-Old, Mythos Instantly Defeated by 8 AIs

From Failing to Start a Hedge Fund Before the Financial Crisis to Managing Trillions in Assets: BlackRock's Global Fixed Income CIO Shares Investment Philosophy

Crypto Market Structure Bill Enters Crucial Stage, Coinbase CEO Says “It’s Time”

When AI's Bottleneck Is No Longer the Model: Perseus Yang's Open Source Ecosystem Building Practices and Reflections

Bitcoin Pulls Back To $71,000 As Profit-Takers Strike Again

Analyst Exposes Bitcoin Market Maker Buy Strategy, Shows What Happens When Accumulation Ends

Gitcoin Announced That the Old Website and cGrants Platform Will Be Closed on July 30, 2023, and the Old Bounty Platform Will Be Upgraded at the Same Time

Isenção de responsabilidade：O conteúdo acima não representa as posições da HTX.，A HTX não faz quaisquer recomendações de negociação.。

Todos os comentários0Mais recentePopular

Tópicos em destaque