# Сопутствующие статьи по теме Benchmark

Новостной центр HTX предлагает последние статьи и углубленный анализ по "Benchmark", охватывающие рыночные тренды, новости проектов, развитие технологий и политику регулирования в криптоиндустрии.

Institutional Adoption of Prediction Markets Stuck at the Third Stage

Prediction markets are transitioning from niche platforms focused on elections and sports to mainstream financial tools, as highlighted at Kalshi Research's inaugural conference. While sports still dominate trading volume (around 80%), non-sports categories like macroeconomics, politics, and entertainment are growing faster, signaling a shift from entertainment-based trading to information and risk management tools. Institutions, including Wall Street firms, are increasingly using prediction markets for data reference (Stage 1 adoption), with some progressing to system integration (Stage 2). However, full-scale trading (Stage 3) is limited due to the lack of margin trading, requiring full collateral for positions—a barrier for leverage-dependent entities. Kalshi is working with regulators to introduce margin mechanisms. Key insights from participants like Goldman Sachs and CNBC emphasize the value of real-time pricing for events (e.g., Fed decisions, tariffs), providing benchmarks previously unavailable. The path to maturity mirrors historical financial instruments like options, with expectations that prediction markets will become institutional staples within five years. Political leaders, including Trump and Schumer, now cite Kalshi odds, underscoring its growing influence. The platform rewards domain expertise over traditional finance backgrounds, attracting diverse participants from fields like music and poker. Ultimately, prediction markets are evolving into critical infrastructure for pricing uncertainty.

marsbit9 ч. назад

Institutional Adoption of Prediction Markets Stuck at the Third Stage

marsbit9 ч. назад

Institutional Adoption of Prediction Markets Stuck at the Third Stage

Prediction markets are transitioning from niche platforms focused on elections and sports to mainstream tools for information and risk management. While events like the Super Bowl still dominate trading volume, non-sports categories—such as macroeconomics, politics, and entertainment—are growing faster and attracting institutional interest. Key drivers include the need for real-time benchmarks on uncertain events (e.g., election outcomes or policy changes), which traditional markets lack. Institutions like Goldman Sachs and CNBC are already using prediction market data for decision-making, though most remain in the early stages of adoption. The path to full institutional integration involves three phases: data integration, system compliance, and active trading. The current barrier to large-scale trading is the lack of margin trading, requiring full collateral for positions—a limitation platforms like Kalshi are working to address. Experts compare prediction markets to the early days of options trading, anticipating they will become a standard, if mundane, financial infrastructure. Political leaders and institutions are increasingly referencing these markets, signaling their growing credibility. The future lies in their evolution from speculative arenas to essential tools for hedging and pricing uncertainty.

Odaily星球日报9 ч. назад

Institutional Adoption of Prediction Markets Stuck at the Third Stage

Odaily星球日报9 ч. назад

OpenClaw Goes Viral, Exposing 12 Types of Critical Vulnerabilities; MCP Protocol Security Benchmark Released

The rapid rise of OpenClaw and similar AI Agents highlights the growing security risks associated with the Model Context Protocol (MCP), a standard enabling models to interact with external tools. Researchers from Beijing University of Posts and Telecommunications introduced MSB (MCP Security Bench), a security benchmark identifying 12 types of attacks across MCP’s three core stages: task planning, tool invocation, and response handling. These include name collision, false errors, retrieval injection, and mixed attacks. Notably, more capable models are often more vulnerable, with an average attack success rate (ASR) of 40.35%. The study also proposes a new metric, Net Resilient Performance (NRP), to balance security and utility. MSB evaluates agents in real-world environments, demonstrating that attacks remain effective even when harmless tools are present. The work underscores the urgent need for robust safety measures as AI agents gain broader tool-use capabilities.

marsbitВчера 04:04

OpenClaw Goes Viral, Exposing 12 Types of Critical Vulnerabilities; MCP Protocol Security Benchmark Released

marsbitВчера 04:04

10 Charts to Understand the State of AI in 2026: US-China Gap Only 2.7%, Sharp Decline in Programmer Positions for Under-25s

The 2026 AI Index Report from Stanford HAI reveals that AI adoption is accelerating faster than PCs and the internet, with a 53% global adoption rate. However, societal systems, job markets, and measurement tools lag behind. Key findings include: - Benchmark reliability is questionable, with 42% of GSM8K math problems deemed invalid. - The U.S. and China show near-parity in model performance (2.7% gap), with the U.S. leading in compute/capital and China in research/manufacturing. - Top models (Anthropic, xAI, Google, OpenAI) show converging capabilities, shifting competition to cost and reliability. - Employment for young developers (22–25) fell nearly 20%, with McKinsey noting AI-driven reductions in services, supply chain, and engineering. - The U.S. ranks 24th in adoption (28.3%) despite leading investment ($285.9B private AI funding in 2025). - AI agent task success improved but has ~33% failure rates; physical robots struggle outside labs (12.4% home success vs. 89.4% in sim). - A stark expert-public divide exists: 73% of experts vs. 23% of the public view AI’s job impact positively. - GPT-4o’s annual water use exceeds 12M people’s needs; AI data centers consume power equivalent to New York State. The report underscores rapid AI integration amid unresolved ethical, environmental, and economic challenges.

marsbit2 дня назад 00:18

10 Charts to Understand the State of AI in 2026: US-China Gap Only 2.7%, Sharp Decline in Programmer Positions for Under-25s

marsbit2 дня назад 00:18

Claude's Intelligence Decline: Suicide or Playing Dead?

Recent reports indicate that Claude Opus 4.6, Anthropic's flagship model, has experienced a significant decline in performance, with its global ranking dropping from 2nd to 10th on BridgeBench. Accuracy fell sharply from 83.3% to 68.3%, while the hallucination rate nearly doubled. Users expressed frustration over the model's reduced capability for complex tasks. However, leaked internal screenshots suggest Anthropic is shifting focus toward a broader strategy: developing Claude Projects, a full-stack application builder. This platform allows users to create functional applications—such as AI chatbots, interactive games, and SaaS dashboards—with minimal coding, potentially making traditional programming obsolete. Anthropic’s move appears to prioritize platform ecosystem development over model leaderboard rankings. With annual revenue reaching $30 billion, largely from API usage, the company aims to reduce dependency on commoditized AI models by creating a sticky, integrated environment where users build and deploy directly within its ecosystem. This strategic pivot reflects a broader industry trend where becoming an indispensable infrastructure matters more than having the highest-performing model in benchmarks.

marsbit04/13 12:02

Claude's Intelligence Decline: Suicide or Playing Dead?

marsbit04/13 12:02

Anthropic's 'Cry' Sparks Wall Street Panic! 27-Year-Old, Mythos Instantly Defeated by 8 AIs

Anthropic's announcement of Claude Mythos, an AI tool claiming to discover thousands of zero-day vulnerabilities—including a 27-year-old bug in OpenBSD—triggered alarm on Wall Street and prompted emergency meetings among financial regulators fearing systemic cyberattacks. However, independent tests revealed significant exaggerations in these claims. Researchers found that many reported vulnerabilities were in obsolete software or were impractical to exploit, and the findings relied on only 198 manual reviews. Furthermore, multiple smaller, open-source AI models (some with as few as 3 billion parameters) successfully identified the same critical flaws at a fraction of the cost, demonstrating that AI cybersecurity capability does not linearly scale with model size. Meanwhile, users reported severe performance degradation in Claude Opus 4.6, with reduced reasoning depth and increased API costs. Critics, including prominent hacker George Hotz, accused Anthropic of overstating risks for marketing purposes, creating a "wolf cry" scenario where hype overshadows reality.

marsbit04/12 08:03

Anthropic's 'Cry' Sparks Wall Street Panic! 27-Year-Old, Mythos Instantly Defeated by 8 AIs

marsbit04/12 08:03

Wang Tao's First Large Model Brings Meta Back to the Table

Meta has unveiled Muse Spark, the first model from its new Muse series, marking a significant step in its AI strategy under the leadership of Alexandr (Wang) since his appointment ten months ago. Designed to be compact and fast, Spark is a natively multimodal reasoning model that integrates visual information into its core architecture, enabling advanced capabilities like visual chain-of-thought reasoning. It excels in areas such as medical reasoning, visual and chart understanding, and scientific reasoning, though it lags in coding and long-form tasks compared to rivals like GPT-5.4 and Gemini 3.1 Pro. The model will power Meta AI across platforms like WhatsApp, Instagram, and Facebook, with private API access for select partners. The release follows Meta’s shift from its earlier Llama series and significant internal investment, including a restructured AI stack and expanded infrastructure. Spark’s introduction spurred a 6.5% rise in Meta’s stock, reflecting market optimism. Meta plans to develop larger models in the Muse series, potentially adopting a hybrid open/closed-source approach moving forward.

marsbit04/09 10:57

Wang Tao's First Large Model Brings Meta Back to the Table

marsbit04/09 10:57

Just Now, Zuckerberg's $14.3 Billion "Avocado" Is Here: Challenging GPT-5.4 Head-On, Silicon Valley's Most Expensive Chinese Debut

Meta has unveiled Muse Spark (codenamed Avocado), its first AI model from the Meta Superintelligence Lab (MSL), positioning it as a direct competitor to leading models like GPT-5.4 and Gemini 3.1 Pro. With a score of 52 on the Artificial Analysis benchmark, it significantly outperforms its predecessor, Llama 4 Maverick (18 points), and ranks among the top models. Key features include native multimodal perception, tool use, visual chain-of-thought reasoning, and multi-agent collaboration via a "Contemplating Mode." Muse Spark excels in multimodal tasks, health-related queries (trained with input from 1,000+ clinicians), and agent-based applications, though it lags slightly in coding and complex reasoning tasks. The model is highly token-efficient, using significantly fewer tokens than competitors like Opus 4.6 and GPT-5.4 for similar performance. It is integrated into Meta's platforms (meta.ai, Facebook, Instagram, WhatsApp) and is free to use, though it remains closed-source. The development involved a complete rebuild of Meta's AI stack, reducing pre-training compute needs to one-tenth of Llama 4's requirements. The project, led by Chief AI Officer Alexandr Wang and a team of researchers from OpenAI and DeepMind, marks Meta's re-entry into the top tier of AI development.

marsbit04/09 07:49

Just Now, Zuckerberg's $14.3 Billion "Avocado" Is Here: Challenging GPT-5.4 Head-On, Silicon Valley's Most Expensive Chinese Debut

marsbit04/09 07:49

Who is the Truly Strongest Agent in OpenClaw? Leaderboard of 23 Real-World Task Evaluations Released

This report presents a comprehensive benchmark evaluating the performance of AI coding agents on 23 real-world OpenClaw tasks, focusing solely on the core metric of success rate. The transparent and reproducible testing methodology employs three scoring methods: automated checks, an LLM judge (Claude Opus), and a hybrid approach. The diverse task set covers areas like code/file operations, content creation, research, system tools, and memory persistence. The top 10 models by success rate (Best % / Avg %) are: 1. anthropic/claude-opus-4.6 (93.3% / 82.0%) 2. arcee-ai/trinity-large-thinking (91.9% / 91.9%) 3. openai/gpt-5.4 (90.5% / 81.7%) 4. qwen/qwen3.5-27b (90.0% / 78.5%) 5. minimax/minimax-m2.7 (89.8% / 83.2%) Claude Opus 4.6 leads in peak performance, while Arcee's Trinity demonstrates superior average success rate stability. The Qwen series shows strong cost-performance potential with multiple entries in the top ten. All task definitions and scoring logic are publicly available for independent verification.

marsbit04/08 14:45

Who is the Truly Strongest Agent in OpenClaw? Leaderboard of 23 Real-World Task Evaluations Released

marsbit04/08 14:45

Claude Mythos Officially Announced: Performance Crushes Opus 4.6, 'Imprisoned' for Being Too Dangerous

Anthropic has officially announced Claude Mythos, a highly advanced AI model that reportedly surpasses Opus 4.6 across multiple benchmarks, including a 24% improvement in bug-fixing capability and a 17% boost in agent-based computer operations. However, due to its dangerous ability to identify and exploit security vulnerabilities at a level exceeding most human hackers, the model has been deemed a significant risk to public and economic security. Instead of releasing it publicly, Anthropic has initiated "Project Glasswing," a collaborative security effort involving major tech companies like Amazon, Apple, Google, Microsoft, and NVIDIA, along with open-source organizations. These partners will use the preview version of Mythos to strengthen defenses and identify vulnerabilities in critical systems before the model is widely available. Anthropic is also providing up to $100 million in usage credits and donating $4 million to support open-source security initiatives. The move underscores the urgent need to address AI safety at a global scale, as rapidly advancing capabilities could soon outpace existing security measures.

marsbit04/08 00:26

Claude Mythos Officially Announced: Performance Crushes Opus 4.6, 'Imprisoned' for Being Too Dangerous

marsbit04/08 00:26

活动图片

Популярные категорииright-arrow

Популярные тегиright-arrow

Project Updates