# Пов'язані статті щодо AI Benchmark

Центр новин HTX надає останні статті та поглиблений аналіз на тему "AI Benchmark", що охоплює ринкові тренди, оновлення проєктів, технологічні розробки та регуляторну політику в криптоіндустрії.

Claude Science Completes Two Years' Work in a Few Weeks, Is 10x Research Acceleration Really Here?

Claude Science, a new AI workbench from Anthropic, is being tested by scientists, reportedly accelerating specific research workflows by up to 10x. A neuro-scientist at the Allen Institute completed a lengthy literature review in weeks instead of nearly two years using the tool, which automates tasks like citation verification. The platform is an integrated environment for macOS and Linux, connecting to local or remote computing resources. It streamlines the fragmented research process—literature analysis, computation, visualization, and drafting—into a single, auditable workflow. A key feature is its emphasis on reproducibility: every chart generated includes the exact code, environment, and history used to create it. Claude Science uses a multi-agent system. A coordinator manages over 60 pre-configured skills for life sciences (genomics, proteomics, etc.) and can spawn specialized agents. A dedicated reviewer agent checks citations and calculations for accuracy, creating a form of internal AI peer review. The system operates with a human-in-the-loop, requiring user approval for major steps. Initial applications are in life sciences. Examples include target identification for biotech company Manifold Bio and germline variant analysis for glioma research at UCSF, completing analyses in roughly one-tenth the previous time. The approach contrasts with competitors: Google focuses on proprietary models like AlphaFold, while OpenAI is advancing models' scientific reasoning with benchmarks like GeneBench-Pro. Claude Science differentiates by automating and integrating the practical research pipeline, not just the model's intelligence, aiming to make AI-aided science more reproducible and integrated into daily lab work.

marsbit07/01 09:50

Claude Science Completes Two Years' Work in a Few Weeks, Is 10x Research Acceleration Really Here?

marsbit07/01 09:50

"Agents' Last Exam", Claude Fable 5 Actually Loses to GPT 5.5

Surprisingly, in the newly released "Agents' Last Exam" (ALE) benchmark from UC Berkeley, GPT-5.5 has outperformed the recently launched and highly-regarded Claude Fable 5. ALE tests AI agents on their ability to perform real-world tasks across 55 professional domains—such as 3D modeling in Siemens NX, creating game scenes in Unreal Engine, and visual effects work in Adobe After Effects—by granting them full GUI and command-line access. In the core task completion rate ranking, GPT-5.5 configurations secured the top two spots (24.0% and 23.0%), while Claude Fable 5 with Claude Code came in third (22.0%). Notably, the highest pass rate was only 24%, and the most difficult "Last-Exam" tier saw most top models, including GPT-5.5 and Fable 5, scoring zero. The benchmark also revealed significant cost and efficiency gaps: Fable 5 spent over four times more money than GPT-5.5's most expensive configuration for a slightly lower score, and was much slower. ALE differs from previous knowledge-based benchmarks by evaluating practical "ability to do" rather than static knowledge retrieval. Its tasks are derived from real expert projects, automatically scored, and designed to prevent cheating through a rotating pool of private challenges. The results suggest that high performance on traditional benchmarks does not necessarily translate to proficiency in complex, open-ended real-world work. The study also notes that agents often fail by prematurely declaring tasks complete without proper verification, and that no single model excels uniformly across all diverse domains.

marsbit06/12 05:01

"Agents' Last Exam", Claude Fable 5 Actually Loses to GPT 5.5

marsbit06/12 05:01

活动图片