Artículos Relacionados con Superintelligence

El Centro de Noticias de HTX ofrece los artículos más recientes y un análisis profundo sobre "Superintelligence", cubriendo tendencias del mercado, actualizaciones de proyectos, desarrollos tecnológicos y políticas regulatorias en la industria de cripto.

Recursive Self-Improvement AI Gains Traction, Google Pours Cold Water, While DeepSeek and Others Approach the Fringes

The term "recursive self-improvement" (RSI), where AI improves itself autonomously, is gaining momentum in the AI industry. Startups like Recursive Superintelligence and projects such as Andrej Karpathy's Auto-Research aim to create systems where AI designs, implements, and validates its own research, moving toward superintelligence. While Google CEO Sundar Pichai cautions that such exponential acceleration is not yet a reality, progress is evident. For instance, Anthropic reported its Claude Code writes nearly 100% of the team's code, though it still lacks true self-direction. Analysts frame RSI development in stages: "adequacy" (systems functioning without humans), "parity" (matching human research quality), and "supremacy" (exceeding human-AI collaboration). Reaching parity could trigger rapid, unpredictable advancement due to AI's continuous operation. In China, companies like DeepSeek and Baidu incorporate self-optimization techniques without explicitly branding them as RSI, focusing on algorithmic efficiency and reinforcement learning. However, challenges remain, including "model collapse" from training on AI-generated data and the immense computational and open-collaboration requirements. Ultimately, RSI represents a trend of increasing automation in AI development, potentially reducing human oversight in the creation process itself.

marsbitHace 13 hora(s)

Recursive Self-Improvement AI Gains Traction, Google Pours Cold Water, While DeepSeek and Others Approach the Fringes

marsbitHace 13 hora(s)

Can Humans Control AI? Anthropic Conducted an Experiment Using Qwen

Can Humans Control Superintelligent AI? Anthropic’s Experiment with Qwen Models Anthropic conducted an experiment to explore whether humans can supervise AI systems smarter than themselves—a core challenge in AI safety known as scalable oversight. The study simulated a “weak human overseer” using a small model (Qwen1.5-0.5B-Chat) and a “strong AI” using a more powerful model (Qwen3-4B-Base). The goal was to see if the strong model could learn effectively despite imperfect supervision. The key metric was Performance Gap Recovered (PGR). A PGR of 1 means the strong model reached its full potential, while 0 means it was limited by the weak supervisor. Initially, human researchers achieved a PGR of 0.23 after a week of work. Then, nine AI agents (Automated Alignment Researchers, or AARs) based on Claude Opus took over. In five days, they improved PGR to 0.97 through iterative experimentation—proposing ideas, coding, training, and analyzing results. The findings suggest that, in well-defined and automatically scorable tasks, AI can help overcome the supervision gap. However, the methods didn’t generalize perfectly to unseen tasks, and applying them to a production model like Claude Sonnet didn’t yield significant improvements. The study highlights that while AI can automate parts of alignment research, human oversight remains essential to prevent “gaming” of evaluation systems and to handle more complex, real-world problems. Anthropic chose Qwen models for their open-source nature, performance, scalability, and reproducibility—key for rigorous and repeatable experiments. The research demonstrates progress toward automated alignment tools but also underscores that AI supervision remains a nuanced, human-AI collaborative effort.

marsbit04/15 09:28

Can Humans Control AI? Anthropic Conducted an Experiment Using Qwen

marsbit04/15 09:28

活动图片

Technology Trends

Bitcoin