AI & ML interests

None defined yet.

black-ytĀ 
posted an update 3 months ago
view post
Post
4890
Hey all — our ResearchClawBench leaderboard just updated šŸ”„

We let AI do real science: 40 tasks across 10 disciplines, compared to human papers. Hard example? šŸ”ļø Glacier mass change — AI must integrate 233 datasets from 35 teams, 4 methods, reproduce 6542±387 Gt ice loss vs IPCC. No toy problems.

Latest leaderboard (2026-06-09) šŸ“Š:
Agents: šŸ„‡ Claude Code 21.5 (50 = match human), $5.3; 🄈 EvoScientist 18.8, $4.1; šŸ„‰ Codex CLI 18.4, just $2.0
LLMs+Harness: šŸ„‡ Claude-Opus-4.8 21.1, $4.0; 🄈 Claude-Opus-4.7 20.7; šŸ„‰ MiniMax-M3 19.8, only $0.45; Qwen3.7-Max 18.7, $0.42, 11min šŸ’„

Claude still king, but MiniMax/Qwen/DeepSeek are crazy cheap and competitive. Expensive isn't always better.

šŸ“Ž Code & star: https://github.com/InternScience/ResearchClawBench
šŸ  Website: https://internscience.github.io/ResearchClawBench-Home/
šŸ¤— Upvote paper: ResearchClawBench: A Benchmark for End-to-End Autonomous Scientific Research (2606.07591)
  • 2 replies
Ā·