claude plugin eval scores realistic prompts with 6 grader types; 4 are free, llm and baseline bill a judge model. Every case ...
ByteDance Seed, SUTD, Georgia Tech, M-A-P, and TokenWave.AI introduce HarnessDev, a benchmark that scores the runnable harness a model builds rather than the answer it returns. Starting from a seed ...
ByteDance Seed, SUTD, Georgia Tech, M-A-P, and TokenWave.AI introduce HarnessDev, a benchmark that scores the runnable harness a model builds rather than the answer it returns. Starting from a seed ...
OpenAI has released the Agents API in public beta. It gives developers the same harness and infrastructure that run Codex. OpenAI hosts and maintains the harness. Developers run the agent’s compute in ...
Long-horizon agents have turned LLM serving into an input-heavy workload. Repeated prefills and million-token contexts leave KV caches that strain HBM, SSD capacity, and bandwidth. DeepSeek AI built ...
Meta FAIR's AI Research Preference Models rank unexecuted ML candidates, raising AIRS-Bench from 0.684 to 0.729 without ...
The hard part of running an open-weights model locally was never the model. It was everything before it, reading VRAM specs, guessing which quantization fits, setting context length and GPU layer ...
Multi-agent workflows have changed the shape of local inference. A lead agent decomposes a task and spawns subagents. What looked like one user request becomes dozens of independent model calls.
AI weather models have spent three years closing the gap with physics-based forecasting, but two problems stayed open: resolution too coarse for local terrain, and initialization tied to numerical ...
Anthropic has released Claude Fable 5.1 and Claude Mythos 5.1, three months after the Fable 5 line shipped in June 2026. The two are the same underlying model behind different safeguard layers. Fable ...
Princeton, Ant Group and Stanford built AQuA, two self-improving quant research agents whose sealed sandbox makes data leakage unwritable ...
Keenable AI open-sources NEEDLE, a live benchmark that rebuilds search queries hourly and scores 15 APIs for agents.
Some results have been hidden because they may be inaccessible to you
Show inaccessible results