evaluation · 46 topics

openai releases mentalhealthbench

tencent iwc bench web apps

artificial analysis capability indices v1 1

artificial analysis intelligence index v4 2

benchmirt llm benchmarks

epochs ebr bench reveals humans learn while frontier ai stays stuck

google deepmind gemini flash lite double blind evaluation

piloting double blind ai evaluations

aletheia quest retrospective

how much memory does your agent actually need

sarvam ai indic diarbench

why 99 percent accurate agents fail long horizon tasks

tutormoments

tutormoments

artificial analysis endpoint accuracy index

epoch mirrorcode claude fable 5

how to evaluate a new ai model without starting from scratch

ai2 olmo eval workbench

a shared playbook for trustworthy third party evaluations

ai eval compute bottleneck

2026 04 27 papers 2604 22119

bias audits detect bias but disagree on ranking

task and session level model routing

cost aware evaluation of long term memory in tool using llm agents

evaldetectbench benchmark evaluation awareness

how fast do agents rot

fm bench

sub billion entity tracking

rubricforge agent evaluation

llm reasoning reliability reproduction

how to dogfood your ai chat agent

the judge knows when it knows

sharding prevents llm oversight failures

holocount holistic visual counting benchmark mllms

what current ai benchmarks leave unmeasured

agentstream self evolving llm agents streaming

do models fake alignment without clear consequences

codifying the judge

eta given delta

arxiv 2501 12948

evaluate skill equipped agents with strands evals and amazon bedrock agentcore

agent evaluation metric for multi turn conversations

evaluate any agent framework with amazon bedrock agentcore evaluations

how to evaluate llms before production

artificial analysis optima

disagreement among frontier llms on real world fact checks