Skip to content

Pull requests: benchflow-ai/awesome-evals

New pull request New
26 Open 60 Closed
26 Open 60 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add Practical Lessons for GenAI Evals with Chip Huyen and Vivienne Zhang
#97 opened Sep 9, 2026 by conorbronsdon Loading…
Add OrcaReplay to 5f — record/replay below the harness
#96 opened Sep 8, 2026 by xizhuomengcontin Loading…
Add LLM Benchmark Costco for benchmark discovery and protocol inspection
#95 opened Sep 7, 2026 by joe1chief Loading…
Add Bifrost to observability and eval platforms
#94 opened Sep 4, 2026 by Swpn0neel Loading…
Add public benchmarks and leaderboards
#93 opened Sep 4, 2026 by crypblizz8 Loading…
Add YYLO Benchmark to 5a · Eval frameworks & harnesses
#92 opened Sep 4, 2026 by InsightFactoryAPP Loading…
Add annotated summary for Evals Are Not Unit Tests
#91 opened Sep 3, 2026 by strickvl Loading…
1
Add Agent Amusement Park trajectory benchmark
#89 opened Sep 1, 2026 by axay-oxo Loading…
Add the 44%-vs-85% cross-agent harness audit to §3, with deep note
#88 opened Aug 28, 2026 by uipreliga Contributor Loading…
Add Mendmark mutation-testing benchmark
#87 opened Aug 21, 2026 by danielgaskins Loading…
Swap scan/responder model to claude-opus-4-6
#86 opened Aug 20, 2026 by xdotli Member Loading…
Frontier-evals sweep: Petri, Opus 4.6 interpretability audit, NLA, CoT-monitorability, Deployment Safety Hub, EVMbench
#85 opened Aug 20, 2026 by xdotli Member Loading…
Add CHANGELOG.md + biweekly changelog-rollup workflow
#84 opened Aug 20, 2026 by xdotli Member Loading…
Add CrossSource to 5c · RAG / retrieval evaluation
#83 opened Aug 20, 2026 by zoeb-nomi Loading…
Add Proofline to agent-specific evaluation
#82 opened Aug 18, 2026 by ceodaradigu Loading…
Add AgentRunProof to eval frameworks and harnesses
#81 opened Aug 16, 2026 by FU-max-boop Loading…
5a: add Gauntlet — merge-blocking eval gates for a deployed feature
#80 opened Aug 16, 2026 by ChelseaKR Loading…
Add MCP Lens Schema Audit to agent-specific evaluation
#79 opened Aug 15, 2026 by labmimors Loading…
Add RepoTrials to eval frameworks and harnesses
#78 opened Aug 15, 2026 by PozziTiv4ik Loading…
1
Add Precise Records on agent telemetry validity
#72 opened Aug 2, 2026 by roli-lpci Loading…
1
Add ImageBench V1 to Section 6 (Benchmark vs. eval / integrity)
#71 opened Aug 1, 2026 by dh7 Loading…
Add Keygate capability-speed-price frontier report to §6
#70 opened Jul 31, 2026 by kygate-ai Loading…
Add ClawBench to agent benchmark resources
#64 opened Jul 29, 2026 by reacher-z Contributor Loading…
3
Add StructEval benchmark
#57 opened Jul 27, 2026 by reacher-z Contributor Loading…
2
Add greenproof to §8 (verifiers)
#50 opened Jul 21, 2026 by zxyasfas Loading…
3
ProTip! Type g i on any issue or pull request to go back to the issue listing page.