v1.4.0

What's Changed

• feat: regression guard, agent card, recommend command, external datasets by @himmi-01 in #18 Like :

Full Changelog: v1.3.0...v1.4.0

v1.3.0

What's Changed

• feat: regression guard, agent card, recommend command, external datasets by @himmi-01 in #14

Full Changelog: v1.2.0...v1.3.0

v1.2.0

What's Changed

• Add voice agents support into EvalMonkey by @himmi-01 in #13

Full Changelog: v1.1.1...v1.2.0

v1.1.1

What's Changed

• feat: add lightweight coding agent sample app with chaos profiles by @himmi-01 in #9
• fix: stop test suite hanging + add coding agent demo script by @himmi-01 in #10
• docs: add real-world benchmark leaderboard for 10 open-source agents by @himmi-01 in #11

Full Changelog: v1.1.0...v1.1.1

v1.1.0

What's Changed

• Add coding agent benchmarks by @himmi-01 in #8

Full Changelog: v1.0.2...v1.1.0

v1.0.2

What's Changed

• docs: add web dashboard screenshots to README by @himmi-01 in #5
• feat: add evalmonkey generate-ci command for easy GitHub Actions setup by @himmi-01 in #6

Full Changelog: v1.0.1...v1.0.2

v1.0.1

What's Changed

• feat: add framework adapters for LangGraph, LlamaIndex, and PydanticAI by @himmi-01 in #4

Full Changelog: v1.0.0...v1.0.1

v1.0.0

What's Changed

• feat: evalmonkey web ui and benchmark stability fixes by @himmi-01 in #3

Full Changelog: v0.1.3...v1.0.0

v0.1.3

implement automated eval asset generation and improvement prompts for failed benchmark traces ea99606
optimize benchmark loading by enabling streaming mode and add testing/inspection utilities 88a8fb5
strip markdown code fences from LLM judge responses 46be866
remove webarena benchmark 179d5ab

v0.1.2

add 5 chaos injection profiles and expand benchmark suite to 20 datasets with updated documentation and tests
add five new server-side chaos profiles and corresponding integration tests to evaluate agent resilience.