Commit Graph

18 Commits

Author SHA1 Message Date
Christian Gunderman d7f6d21c10 Generalize evals infra to support more types of evals, organization and queuing of named suites (#24941) 2026-04-08 23:57:26 +00:00
Abhi 6a551f7e9c test(evals): add comprehensive subagent delegation evaluations (#24132) 2026-03-29 23:13:50 +00:00
Alisa aa178f547c feat(evals): add reliability harvester and 500/503 retry support (#23626) 2026-03-26 01:48:45 +00:00
Sandy Tao fa58e5ae05 eval(save_memory): add multi-turn interactive evals for memoryManager (#23572) 2026-03-23 22:58:55 +00:00
Sandy Tao ad98e9c17c fix(evals): remove tool restrictions and add compile-time guards (#23312) 2026-03-21 03:45:33 +00:00
Abhi 66cba6d96b feat(core): add concurrency safety guidance for subagent delegation (#17753) (#21278) 2026-03-06 18:09:45 +00:00
joshualitt e713e7d288 feat(core): experimental in-progress steering hints (1 of 3) (#19008) 2026-02-17 22:59:33 +00:00
N. Taylor Mullen e55b07fcc0 chore: strengthen validation guidance in system prompt (#18544) 2026-02-09 05:32:46 +00:00
Sandy Tao 6dc9a62fb9 feat(cli): add WebSocket-based network logging and streaming chunk support (#18383) 2026-02-07 00:20:22 +00:00
Christian Gunderman 131592d14b Fix issue where agent gets stuck at interactive commands. (#18272) 2026-02-04 07:02:09 +00:00
Coco Sheng 18c9bb1fc8 fix(test): improve test isolation and enable subagent evaluations (#18138) 2026-02-03 19:05:26 +00:00
Sandy Tao 4322adb1f3 fix(evals): use absolute path for activity log directory (#17830) 2026-01-28 15:20:21 -08:00
Sandy Tao ca07d33fdc feat(cli): enable activity logging for non-interactive mode and evals (#17703) 2026-01-28 17:02:41 +00:00
Jerop Kipruto 54e03635d9 feat(plan): refactor TestRig and eval helper to support configurable approval modes (#17171) 2026-01-21 15:43:48 +00:00
Christian Gunderman b4a786e42f Stabilize the git evals (#16989) 2026-01-19 06:18:06 +00:00
Christian Gunderman 9c3f0fce0b Steer outer agent to use expert subagents when present (#16763) 2026-01-16 16:51:10 +00:00
Christian Gunderman f60b442d39 Aggregate test results. (#16581) 2026-01-14 07:08:05 +00:00
Christian Gunderman b82c66b2d8 Behavioral evals framework. (#16047) 2026-01-14 04:49:17 +00:00