cocosheng-g
fe50e580fa
fix(ci): isolate workflow evals, revert unrelated changes, and fix aggregation
2026-02-03 23:04:50 -05:00
cocosheng-g
ff4e816a70
refactor(evals): isolate workflow evals and target specific models
2026-02-03 21:02:55 -05:00
cocosheng-g
5c2f477adf
feat(evals): add comprehensive workflow evaluations and tune prompts (Issue #219 )
...
- Established evals for all agent workflows (triage, dedup, refresh).
- Refactored all evals to use modern --output-format=json flag for robust validation.
- Tuned prompts for strict JSON compliance and corrected spam handling in scheduled triage.
- Expanded edge case coverage for false positives, security leaks, and mixed batches.
2026-02-03 19:31:56 -05:00
Coco Sheng
3183e4137a
fix(test): improve test isolation and enable subagent evaluations ( #18138 )
2026-02-03 19:05:26 +00:00
Sandy Tao
0b169e9867
fix(evals): use absolute path for activity log directory ( #17830 )
2026-01-28 15:20:21 -08:00
Sandy Tao
9e09db1ddb
feat(cli): enable activity logging for non-interactive mode and evals ( #17703 )
2026-01-28 17:02:41 +00:00
Jerop Kipruto
c21c297133
feat(plan): refactor TestRig and eval helper to support configurable approval modes ( #17171 )
2026-01-21 15:43:48 +00:00
Christian Gunderman
203f5209ba
Stabilize the git evals ( #16989 )
2026-01-19 06:18:06 +00:00
Christian Gunderman
a15978593a
Steer outer agent to use expert subagents when present ( #16763 )
2026-01-16 16:51:10 +00:00
Christian Gunderman
66e7b479ae
Aggregate test results. ( #16581 )
2026-01-14 07:08:05 +00:00
Christian Gunderman
8030404b08
Behavioral evals framework. ( #16047 )
2026-01-14 04:49:17 +00:00
