Commit Graph

64 Commits

Author SHA1 Message Date
Samee Zahid fbc4c83996 feat(evals): add behavioral evaluations for subagent routing (#23272)
Co-authored-by: Samee Zahid <sameez@google.com>
2026-03-24 01:19:21 +00:00
Sandy Tao fa58e5ae05 eval(save_memory): add multi-turn interactive evals for memoryManager (#23572) 2026-03-23 22:58:55 +00:00
Abhi dd538662c7 feat(skills): add behavioral-evals skill with fixing and promoting guides (#23349) 2026-03-23 21:06:43 +00:00
Abhi 9879ae1e58 fix(core): refine CliHelpAgent description for better delegation (#23310) 2026-03-21 06:24:37 +00:00
Sandy Tao ad98e9c17c fix(evals): remove tool restrictions and add compile-time guards (#23312) 2026-03-21 03:45:33 +00:00
Christian Gunderman 7929516f1a Retry evals on API error. (#23322) 2026-03-21 02:52:19 +00:00
Alisa 06858e6a28 Disabling failing test while investigating (#23311) 2026-03-20 22:52:35 +00:00
ruomeng 7945227bdd feat(plan): support plan mode in non-interactive mode (#22670) 2026-03-18 20:00:26 +00:00
Christian Gunderman 55633ca50b Promote stable tests. (#22253) 2026-03-13 21:32:00 +00:00
Adib234 834055d40a fix(plan): Fix AskUser evals (#22074) 2026-03-13 13:30:19 +00:00
anj-s 3746e32770 Add behavioral evals for tracker (#20069) 2026-03-10 18:51:54 +00:00
Abhi 66cba6d96b feat(core): add concurrency safety guidance for subagent delegation (#17753) (#21278) 2026-03-06 18:09:45 +00:00
Adib234 622648a15a feat(evals): add behavioral evals for ask_user tool (#20620) 2026-03-03 17:51:15 +00:00
Christian Gunderman 27fa2a685d Add some dos and don'ts to behavioral evals README. (#20629) 2026-03-02 23:14:00 +00:00
Christian Gunderman af24040e5d Promote stable tests to CI blocking. (#20581) 2026-02-27 21:08:12 +00:00
Christian Gunderman 94b2cb593e Add slash command for promoting behavioral evals to CI blocking (#20575)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-02-27 19:11:30 +00:00
Christian Gunderman 355bd0bfbc Demote unreliable test. (#20571) 2026-02-27 16:48:46 +00:00
joshualitt 325c8683db feat(core): Enable generalist agent (#19665) 2026-02-26 16:38:49 +00:00
Sandy Tao 4a47d0b349 feat(core): rename grep_search include parameter to include_pattern (#20328) 2026-02-26 04:16:21 +00:00
Christian Gunderman f2091a1ef8 Stabilize tests. (#20095) 2026-02-24 00:01:39 +00:00
Alisa 98f312130c Search updates (#19482)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-02-20 17:54:28 +00:00
joshualitt be97897a39 feat(core): experimental in-progress steering hints (2 of 2) (#19307) 2026-02-18 22:05:50 +00:00
Jerop Kipruto d8656206d3 fix(core): clarify plan mode constraints and exit mechanism (#19438) 2026-02-18 20:09:59 +00:00
christine betts 00384b9ec1 Disable failing eval test (#19455) 2026-02-18 19:27:21 +00:00
N. Taylor Mullen 2005e64258 test(evals): add behavioral tests for tool output masking (#19172) 2026-02-18 05:07:25 +00:00
Christian Gunderman 93faf7cafe Use ranged reads and limited searches and fuzzy editing improvements (#19240) 2026-02-17 23:54:08 +00:00
joshualitt e713e7d288 feat(core): experimental in-progress steering hints (1 of 3) (#19008) 2026-02-17 22:59:33 +00:00
N. Taylor Mullen b74511dead fix(core): Encourage non-interactive flags for scaffolding commands (#18804) 2026-02-15 20:26:59 +00:00
Christian Gunderman 68de8e86ff More grep prompt tweaks (#18846) 2026-02-11 21:55:27 +00:00
Christian Gunderman efde27f3fc Update prompt and grep tool definition to limit context size (#18780) 2026-02-11 19:20:51 +00:00
Jerop Kipruto 794d0aad1b test(evals): mark all save_memory evals as USUALLY_PASSES due to unreliability (#18786) 2026-02-11 02:16:52 +00:00
Abhijit Balaji 278120b4be fix(evals): prevent false positive in hierarchical memory test (#18777) 2026-02-11 01:51:05 +00:00
Christian Gunderman 12f2550226 Fix issue where Gemini CLI creates tests in a new file (#18409) 2026-02-10 20:53:29 +00:00
Keith Guerin 98c008cf90 ui: update & subdue footer colors and animate progress indicator (#18570) 2026-02-10 17:36:20 +00:00
N. Taylor Mullen 2fb8d3831f test(core): remove hardcoded model from TestRig (#18710) 2026-02-10 07:54:23 +00:00
joshualitt 8edc496312 feat(core): Render memory hierarchically in context. (#18350) 2026-02-10 02:01:59 +00:00
N. Taylor Mullen d0e0caa6f8 feat: move shell efficiency guidelines to tool description (#18614) 2026-02-09 18:51:13 +00:00
N. Taylor Mullen d51d4b8488 chore(evals): update validation_fidelity_pre_existing_errors to USUALLY_PASSES (#18617) 2026-02-09 01:31:22 -08:00
N. Taylor Mullen 5a0d643411 fix(evals): update save_memory evals and simplify tool description (#18610) 2026-02-09 01:06:03 -08:00
N. Taylor Mullen e55b07fcc0 chore: strengthen validation guidance in system prompt (#18544) 2026-02-09 05:32:46 +00:00
Sandy Tao 6dc9a62fb9 feat(cli): add WebSocket-based network logging and streaming chunk support (#18383) 2026-02-07 00:20:22 +00:00
Jerop Kipruto 54f4def89d feat(plan): add positive test case and update eval stability policy (#18457) 2026-02-06 19:45:22 +00:00
Jerop Kipruto d01287b640 feat(plan): add behavioral evals for plan mode (#18437) 2026-02-06 16:51:12 +00:00
Alisa 21aa049734 Improving memory tool instructions and eval testing (#18091) 2026-02-05 18:07:47 +00:00
Christian Gunderman 131592d14b Fix issue where agent gets stuck at interactive commands. (#18272) 2026-02-04 07:02:09 +00:00
Christian Gunderman c07d78d16c Encourage agent to utilize ecosystem tools to perform work (#17881) 2026-02-04 02:02:25 +00:00
Coco Sheng 18c9bb1fc8 fix(test): improve test isolation and enable subagent evaluations (#18138) 2026-02-03 19:05:26 +00:00
Christian Gunderman 4d72449dfa Cleanup post delegate_to_agent removal (#17875) 2026-01-29 18:24:35 +00:00
Sandy Tao 4322adb1f3 fix(evals): use absolute path for activity log directory (#17830) 2026-01-28 15:20:21 -08:00
Sandy Tao ca07d33fdc feat(cli): enable activity logging for non-interactive mode and evals (#17703) 2026-01-28 17:02:41 +00:00