mirror of
https://github.com/google-gemini/gemini-cli.git
synced 2026-05-15 22:33:05 -07:00
294fd9b75a
This PR implements the "Triage Accuracy (Overrides)" metric as requested in #26660 (Option 1). ## Changes - Created `tools/gemini-cli-bot/metrics/scripts/triage_accuracy.ts`. - The script uses GraphQL to analyze the last 100 issues. - It detects the first `area/*` label added by a bot (`gemini-cli-robot` or any `*[bot]`). - It flags an "override" if a human later removes that label or replaces it with a different `area/*` label. ## Expected Impact This metric provides a feedback loop for our automated triage system, allowing us to measure how often maintainers need to correct the bot's classification. This will help in fine-tuning the triage prompts and logic. ## Metrics Added - `triage_accuracy_overrides`: Total number of human overrides in the sample. - `triage_accuracy_total_bot_labeled`: Total number of issues labeled by the bot in the sample. - `triage_accuracy_rate`: The ratio of correct (non-overridden) triage actions.