feat(optimization): implement manifest-driven extraction pipeline

- Implement `extract.ts` with robust character-aware parsing for snippets and tools.
- Consolidate research dependencies by moving `@ax-llm/ax` to root `optionalDependencies`.
- Relocate evaluation logic from `packages/core` to `scripts/optimization/lib/evals` to keep the production core lean.
- Add `optimization_targets` to `data/manifest.json` as the single source of truth for the pipeline.
- Implement comprehensive unit tests for extraction and variable masking with 100% pass rate.
- Update global config and linting rules to support the new optimization infrastructure.
This commit is contained in:
Abhijit Balaji
2026-03-04 14:25:17 -08:00
parent 6c94c4d9ca
commit 59d377e5e0
20 changed files with 599 additions and 143 deletions
+8
View File
@@ -66,6 +66,14 @@
},
"file_descriptions": {
"data/tool_alignment.jsonl": "Ensures the model selects the correct built-in tool over generic shell commands and optimizes for brevity."
},
"optimization_targets": {
"snippets": [
"renderCoreMandates",
"renderPrimaryWorkflows",
"renderOperationalGuidelines",
"renderGitRepo"
]
}
}
}