Repository navigation
docs(skills): slim sdk-integrations and sdk-vcr-workflows, fix dead spec link - #1110
Merged
Abhijeet Prasad (AbhiPrasad) merged 1 commit intoNov 12, 2026
Merged
Conversation
…pec link Datasets: skill-health-sdk-integrations, skill-health-sdk-vcr-workflows (BT Staging) Expect: sdk-integrations full-read share 31% -> >=80%; sessions fetching docs/instrumentation-guide.md 26/42 -> 0; "combine redundant tests" follow-ups 26/42 -> <=20% of sessions. sdk-vcr-workflows full-read share 25% -> >=80%.
Codex Review Summary: ✅ CompletedThis comment shows the latest Codex review activity on this pull request.
ℹ️ About Codex in GitHubYour team has set up Codex to review pull requests in this repo. Reviews are triggered when you
Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings. |
Abhijeet Prasad (AbhiPrasad)
deleted the
abhi/run-skill-health-check-b2f390ad
branch
November 12, 2026 20:09
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Ran the
skill-healthskill against 30 days of coding-agent traces for this repo (2026-10-13 to 2026-11-12, 164 sessions). Two skills stood out. Agents often never saw their full text, andsdk-integrationshad a broken spec link.sdk-integrations(23.3 KB → 11.1 KB)## Specpointed tobraintrust-spec/docs/instrumentation-guide.md, which returns 404 (it moved toskills/instrumentation-spec/in July). 26 of 42 sessions tried the dead URL; only 13 found the new location. The link now goes toskills/instrumentation-spec/SKILL.md, with agh apicommand that fetches the guide.SKILL.mdwith other files in one command, and that output is cut off at about 10k tokens. Span design, metrics, attachments, span origin and the streaming-lifecycle review moved intoreferences/, each linked with a note on when to open it. The rules were moved, not deleted.make check-unused-cassettes, and report the test count before and after.sdk-wrapper-migrations, which isn't in this repo.sdk-vcr-workflows(21.0 KB → 6.4 KB)references/. The "Repo Rules" section, which repeatedAGENTS.md, is gone.wrappers/claude_agent_sdk/path and thesdk-wrapper-migrationsreference.Both skills plus
AGENTS.mdnow come to about 7.5k tokens, which should fit in a single batched read.Expected impact
Failure cases are in the
skill-health-sdk-integrations(52 rows) andskill-health-sdk-vcr-workflows(12 rows) datasets inbt-coding-agent-insights. Targets:sdk-integrations: full-read share 31% → ≥80%. Fetches ofdocs/instrumentation-guide.md26/42 sessions → 0. Test-consolidation follow-ups 26/42 → ≤20% of sessions.sdk-vcr-workflows: full-read share 25% → ≥80%.Re-check once each skill has about 10 sessions on the new version.
Test plan
references/link resolves