Add "tests" Copilot skill with test discovery and source-to-test mapping#11014
Open
simonrozsival wants to merge 5 commits intomainfrom
Open
Add "tests" Copilot skill with test discovery and source-to-test mapping#11014simonrozsival wants to merge 5 commits intomainfrom
simonrozsival wants to merge 5 commits intomainfrom
Conversation
…uild The skill previously told Copilot to silently skip tests when the local SDK was not built, without asking the user. This caused confusion because users expected all tests to run. Changes: - Split tests into Tier 1 (standalone, plain dotnet test on .csproj) and Tier 2 (requires local SDK via dotnet-local.sh) - Tier 1 tests run immediately without any build prerequisites - When Tier 2 tests are requested but SDK is missing, the skill now instructs Copilot to use ask_user to let the user choose YES (full build) or NO (skip Tier 2) - Added 15 standalone test projects to the test catalog with their dotnet test commands - Added tier labels to all test catalog sections Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
- Add ability to recommend tests for code changes (source-to-test mapping) - Add test discovery/listing workflow - Rename Tier 1/Tier 2 to Standalone/Full-build for clarity - Add source path to test suite mapping table Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
simonrozsival
added
the
copilot
- Rename skill from 'run-tests' to 'tests' for broader scope - Reduce SKILL.md from 304 to 87 lines following Copilot skill best practices - Trust Claude's existing knowledge; only document repo-specific details - Move source-to-test mapping into compact table - Keep test-catalog.md as detailed reference (progressive disclosure) Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
simonrozsival
requested review from
grendello and
jonathanpeppers
as code owners
Contributor
There was a problem hiding this comment.
Pull request overview
Adds a new GitHub Copilot skill intended to help contributors run, discover, and select appropriate tests in the dotnet/android repo by documenting test tiers, commands, and a source-to-test mapping.
Changes:
- Introduces a new
testsskill definition describing workflows for running, discovering, and recommending tests. - Adds a test catalog reference document mapping test areas to projects/assemblies, filters, prerequisites, and device requirements.
- Documents “Standalone” vs “Full-build” test tiers and provides command examples for common suites.
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 5 comments.
| File | Description |
|---|---|
.github/skills/tests/SKILL.md |
Defines the Copilot skill behavior, tier definitions, and source-to-test mapping. |
.github/skills/tests/references/test-catalog.md |
Provides the detailed catalog of test suites, commands, and prerequisites used by the skill. |
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
simonrozsival
changed the title
Member
Author
|
Addressing review comments:
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds a Copilot skill for running, discovering, and recommending tests in the dotnet/android repository.
Key features:
Files changed:
.github/skills/run-tests/SKILL.md— skill definition with workflows.github/skills/run-tests/references/test-catalog.md— test area catalog