From ca7943c7be12b3c7e851e126e18483461a262858 Mon Sep 17 00:00:00 2001 From: Zidong Lu Date: Tue, 19 May 2026 11:31:33 +0800 Subject: [PATCH 1/6] Add endgame skill and smoke-test probe Convert .github/prompts/endgame.prompt.md into a reusable skill at .github/skills/endgame/SKILL.md: - 4-step workflow: ask for inputs, fetch issue, delegate to subagents, summarise - Subagent template writes test plans to test-plans//.md following the project format (test-plans/thinking-persistence/ as reference) - Removed manage_todo_list dependency Add probe script endgame-chat-open-001.json: smoke-tests that the Copilot Chat view opens, model picker resolves, and chat input is ready. All 14 steps pass. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> --- .github/skills/endgame/SKILL.md | 173 ++++++++++++++++++ .../probe-scripts/endgame-chat-open-001.json | 31 ++++ 2 files changed, 204 insertions(+) create mode 100644 .github/skills/endgame/SKILL.md create mode 100644 com.microsoft.copilot.eclipse.swtbot.test/probe-scripts/endgame-chat-open-001.json diff --git a/.github/skills/endgame/SKILL.md b/.github/skills/endgame/SKILL.md new file mode 100644 index 00000000..30fb2d97 --- /dev/null +++ b/.github/skills/endgame/SKILL.md @@ -0,0 +1,173 @@ +--- +name: endgame +description: Orchestrate endgame verification for a GitHub milestone issue. Fetches the issue, parses assigned tasks, delegates each task to a subagent that researches the linked PR/issue and writes a test plan, and saves every plan to test-plans/ following the project's standard test-plan format. +--- + +# Endgame Verification Skill + +Use this skill to run an endgame verification pass for a GitHub milestone issue. +Each task in the issue is delegated to a subagent that researches the linked +PR/issue and writes a test plan under `test-plans/`. + +## Workflow + +**⚠️ CRITICAL — YOU MUST FOLLOW THESE RULES:** + +1. **Do NOT run `gh pr view` or `gh issue view` for individual tasks** — only + run it once for the main endgame issue. +2. **Do NOT research or analyse any task yourself.** +3. **Do NOT create any test-plan files yourself.** +4. **IMMEDIATELY call `runSubagent` for each task** after parsing the issue — + no delays, no research. + +--- + +### Step 1 — Ask the user for inputs + +Ask for: +- The GitHub endgame issue URL + (e.g. `https://github.com/microsoft/copilot-for-eclipse/issues/XXXX`) +- The user's GitHub account name + +--- + +### Step 2 — Fetch the endgame issue (ONE call only) + +```shell +gh issue view --repo microsoft/copilot-for-eclipse +``` + +Parse the body to find **all tasks (checkboxes) assigned to the specified +user**. Extract each task's title and any linked PR/issue URL as plain text. + +**STOP — do NOT fetch any of the linked PRs or issues.** + +--- + +### Step 3 — Process each task via subagent + +For each task, call `runSubagent` with: +- **description**: `"Endgame: "` +- **prompt**: the template below, filled in with only the info you extracted. + +#### Subagent prompt template + +--- +## Task Details +- Task Number: \ +- Task Title: \ +- Assignee: \ +- Related Issue/PR: \ (NOT YET FETCHED — you must fetch this) + +## Your Mission + +YOU (the subagent) must research this task AND create the test-plan file. + +### Step 1: Research the task + +- Fetch the linked PR or issue with `gh pr view` / `gh issue view`. +- Understand what feature or fix needs to be verified. +- **If anything is ambiguous or unclear after reading the PR/issue, ask the + user for clarification before proceeding. Keep asking until you have enough + information to write concrete, accurate test steps.** + +### Step 2: Create the test-plan file + +Determine a short `` (lowercase, hyphens, no special chars) +derived from the task title (e.g. `chat-history-restore`). + +Create the directory and file: + +``` +test-plans//.md +``` + +Use **exactly** this format, matching the project's existing test plans +(see `test-plans/thinking-persistence/thinking-persistence.md` for a live +example): + +```markdown +# + +## Overview +<1–3 sentences: what is being verified and why it matters.> + +--- + +## Test Cases + +### TC-001: + +**Type:** `Happy Path` +**Priority:** `P0` + +#### Preconditions +- + +#### Steps +1. +2. +3. + +#### Expected Result +- + +#### 📸 Key Screenshots +- [ ] **