Today's task
When an agent gives a poor answer, people usually rewrite the question until it works. A better habit is to ask which lever is broken. Today you'll take the agent from Build your first agent in Copilot Studio and deliberately break each lever in turn, so you can recognize the symptoms.
You'll need: access to Copilot Studio and the agent you built earlier (or any test agent). Use a test agent, not one real customers use.
Heads-up: Copilot Studio offers more than one authoring experience. These steps follow the standard one, which Microsoft's quickstart reaches by turning off New experience on the Home page. If your screens look different, look for the same settings by name.
Steps
- Learn the three levers.
- Prompt: what the user types in the moment.
- Instructions: standing guidance the agent follows in every conversation. In Copilot Studio you edit these on the agent's Overview page.
- Knowledge: the content the agent draws facts from. You manage it in the Knowledge section.
- Baseline. In the test chat, ask a question your knowledge clearly answers. Note the answer and the citation.
- Change only the prompt. Ask the same thing vaguely, such as "What about your hours?". A vague prompt gets a vague answer. This is the fix users can make themselves, so guide them with a clear introductory message. For agents used in Teams or Microsoft 365, you can also add suggested prompts on the Overview page (they don't show in the test chat).
- Change only the instructions. On the Overview page, add a rule such as "Answer in two sentences." Ask the baseline question again. The tone and format change, but the facts don't. That's what instructions do.
- Change only the knowledge. Note which sources the agent has, then remove one, or point to a page that's out of date, and ask again. Now the agent either can't answer or answers with old facts. No instruction can supply a fact the agent doesn't have.
- Restore everything and write a one-line rule for yourself, such as: wrong tone or format means instructions; wrong or missing facts means knowledge; confusing question means prompt.
What to notice
- Instructions shape behavior; knowledge supplies facts. Trying to paste facts into instructions makes them long and hard to maintain.
- Test one change at a time. If you change two levers at once, you won't know which one worked.
- Citations help you diagnose. Open the cited source to tell a knowledge problem from an instruction problem.
Governance tip: Instructions are a policy document for your agent. Record who last edited them and why, keep a copy outside the tool, and re-test the agent after every change.