Module 5 · Lesson 6 of 6 · Emerging

A person approves the risky steps

Ask before acting

Tools that change things wait for a person's yes, and that rule lives in code, not in the prompt.

Scene 1 of 4 · Safe steps run alone

Searching and checking tables change nothing, so the agent runs those tools on its own.

Agent + your codeAgent + your codeYouYouBooking systemBooking system
  • Agent + your code — healthy
  • You — healthy
  • Booking system — healthy
Tool rules, set in code
ToolCheck
search_restaurants (highlighted) Runs alone
check_table (highlighted) Runs alone
book_table Needs approval
send_email Needs approval
  1. Safe steps run alone. Searching and checking tables change nothing, so the agent runs those tools on its own.
  2. A risky step. Booking is hard to undo, so book_table is marked "needs approval" in code.
  3. Show it exactly. The agent shows the exact booking, with place, day, time and size, then waits for you.
  4. Only a yes runs it. Your yes is checked in code, and only then may the booking tool run.
  5. Now you try. The agent asks: book Rosa's, Friday, 7 pm, 4? Pick your answer. For example: Not booked: the agent stops and asks what to change. Anything but a clear yes leaves the hard-to-undo step undone.

Scene 1 of 4: Safe steps run alone. Searching and checking tables change nothing, so the agent runs those tools on its own.

Key points

  1. Reading tools can run alone; changing tools cannot.
  2. Each tool is marked in code as safe alone or needing approval.
  3. The agent shows exactly what it will do, then waits.
  4. Anything but a clear yes leaves the risky step undone.

Some actions are hard to undo, such as paying, booking or sending a message. For these, the should ask a person first.

The agent shows exactly what it is about to do, and waits. If the person says no, it stops or asks what to change.

Agents are still a young area, so start with narrow tasks, small sets of tools and approval for anything that matters.

Example. Before booking, the agent asks: "Book Rosa's, Friday at 7 pm, table for 4?" Only a yes lets the booking tool run.

In system design: Mark each tool as safe to run alone or as needing approval, and enforce that in code, not in the .

Check yourself

Where should the rule that payments need a person's approval live?