learn-ai-agents-with-phoebe / Leader session 1 of 6
Learn AI Agents with Phoebe · Leader track · Session 1 of 6

What an agent actually is

Every vendor deck this year says "agent". Most of them mean something far more ordinary. Tonight you get the one-sentence definition both Anthropic and OpenAI actually use, a filter that separates agents from rebadged chatbots in under a minute, and - most usefully - the cases where you should NOT want an agent at all. You will also watch a real one run in your browser, then watch it lie confidently when a single capability is switched off. No code anywhere in this track: just the judgment.

🟢 Leader track C-level · managers · curious minds No code Start here
0-3 · Welcome 3-18 · The loop behind the hype 18-42 · Watch one run + when not to 42-45 · Q&A
Part 0

How this track works

Six 45-minute sessions that build one leadership skill: judging agent proposals without needing to read code. Tonight you learn to judge what is and is not an agent. a2 gives you the anatomy in plain English. a3 puts your hand on the autonomy dial between workflows and agents. a4 covers risk and governance. a5 scans your org for the right first use cases. a6 is the roadmap: what is coming next and what to ignore. Every session ends with questions you can walk into Monday's meeting and ask.

Live - presented in session Self-study - read after class ▶ Live agent run - step through + toggle levers Official sources covered
★ What you walk out with today A definition of "agent" you can defend in a board meeting (with the official Anthropic and OpenAI wording), a one-question hype filter for any vendor pitch, and a short, honest list of situations where the right answer is "no agent - normal software wins."
Part 1 · covers Anthropic "Building Effective Agents" definitions, OpenAI guide pp.4-7

The loop behind the hype 15 min live

Strip the pitch language away and an agent is a simple, checkable thing: an AI model running in a loop with tools, choosing its own next step until the task is done. The model looks at the goal, decides whether to answer or to use a tool, reads what came back, and repeats - then stops when it hits an exit condition. That is the whole machine. Everything a vendor adds on top is either one of four capabilities you will meet in a2, or decoration.

WHAT THE PITCH SAYS WHAT IT ACTUALLY IS "An autonomous digital employee" hire it and forget it An LLM + tools in a loop software you commission, not staff "It thinks and decides" like a person would It chooses the next step answer now, or call a tool first "Fully autonomous" no supervision needed It loops until an exit done, error, or max turns - then stops Not agents (OpenAI's own exclusion): chatbots and classifiers - the model never controls what happens next. The hype filter: ask what chooses the next step. If your code does, it is a workflow - useful, not an agent.
🔍 Click to zoom - three pitch claims, and what each one really means
LiveThe two definitions that matter5 min▶

You only need two sentences, and they come from the two vendors who defined the field:

  • OpenAI: agents are "systems that independently accomplish tasks on your behalf." The guide is equally clear about what does not count: chatbots and classifiers that do not control workflow execution "are not agents."
  • Anthropic: agents are systems where "LLMs dynamically direct their own processes and tool usage." When your code fixes every step in advance, that is a workflow - a perfectly good thing, just a different thing.

The shared keyword is direct. In an agent, the model chooses the next step. In a workflow, your engineers chose it months ago. Both belong in your portfolio; only one deserves the word "agent" - and the budget, latency, and oversight that word implies.

Self-studyA 60-second history: chatbot → copilot → agent2 min read▶

Three generations, one direction of travel: how much of the process the model controls.

  • Chatbot - one question in, one answer out. The model controls nothing beyond its reply. Excluded from "agent" by OpenAI's definition.
  • Copilot - the model suggests, a human executes every step. Control still sits entirely with the person.
  • Agent - the model chooses steps and uses tools itself, inside limits you set. Control is delegated, which is exactly why a4 spends a whole session on guardrails.

Most products sold as "agents" today sit in the first two generations. That is not a scandal - it is often the right engineering choice - but you should know which one you are buying.

Part 2 · live demo · Daybreak Ops Agent

Watch one actually run ★ 14 min · everyone runs it

This is the Daybreak Ops Agent - the running example for the whole course, built on a small coffee brand's real operations data. The founder asks: "What was March 2026 revenue?" Step through the run below and watch the loop from Part 1 happen in front of you. Then break it, on purpose, with one click.

Press Next and step through with Tools on. Find the moment the model chooses to look the number up instead of answering from memory - that choice is what makes it an agent.

Note the tool result: $150.00, 1 refund excluded. That figure is computed live from Daybreak's embedded data, in your browser, right now.

Now toggle Tools off and step through again. Read the new "answer" carefully: fluent, specific, confidently formatted - and invented end to end.

Say the lesson out loud: the model did not get worse between runs. A capability was missing, and nothing in the polished answer told you.

How to read every agent demo in this course 👤 user · 🧠 model reasoning · 🔧 tool call · 📦 tool result · 🛡 guardrail · 💬 final answer. The model's words are a scripted teaching simulation replaying the characteristic behaviors; every number in a 📦 step is genuinely computed from the embedded Daybreak data.
LiveThe demo-that-lied test4 min▶

What you just reproduced is the single most common way executives get burned by agents: a demo that looks flawless because nobody asked what the system could actually reach.

Real world

The demo that lied. A team demoed an "analytics agent" to their exec - it answered every revenue question instantly, and got a budget. In production someone checked a number against the warehouse: the agent had no database tool wired in and had been improvising figures the whole time. Nobody had asked which capabilities were switched on. From today, you always ask.

The leader's version of the test is one sentence in any demo: "Show me the tool call that produced that number." If there is no tool call to show, you are watching a very confident guess.

Part 3 · covers OpenAI guide when-to-build criteria, inverted

When you should NOT want one 8 min live

OpenAI's own guide is refreshingly blunt: agents cost latency, money, and predictability. It names exactly three situations that justify that price - complex decision-making (judgment calls a rulebook cannot capture), difficult-to-maintain rules (the if/else forest nobody dares touch), and heavy unstructured data (tasks swimming in documents and conversations). Turn that into a leader's checklist: if a proposal cannot claim at least one of the three, the answer is normal software - and saying so is not being behind, it is being right.

A TASK ARRIVES "let's agent this" ASK THE THREE QUESTIONS 1 · Judgment no rulebook captures? 2 · An if/else forest nobody touches? 3 · Swimming in unstructured docs? YES TO ANY consider an agent NO TO ALL normal software wins yes no Agents cost latency, money and predictability (OpenAI). Pay that price only when at least one answer is yes. Deterministic code first: if rules capture the task, normal software is cheaper, testable and boring.
🔍 Click to zoom - the three-question filter before any agent gets funded
LiveThe trade you are making4 min▶

When you approve an agent instead of a workflow, you are trading three things away. Name the trade explicitly in the approval conversation:

  • Cost - the loop calls the model many times per task, not once. Budget per task, not per month.
  • Latency - choosing steps takes turns. Fine for a report, wrong for a checkout page.
  • Predictability - the path is chosen at run time, so two runs can differ. That is the feature and the risk at once.

Anthropic's essay opens with the matching advice: the most successful teams build with simple, composable patterns and add autonomy only when it demonstrably wins. "We could use an agent" is not a reason to.

Self-studyThree proposals, three verdicts3 min read▶

Run the filter on three typical pitches and notice how fast it decides:

  • "Agent to send the weekly sales report" - fixed steps, structured data, no judgment. Verdict: workflow or plain automation. Cheaper, testable, done.
  • "Agent to triage inbound support tickets" - unstructured text, judgment about urgency and routing. Verdict: a real agent candidate, with guardrails from day one.
  • "Agent to approve refunds" - judgment, yes, but also money leaving the building. Verdict: maybe - and only with a human approval gate, which is a4's whole topic.
Homework

Try it yourself - this week ◐ 20-30 min total

Source material

Official sources covered

This track teaches the leadership core of the canonical agent-building sources - Anthropic's and OpenAI's official guidance plus the major vendor courses - in business language, with a live agent to poke on every page. Certificates, videos, and graded assessments stay on the official sites (linked each session). This page covers:

✓Anthropic "Building Effective Agents" - definitionsWorkflows vs agents wording · the patterns get their own session in a3
✓OpenAI "A Practical Guide to Building Agents" - pp. 4-7Agent definition + exclusions · when-to-build criteria, inverted here into the when-NOT-to list
◐DeepLearning.AI "Agentic AI" (Ng) - Module 1Degrees of autonomy · the full autonomy dial is a3's topic
Check yourself

Three questions before you go 🎯 ◐ 90 seconds

1 · A vendor shows you an "AI agent". What single fact makes it an agent rather than a workflow?

Anthropic's line: workflows run "predefined code paths"; agents "dynamically direct their own processes." Model size and tool count are irrelevant - who chooses the next step is everything.

2 · In the demo, the agent quoted a confident March revenue figure that no system ever produced. What was missing?

Invented numbers are the signature of a missing data tool. No amount of model size or prompt polish gives a model access to figures it cannot reach - only a wired tool does.

3 · A team proposes an agent for a task with stable rules and fully structured data. Best call?

OpenAI's three criteria: complex judgment, unmaintainable rules, heavy unstructured data. None present means you would pay agent costs (latency, money, unpredictability) for no benefit.

Leader session 1 cheat sheet · pin this

Agent in one lineAn LLM in a loop with tools, choosing its own next step until the task is done, then stopping at an exit condition.
The two definitionsOpenAI: "systems that independently accomplish tasks on your behalf." Anthropic: "LLMs dynamically direct their own processes and tool usage."
Not an agentChatbots and classifiers - OpenAI's own exclusion. The model never controls what happens next.
The hype filterOne question: "What chooses the next step?" If the answer is their code, it is a workflow - useful, but not an agent.
The demo test"Show me the tool call that produced that number." No tool call = a very confident guess.
When to agentOpenAI's three: complex judgment, difficult-to-maintain rules, heavy unstructured data. At least one, or no deal.
When NOT toStable rules + structured data = normal software. Cheaper, testable, boring - and boring is a feature in production.
The tradeApproving an agent trades away cost, latency and predictability. Name the trade out loud before you sign.