learn-ai-digital-human-with-phoebe / Session 3 of 6
Learn AI Digital Human with Phoebe · Session 3 of 6

Making one that works

This is the hands-on session, and the finding at the centre of it is not what most people expect. A synthetic presenter reads as synthetic because of its timing, not because of its face. Tonight you take the same avatar from 24 percent believable to 84 with four production choices, none of which involve a better model, and then you find the ceiling those four choices cannot get past.

🟡 Hands on Anyone who will actually make one And anyone signing off on the footage budget 45 min
0-3 · Welcome 3-18 · The four levers, and what the eye checks 18-38 · Build-along: drive the viseme track 38-45 · Where craft stops · Q&A
Part 0

The craft question, asked properly

Session 1 gave you two axes: how convincing the thing is, and whether the trust in it survives being found out. Tonight you earn the first axis in full. Session 4 takes the second one, and it will not be moved by anything you learn here.

🎫 Clear all three quiz questions to stamp your passport Live = presented in the 45 minutes Self-study = the full depth, after class

★ What you walk out with tonight. Four production levers you can name and defend, in the order of how much each one buys you. A working understanding of why timing rather than pixel quality is what breaks the illusion. The exact footage each vendor demands before you book a studio hour. And a clear-eyed sense of where the craft axis runs out.

LiveWhy the face is not the problem3 min▶

Show somebody a still frame of a modern synthetic presenter and they will usually accept it. Show them eight seconds of the same presenter talking and a good proportion will say something is off, without being able to say what. That gap between the still and the motion is the entire craft problem, and it is a timing problem.

The viewer's eye is not running a resolution check. It is running a small set of expectation checks about how a speaking human behaves in time: does the mouth arrive with the sound, does the delivery breathe where a thought ends, does this body do anything at all while it talks, do these eyes ever close. Fail any of those and the verdict lands before the viewer has a word for it.

Which is why the honest advice on budget is unpopular. Higher resolution is the easiest thing to buy and the least of these four things.

Real world

Synthesia's own documentation gives the mechanism away in one line about photo-derived avatars: "For best lip-sync results, choose a photo where your teeth are visible." The system is estimating mouth shapes rather than observing them. Everything in this session follows from that being true.

Self-studyWhat this session is not going to teach you2 min▶

It is not a click-path tutorial for any one product. Those go stale in months, the vendors publish their own, and two of the three products in this course were renamed in the last year.

It is also not a promise that craft is enough. This is the session where you get good at making one. Session 4 is where you find out what the evidence says about whether that helps you, and the answer is more uncomfortable than "yes".

Roughly 80 percent of what the vendor documentation teaches about capture and production is covered here. Certification and product training stay with the vendors, and Synthesia Academy is the only one of the three with a real certificate behind it.

Part 1 · covers the four craft levers

Four levers, 24 to 84, and not one of them is resolution

8 min live

These are the four the playground below exposes, and they are the four that a real production actually controls. Each one is a decision somebody makes, or fails to make, before the render starts.

Believability, exactly as the playground computes it base 24 +18 +16 +14 +12 24 with every lever off 84 with all four on 100 Pause at punctuation +18 pts the eye is checking whether the delivery has thought behind it Match mouth to syllables +16 pts the eye is checking whether the mouth belongs to the words Blink on a human cadence +14 pts the eye is checking that the face is alive at all Let the head move a little +12 pts the eye is checking for a stillness no living body holds
🔍 Click to zoom - four production decisions, in order of how much each one buys
LiveLever one: pause where the punctuation is3 min▶

Worth 18 points, the largest single contribution, and the one people most often skip because it looks like a script problem rather than a production problem.

What the viewer's eye is checking. Human speech is not evenly spaced. A comma is a small held breath, a full stop is a bigger one, and both of them are where the listener is given a moment to catch up. When those pauses are absent the delivery runs flat, and flat delivery is the fastest route to the uncanny feeling there is. The viewer reads it as a person who is not thinking about what they are saying, which is precisely what is happening.

What you actually do about it. Punctuate the script for delivery rather than for grammar. Put the comma where you would take the breath. Every one of the three vendors honours punctuation in its timing, so the script is your prosody control surface whether or not you think of it that way.

The related finding worth carrying into every script review. Mayer's multimedia research puts the personalization principle, meaning a conversational rather than formal script register, at a median effect of d = 1.11. Adding the speaker's image on screen sits at d = 0.22, described as small to negligible. The way the script is written matters roughly five times more than whether there is a face on screen at all. That is a budget argument, not just a craft one.

LiveLever two: match the mouth to the actual syllables3 min▶

Worth 16 points. This is the one people think of as "lip sync", and it is the one that degrades most invisibly.

What the viewer's eye is checking. Whether this mouth belongs to these words. Not frame by frame, which nobody can do, but as an accumulating sense of drift. A generic mouth loop looks fine for a second and a half and then it is a syllable behind, and the viewer's verdict arrives around the point where a hard consonant lands on an open mouth shape.

What you actually do about it. Use the product that derives its mouth shapes from your specific audio rather than from a canned animation, and then respect the framing constraint the vendor publishes.

★ Synthesia's own constraint, and it is a production instruction "Lip sync performs best when the avatar is framed closer in the scene."

Read that as a shot-list rule. If your storyboard has the presenter in a wide corporate lobby shot, you have chosen the framing that most exposes the weakest part of the system.

LiveLevers three and four: blinking, and letting the head move3 min▶

Worth 14 and 12 points, and both are cheap. Together they are 26 points, more than lip sync, and neither costs a cent in resolution.

Blink, worth 14. The eye is checking that this face is alive at all. Blinking is involuntary, unconscious and constant, and its absence is one of the few things a viewer notices in under two seconds without knowing they have noticed it. A face that never blinks reads as wrong before anyone can articulate why. It does not need to be biologically accurate. It needs to happen.

Head motion, worth 12. The eye is checking for a stillness that no living body actually holds. Even a person concentrating on staying still micro-corrects constantly. Perfect stillness is the single strongest tell in the set, and small motion buys more believability than a resolution upgrade does.

The procurement version of this paragraph. Blink and head motion together are 26 of the 60 points on offer. Going from 1080p to 4K is not on this chart at all, because it does not move any of the four checks the viewer's eye is running. If the budget conversation is about resolution, it is about the wrong thing.

Self-studyThe limit that no lever reaches, and it is written in the vendor docs3 min▶

All four levers work inside a system that is estimating rather than observing. Synthesia says this plainly about avatars derived from a photograph:

✗ What a photo-derived avatar cannot do "Because movement is not learned from a real performance, the avatar's motion will not exactly match how you move in real life."

That is not a bug report, it is a description of the product class. A photo avatar has no performance behind it, so its motion is generic by construction. A video avatar has your actual performance behind it and behaves accordingly, which is the real reason the footage requirements in Part 3 exist.

Two more constraints worth knowing before you build on something. The avatar generation you pick has a shelf life: Synthesia's Legacy avatars "remain available... but are being phased out and are not recommended for new content". And the likeness can walk out with the person. On Synthesia, if the individual creates an account with the email address the avatar request went to, "the Personal Avatar will be transferred from your account to theirs".

Part 2 · covers why prosody is timing

Prosody is timing, and timing is where the illusion breaks

6 min live

The playground below computes a genuine viseme track from whatever you type, grapheme by grapheme, and commas and full stops become genuinely longer held pauses. Here is the same sentence with the prosody lever on and off, on a shared time axis, so you can see exactly what the lever is doing.

Same sentence, same visemes: "Hello, this works." prosody on 240ms 340ms 1,805 ms prosody off 1,325 ms 0 0.5s 1.0s 1.5s The comma buys 180ms and the full stop 340ms. Turn prosody off and both collapse to 50ms. Same face, same mouth shapes, same script. The only difference is where the time went. That half second is most of what makes a presenter read as synthetic.
🔍 Click to zoom - the levers do not change the visemes, they change how long each one is held
LiveWhat a viseme track is, and why yours should be computed rather than looped4 min▶

A viseme is a mouth shape, the visual counterpart of a sound. There are far fewer of them than there are phonemes, because several sounds look identical on a face. The letters m, b and p all close the lips. That collapse is why lip reading is hard and why a mouth animation can be plausible without being right.

A viseme track is the ordered list of those shapes with a duration attached to each one. That duration list is the prosody. It carries the emphasis, the breathing, the sense that a thought ended, all of it. Change nothing but the durations and you change how human the delivery reads.

In the playground below, the track under the face is computed from the exact characters you typed. Vowels hold longer than stops, because they do: an open O is held around 115 milliseconds and a hard K around 70. A comma inserts 180 milliseconds of rest, a full stop 340, a space 60. Turn the prosody lever off and every punctuation pause collapses to 50, which is the flat delivery you have heard in every bad corporate explainer video.

Say this to whoever writes the script. Your punctuation is a timing instruction. It is not decoration and it is not grammar. In a system that derives its pauses from the text, a missing comma is a missing breath, and a missing breath is a real cost you pay in believability.

Self-studyWhy the machine voice objection has mostly dissolved3 min▶

The old received wisdom was that a synthesised voice is a learning penalty. Mayer's voice principle, human rather than machine narration, sits at a median effect of d = 0.78, which is substantial. But that finding is about the text-to-speech of its era.

Dincer 2022, with 51 participants, found human voice at d = 0.90 and modern text-to-speech at d = 0.75, both beating traditional synthesis, with no significant difference between human voice and modern machine voice at p = .200, and cognitive load statistically identical at p = .964. Craig and Schroeder found the same reversal.

The practical reading is narrow and useful. Modern synthesised speech is no longer the thing that gives you away. Timing is. If your presenter sounds wrong, look at the pauses before you look at the voice model.

Part 3 · covers footage and cost

What you actually have to record, and what it costs

5 min live

Before you book a room, a camera and an hour of somebody's time, know what the product will accept. These are the published requirements, and they differ enough that guessing will waste the shoot.

What you actually have to record Synthesia PERSONAL AVATAR 1 to 5 minutes of footage single continuous take .webm / .mp4 / .mov 2GB maximum docs say 31 languages HeyGen DIGITAL TWIN 1080p at 30fps minimum 4K at 60fps is better 16:9 or 9:16 consent video required upload or live capture HeyGen AVATAR V 15-second webcam clip 175+ languages no cap on output length one slot, up to 500 looks redo once per billing cycle The docs figure is 31 languages, read 26 August 2026. A figure of 33 circulates elsewhere; use the docs. One consent video covers up to 500 looks for one individual, redoable once per billing cycle.
🔍 Click to zoom - five minutes of studio footage and a fifteen second webcam clip are both real products
LiveReading the footage requirements as production instructions4 min▶

Synthesia personal avatar. Between one and five minutes of footage, in a single continuous take, as .webm, .mp4 or .mov, under 2GB. The single-take requirement is the one that catches people out. You cannot stitch three good minutes together from six attempts, so plan the read as a performance rather than as a series of takes.

Language count, and why it is worth dating. Synthesia's documentation now says 31 languages. A figure of 33 circulates elsewhere. One of the two is stale, and rather than pick the more flattering one this course states the docs figure and the date it was read, which was 26 August 2026. Check it again before it goes in a proposal.

HeyGen Digital Twin. Minimum 1080p at 30 frames per second, with 4K at 60 preferred, in 16:9 or 9:16. This is the option that expects a real capture setup, and the resolution floor here is about giving the model something to learn a performance from rather than about output quality.

HeyGen Avatar V. A 15-second webcam recording, 175 or more languages, and no cap on output length. That is the shape of the current flagship: almost nothing at the door, and no limit on what comes out of it.

The number to plan the consent conversation around. One avatar slot covers up to 500 "looks" for a single individual, generated from one consent video, and can be redone once per billing cycle. Five hundred looks from one recording is a lot of latitude for the buyer, and it is exactly the latitude the person in the recording should be told about before they agree. That is session 2's material arriving in a production spec.

Self-studyCosts, briefly, so you can budget the thing3 min▶
TierHeyGenD-ID Studio, billed annually
EntryFree: 3 videos a month, 1 minute, watermarkedLite $4.7 a month
IndividualCreator $29 a month, 30 min, 1080pPro $16 a month
ProfessionalPro $49 a month, 4KAdvanced $108 a month for 100 minutes
TeamBusiness $149 a month plus $20 a seatEnterprise, custom

Avatar slot add-ons at HeyGen are $29 a month or $300 a year, each covering up to 500 looks for one individual.

The billing quirk that will surprise your finance team. D-ID states that "The length of the video is rounded up to the nearest 15-second interval", and that unused minutes become void. A 100-minute allowance is not 100 minutes if your workflow is forty short clips a week. Model your actual clip lengths against the rounding before you commit to a tier.

Self-studyA correction worth making, because you may have heard otherwise2 min▶

There is a persistent story that D-ID was acquired and is winding down. It is backwards. D-ID is alive and was the acquirer, not the acquired. It bought the Berlin explainer-video company simpleshow, announced on 16 September 2025, and runs the combined company under the D-ID brand. Its own AI information page confirms that simpleshow is now part of D-ID.

Any vendor comparison that has quietly dropped D-ID is out of date, and any comparison that says D-ID was bought has the direction of the transaction wrong. This matters more than it looks: D-ID is the only one of the three where the watermark is never fully removable, even on Enterprise, which makes it a genuinely different option to have on a shortlist.

It also renamed its avatar tiers. "Express Avatar" is now V3 Instant, "Premium+" is now V3 Pro, and photo avatars are V2. The old names survive in D-ID's own help-centre URLs.

Build-along

Drive the viseme track yourself

★ 20 min · everyone builds

Type your own sentence into the playground and watch the track underneath it change grapheme by grapheme. Then add the four levers one at a time. Then try the fifth lever, which will not move the number, and that is the hinge into session 4.

Type a sentence with no punctuation at all and press speak. Watch the track. Every cell is a mouth shape computed from your letters, and the tooltip on each one tells you how long it is held. Note the total duration at the end of the row.

Now add a comma in the middle and a full stop at the end. Press speak again. The track grows two rest cells and the total duration jumps. You did not change a single mouth shape. You changed where the time went, and that is all prosody is.

Turn on "pause where the punctuation is" and press speak. Believability moves from 24 to 42, the largest single jump on offer. Watch the held rests actually hold this time. With the lever off, those same pauses are crushed to 50 milliseconds each.

Add "match the mouth to the actual syllables", now 58. This is the one you would expect to matter most and it comes second. Turn it off again and the holds flatten to a uniform 85 milliseconds regardless of what sound is being made. Uniform is the tell.

Add "blink on a human cadence", now 72, then "let the head move a little", now 84. Two cheap levers worth 26 points between them. Watch the face while it speaks with motion off and then on, and notice which version you would rather look at for ninety seconds.

Now switch on the disclosure lever and watch believability not move. It sits at 84. Craft got you here and craft cannot go any further in that direction, because disclosure was never a craft decision. That is session 4's subject, and the playground is telling you the truth about it.

What is real in this widget and what is not, stated plainly. The viseme track and its timings are genuinely computed from your text by a small rule set over digraphs and letters. The mouth is genuinely driven by that track. The believability percentage is a teaching model with weights chosen to make the ordering of the levers arguable and legible, not a measurement of anything. Trust the ordering and the mechanism. Do not quote the number.

The script is punctuated for delivery, not for grammarEvery comma is a breath you are buying.
The framing is close enough for the lip sync the vendor documentsWide shots expose the weakest part of the system.
Blink and idle head motion are on, and somebody checked26 of the 60 available points, and the cheapest two.
You know the footage spec before you book the roomSingle continuous take, or 1080p at 30, or a 15-second clip. They are not interchangeable.
The person recording consent knows what 500 looks meansOne recording, up to five hundred variants, one redo per cycle.
Nobody on the team believes craft settles the disclosure questionIt does not. Session 4 is where that gets decided.
Part 4 · the hinge

Where craft stops

4 min live

This is the most important paragraph in the session, and it is the one that costs you the good feeling you just earned. You can get very good at this. Being very good at it changes nothing on the other axis.

What craft moves Believability, 24 to 84 percent How long a viewer keeps watching Whether the mouth belongs to the words Four levers. All of them real. What craft does not move Whether disclosure is required What happens when someone finds out Who owns the video of that face A flawless avatar is still undisclosed. Session 4 is the second axis. No amount of craft reaches it.
🔍 Click to zoom - the two axes from session 1, with tonight's work filling in exactly one of them
LiveThe two things craft cannot buy you4 min▶

Craft does not move whether disclosure is required. That is decided by where you are publishing, what you are publishing about, and increasingly by statute. The UK advertising regulator's own position is that there is no blanket legal requirement to disclose AI in ads, and that the test is whether the audience would be misled without it. A better lip sync does not make an audience less misled. It makes them more misled, which is the wrong direction.

Craft does not move what happens when somebody finds out. An undisclosed synthetic presenter at 84 percent believability and one at 24 percent are in exactly the same position on the day someone works it out. The better one has simply been believed by more people for longer, which is more to unwind rather than less.

The version of this that a room actually feels. McDonald's Netherlands published a fully AI-generated Christmas advert and pulled it three days later after viewers called it AI slop. It was made with a named agency and professional AI specialists. Nothing about it failed technically. It failed on reception, and reception is not on tonight's chart.

So take the 84. It is real, it is earned, and it is worth having. Then go into session 4 knowing that the axis you just mastered is the one nobody will hold you accountable for.

Homework

Before session 4

30 min
  1. Repunctuate a real script for delivery. Take ninety seconds of something your organisation has actually published, read it aloud, and put a comma wherever you took a breath. Compare the before and after. That is the largest lever, applied for free.
  2. Watch a synthetic presenter with the sound off. Any vendor demo will do. Count the blinks in thirty seconds and watch whether the head moves. You will find the two cheap levers are the two most often missing.
  3. Write down your footage spec before you need it. One line each: which product, what the capture requirement is, and who is going to be in front of the camera. Single continuous take, 1080p at 30, or a 15-second clip are three different bookings.
  4. Price the rounding. If D-ID is on your shortlist, take a typical week of clips, round each up to the nearest 15 seconds, and see what your 100 minutes is actually worth. Then check whether unused minutes rolling over matters to you, because they do not roll over.
  5. Optional, and it lands harder than any slide: show a colleague your best 84 percent version, let them say it looks good, then tell them it is synthetic. Note how fast the conversation stops being about craft. That is session 4 arriving early.
Check yourself

Three questions

Clear all three and session 3 gets stamped in your passport.

1 · Your budget has room for exactly one upgrade. Which of these buys the most believability?

Resolution does not appear on the lever chart at all, because it does not touch any of the four checks the viewer's eye is running. Wider framing is actively worse: Synthesia's own docs say lip sync "performs best when the avatar is framed closer in the scene". Pausing at punctuation is plus 18, ahead of syllable matching at plus 16, blinking at plus 14 and head motion at plus 12.

2 · The same sentence runs 1,805 milliseconds with the prosody lever on and 1,325 with it off. What changed?

This is the whole point of the session. Prosody is timing. The viseme track is identical in both rows of the figure, cell for cell, and the only difference is how long two of those cells are held. That half second is most of what makes a presenter read as synthetic.

3 · You get an avatar to 84 percent believability. What has that bought you on the disclosure question?

The playground makes this literal: switch on disclosure and believability does not move a point. Higher craft is not an argument for disclosure or against it. It just means more people believed it for longer before anyone found out, which is more to unwind rather than less. C sounds right and is a different claim, about proportionality, which session 4 handles with actual evidence.

Sources covered

What this session teaches, and where it came from

✓Synthesia personal avatar footage requirements1 to 5 minutes, single continuous take, .webm / .mp4 / .mov, 2GB max, and the 31-language docs figure read on 26 August 2026 with the conflicting 33 noted rather than hidden
✓HeyGen Digital Twin and Avatar V capture specs1080p at 30fps minimum with 4K at 60 preferred, 16:9 or 9:16; Avatar V at a 15-second webcam clip, 175+ languages, no output cap; one slot covering up to 500 looks from one consent video, redoable once per billing cycle
✓Pricing at HeyGen and D-ID, plus the rounding ruleHeyGen Free / Creator $29 / Pro $49 / Business $149 plus $20 a seat. D-ID Studio annual Lite $4.7 to Advanced $108 for 100 minutes, with video length "rounded up to the nearest 15-second interval" and unused minutes void
✓The D-ID correction, stated as a correctionD-ID was the acquirer. It bought simpleshow, announced 16 September 2025, and runs the combined company under the D-ID brand
✓The viseme track in the playgroundGenuinely computed from your text, grapheme by grapheme, with real per-shape hold times and real punctuation pauses. The mouth is actually driven by it
◐The believability percentageA teaching model, not a measurement. The weights are chosen so the ordering of the four levers is legible and arguable. Quote the ordering and the mechanism, never the number
◐Mayer's principles and the voice-penalty researchPersonalization d = 1.11, voice d = 0.78, image d = 0.22; Dincer 2022 at N = 51 finding no significant difference between human and modern machine voice. Small samples, cited with their sizes
◐Disclosure law, platform policy and the evidence on trustDeliberately not covered here. Session 4 takes the second axis, including where the research disagrees with itself

Every fact on this page, and its verification tier, is recorded in the course's source map., including a dated list of what is deliberately not stated.

Session 3 cheat sheet · pin this

Four levers, 24 to 84Punctuation pauses +18, syllable matching +16, blinking +14, head motion +12. Resolution is not on the list.
Prosody is timingSame visemes, same order. A comma buys 180ms, a full stop 340ms. Turn prosody off and both crush to 50ms.
Stillness is the strongest tellNo living body holds still. Blink and small head motion are 26 of the 60 available points and cost nothing.
Frame close, not wide"Lip sync performs best when the avatar is framed closer in the scene." Treat that as a shot-list rule.
Know the footage spec firstSynthesia: 1 to 5 min, one continuous take, 2GB, docs say 31 languages. HeyGen Twin: 1080p/30 min. Avatar V: a 15-second clip.
Craft has a ceilingIt does not move whether disclosure is required, or what happens when someone finds out. A flawless avatar is still undisclosed.