learn-facilitation-with-phoebe / Session 4 of 6
Learn Facilitation with Phoebe · Session 4 of 6

The airtime bench

Full participation is the first of Kaner's four values, and the easiest to claim. Tonight it is measured. Forty real meetings from the AMI Meeting Corpus sit in this page, ten design teams of four, each recorded across a full day of four meetings. For every meeting the page computes, from the timing of 21,166 speaker segments, how much of the airtime each person held, how unequal that was, how often the floor changed hands, and who started speaking over whom. Then you apply facilitation moves to a meeting you choose, and watch the inequality move. The baseline is real. Every move is a rule the widget prints, and every number carries a tag saying which kind it is.

🔴 Bench night Bring a meeting you ran No code tonight, all clicking 45 min
0-3 · Welcome 3-12 · How a meeting becomes numbers 12-38 · The bench, move by move 38-45 · The evidence, and Q&A
Part 0

Where we start

The AMI Meeting Corpus is about 100 hours of recorded meetings, released by the University of Edinburgh and partners under a Creative Commons Attribution licence. About two-thirds are scenario meetings: four people play a design team, a project manager, a marketing expert, a user interface designer and an industrial designer, and design a television remote control across four meetings in one day, from kick-off to detailed design. The participants were not trained designers, and the project manager's role is defined as coordinating the project and running the meetings. That last detail matters tonight: the role itself asks one person to talk.

🎫 Clear all three quiz questions to stamp your passport measured = counted from the real segments simulated / modelled = a stated rule applied to the real baseline

★ What you walk out with tonight. The measured shape of airtime in 40 real meetings, a way of reading any meeting's balance in three numbers, the honest size of what a round robin can and cannot do, why handing the close to the loudest voice undoes it, and what the research on equal airtime actually shows, including the part that did not replicate.

Part 1 · covers what the bench measures

How a meeting becomes numbers

6 min live

AMI's annotators marked, for every participant, each stretch of speech with a start and an end time. The bench uses only those segment timings: no audio and no words. From them it counts four things, defined the same way in the browser and in the Python reference run that checked every number on this page.

HOW A MEETING BECOMES NUMBERS one turn, two segments PM ME UI ID ME started over PM time WHAT IS COUNTED airtime union of a person's segments turn a run of one person's segments started over started while another spoke Gini of the four shares 0 equal, 0.75 one voice Timings are AMI's manual segment annotations, in hundredths of a second; no words or audio are used.
🔍 Click to zoom - the bench never listens; it only knows who was speaking when, which is exactly what a facilitator can see from the front of the room
LiveThree numbers to read any meeting3 min▶

Share of airtime. Each person's speaking time divided by everyone's. With four people, an equal meeting gives each 25 percent. A share is the most direct reading of full participation, and the easiest to estimate from the front of a room: whose voice have you heard most?

Gini of the four shares. One number for how unequal the shares are: 0 when everyone held the same airtime, rising to 0.75 when one of four people did all the talking. It lets you compare meetings and moves on one scale. The mean across the 40 meetings is 0.198, from 0.044 in the most balanced to 0.416 in the least.

Top speaker's share. The share of the person who spoke most. Gini summarises everyone; the top share names the one thing a facilitator usually notices first. Across the 40 meetings the top speaker held 39.9 percent on average.

Self-studyWhat the definitions include, and leave out3 min▶

Started over counts every time a person begins a segment while someone else is mid-segment. That includes "yeah" and "mm-hmm" said under someone else's sentence, which are support, not interruption. The bench also counts the stricter case where the first speaker stopped before the second did, but neither is a measure of rudeness. Read the matrix as "who is talking while whom is talking", and expect the person who talks most to be talked over most, simply because they are speaking more of the time.

Airtime says nothing about quality. One person explaining a cost model for six minutes may be exactly what the meeting needed. Inequality is a reading to interpret, not a score to minimise, and a kick-off where the project manager briefs the team is supposed to be unequal.

The sample. Of the scenario teams with all four meetings, all four roles and complete timings, 32 qualified; ten were drawn with a fixed seed (one team was left out because AMI documents incomplete timings for it). The data is derived from the corpus and modified to timings only, as its licence permits with attribution.

Build-along · the bench

Forty real meetings, and four moves

★ 26 min · the main event

The bench opens on TS3012b, a functional-design meeting of 40.9 minutes. Read the baseline first: the bars, the three numbers, the dot strip of all 40 meetings, and the table by meeting in the series. Then work down the four moves in order, and say out loud what changed and what did not before moving on. Pick other meetings from the list whenever you want a second case.

Read it in this order. The tag first, then the verdict line, then Gini and top share, then the sample-wide numbers. On TS3012b the project manager held 45.3 percent of the airtime against 25 percent for an equal share, a Gini of 0.217, close to the sample mean. It is an ordinary meeting, which is why it is the default.

Part 2 · covers what the 40 meetings show

The person who runs the meeting holds the floor

6 min live

The bench computes these live; the numbers here are the ones it prints on the baseline, written down so they can be argued with after class. They agree with an independent Python run on every value.

WHO HELD THE FLOOR, MEASURED Mean airtime share by role PM's mean share, by meeting in the series PM ME UI ID 37.6% 21.8% 19.0% 21.7% equal share 25% kick-off functional conceptual detailed 49.2% 36.1% 29.6% 35.4% 25% The PM spoke most in 30 of 40 meetings, and in all 10 kick-offs. Measured, not simulated.
🔍 Click to zoom - the role that runs the meeting holds the most airtime, most of all in the meeting that sets the direction
LiveFinding 1: the process role takes the floor2 min▶

Across the 40 meetings the project manager held 37.6 percent of the airtime on average, against 21.8, 19.0 and 21.7 percent for the other three roles, and was the top speaker in 30 of 40. In the ten kick-offs the PM held 49.2 percent and was the top speaker every time. By the third meeting, conceptual design, the PM's share was 29.6 percent and the PM was top in 5 of 10.

Part of this is the job description. AMI's scenario asks the PM to coordinate and run the meetings, so a kick-off where the PM talks for half the time is the role working as written. That is exactly the lesson for facilitation: whoever holds the process tends to hold the floor, whether or not anyone meant them to. A facilitator who is also the person with the agenda, the slides and the clock starts every meeting with that pull, and has to design against it.

LiveFinding 2: more turns, but longer ones2 min▶

The PM took 29.7 percent of the turns but 37.6 percent of the airtime: PM turns are longer than everyone else's. The other three roles took 24.6, 22.7 and 23.1 percent of the turns. Turn counts are much closer to equal than airtime. People got in; they just did not stay long. A meeting can look participatory from the number of voices heard and still be run by one person's long turns. The floor changed hands about 14.1 times a minute on average, so these are lively meetings, not monologues.

Self-studyFinding 3: everyone talks over the person who talks most2 min▶

Summed over the 40 meetings, other people started speaking while the PM was mid-segment 5,914 times, and the PM started over others 4,788 times. In TS3012b the industrial designer started over the PM 125 times and the marketing expert 124 times. Read with care: the person who holds the floor longest is the one others most often overlap, and much of it is agreement noises and attempts to get in. A high count in the column under one name is a sign the floor was hard to get, not that the others were rude.

Real world

IS1001a, a kick-off. The project manager held 61.0 percent of the airtime, the highest share in the sample, and the Gini was 0.416. Nobody in that room was misbehaving: the PM was briefing three people who had just met, as the scenario asked. Select it on the bench and try the moves. It is the clearest case of a structure, not a personality, producing inequality, and the one where a facilitator's structure would change the most.

Part 3 · covers the moves, the anti-lever and the break button

What a move can do, what undoes it, and how to know the bench is honest

6 min live

The baseline happened. The moves did not: each applies a rule the widget prints to the real baseline and reports what the inequality would be under that rule. That makes them good for comparing moves and bad for predicting a particular meeting, and every number they produce is tagged so you cannot mistake one for the other.

MEAN GINI OF AIRTIME, SAME 40 MEETINGS, FIVE WAYS Baseline measured Round robin, cap 40% simulated Round robin, cap 30% simulated Loudest summarises modelled, anti-lever Shuffle the labels break button 0.198 0.163 0.095 0.236 0.068 Only the first row happened. The others apply a stated rule to it, and the widget prints the rule.
🔍 Click to zoom - two moves pull inequality down, one pushes it up in all 40 meetings, and the break button shows how low "random" goes
LiveThe round robin with a cap, simulated2 min▶

The rule: nobody may hold more than the cap; whatever was above it is handed out in equal parts to everyone below it, repeated until nobody is over. Total airtime stays the same. At a 40 percent cap the mean Gini falls from 0.198 to 0.163, because most meetings had nobody above 40 percent and are untouched. At 30 percent it falls to 0.095, the PM's mean share falls to 28.9 percent, and the PM is the sole top speaker in 22 of 40 meetings instead of 30. On TS3012b, a 30 percent cap takes Gini from 0.217 to 0.063.

What it does not show: a real round changes more than the totals. It changes the order of ideas, who responds to whom, and sometimes how long the meeting runs. The cap is a way to see the size of the imbalance a structure would have to absorb, not a forecast of a better meeting. Drag the slider down to 25 percent and Gini goes to zero, which no real meeting does.

LiveThe anti-lever: let the loudest summarise2 min▶

Ending a meeting with "Ravi, can you sum up where we landed?" feels efficient: Ravi has been the most engaged, and he knows the material. The model: every segment that starts in the last 10 percent of the meeting is handed to whoever already spoke most. Mean Gini rises from 0.198 to 0.236, the top speaker's mean share from 39.9 to 43.9 percent, and inequality rises in all 40 meetings. On TS3012b the PM's share goes from 45.3 to 49.4 percent.

The honest nuance: it is a model of the closing minutes, and in some meetings the top speaker would summarise fairly. The airtime cost is small. The bigger cost is the one the bench cannot count: the summary is the part of a meeting people remember and the part that becomes the record, and it is now in the voice that already dominated. Session 6 closes a different way.

Self-studyThe break button: shuffle the speaker labels2 min▶

A bench that can only produce the result you expect is measuring nothing. The break button gives every segment a speaker drawn at random from the four, with a fixed seed, and recomputes everything. If the PM's dominance came from the people, it should vanish; if it came from some artifact of how segments were cut, it would survive. It vanishes: the PM's mean share drops to 25.3 percent, the PM is top in 9 of 40 (about the 10 you would expect by chance), and the mean Gini falls to 0.068.

That 0.068 is also worth reading. Random labels do not give perfect equality, because segments differ in length and a random draw is uneven. It is the floor a four-person meeting reaches with no pattern at all, and a useful reminder that a Gini of 0.05 in a real meeting is about as equal as meetings get.

Part 4 · covers the research behind equal airtime

"Equal turn-taking makes smarter teams", traced

5 min live

Equal airtime is often sold with a famous finding attached, usually credited to Google. The trail is worth following, because the finding is not Google's and it did not replicate cleanly.

WHERE "EQUAL AIRTIME" CAME FROM, AND WHAT HAPPENED NEXT finding journalism Google page replication reanalysis meta-analysis 2010 2016 2016 2017 2017 2021 Woolley et al. turn-taking linked Duhigg, NYT joins it to Google Google re:Work no turn-taking Bates and Gupta did not replicate Credé, Howardson factor itself weak Riedl et al. process = strategy All six read at source. Equal airtime as a cause of smarter groups is contested, not settled.
🔍 Click to zoom - the teal dot is where a 2010 lab finding became "what Google learned"
LiveWhat Google's page says, and what it does not2 min▶

Google's re:Work guide on team effectiveness describes Project Aristotle: 180 teams, 115 engineering project teams and 65 sales pods, and five dynamics in order of importance: psychological safety, dependability, structure and clarity, meaning, and impact. It lists factors that did not significantly matter at Google, including consensus-driven decision making, extroversion, team size and seniority. The words "turn" and "conversation" do not appear on the page.

The turn-taking idea arrived through Charles Duhigg's 2016 New York Times Magazine article, which described Woolley and colleagues' research next to Google's psychological-safety finding. Saying "Google found that equal turn-taking makes teams effective" merges a university study, a magazine article and a company guide into one claim none of them made.

LiveThe disagreement, as it stands3 min▶

Woolley, Chabris, Pentland, Hashmi and Malone (2010, Science) studied 699 people in groups of two to five and reported a general "collective intelligence" factor that was not strongly correlated with members' average or maximum intelligence, and was correlated with members' average social sensitivity, the equality of conversational turn-taking, and the proportion of women in the group.

Bates and Gupta (2017, Intelligence) ran three studies with 312 people and found individual IQ accounted for around 80 percent of group-IQ differences; the turn-taking and proportion-of-women effects were not supported. Credé and Howardson (2017, Journal of Applied Psychology) reanalysed six samples and judged the support for the collective factor generally weak.

Riedl, Kim, Gupta, Malone and Woolley (2021, PNAS), a meta-analysis of 22 studies with 5,279 people in 1,356 groups, found a robust collective factor and that group process predicted it better than individual skill. But "process" there meant skill congruence, strategy and effort on an online task platform, not equal airtime.

None of this is resolved, and this page does not resolve it. What a facilitator can take from it is narrower and safer: equal airtime is not proven to make a group smarter. The reason to balance airtime does not depend on that proof. A decision only one voice shaped contains only that voice's information, and the people who were not heard did not take part in it, which is Kaner's case for full participation and shared responsibility.

The sentence to use with a sceptical sponsor. "I am not promising a smarter group. I am making sure the four people who know different things all get it into the room before we decide, and that the decision belongs to all of them."

Homework

Before session 5

30 min
  1. Read a meeting you ran. From memory or a recording, estimate each person's share of airtime. Who was top, and did their role ask them to be?
  2. Find the most balanced meeting on the bench and the least balanced. What kind of meeting was each, kick-off or later? Write one sentence on why.
  3. Try the cap on IS1001a. Note the Gini at 40 percent and at 30 percent, and say in one line why a round in a kick-off might be the wrong move.
  4. Practise the sponsor sentence from Part 4 out loud until it sounds like yours, without the word "Google".
Check yourself

Three questions

Clear all three and session 4 gets stamped in your passport.

1 · The project manager spoke most in 30 of the 40 meetings, and in all 10 kick-offs. What is the best reading?

The break button rules out B: with random labels the PM is top in 9 of 40, about chance. A would need the people to have been chosen for talkativeness; AMI assigned roles by scenario. The pattern is strongest in the kick-off, where the PM is briefing, which points at the role.

2 · Handing the closing 10 percent of each meeting to its top speaker raises the mean Gini from 0.198 to 0.236. What is the honest way to state this?

The baseline is measured; the anti-lever is modelled, and only its direction and rough size are claimed. B claims an outcome no one measured, C mislabels a model as a measurement, and D ignores the cost the number cannot show.

3 · A colleague says "Google proved equal turn-taking makes teams effective". What is accurate?

The finding is real but it is Woolley's, brought into Google's story by a 2016 magazine article. Bates and Gupta did not replicate the turn-taking effect, and Riedl and colleagues' later "process" was strategy and skill matching, not airtime. C overcorrects: there is a published link, and the disagreement is about whether it holds.

Sources covered

What this session teaches, and where it came from

✓Every baseline number on the benchComputed in the browser from segment timings of 40 AMI scenario meetings (AMI Meeting Corpus, CC BY 4.0; Carletta et al. 2006, MLMI 2005, Springer); derived and modified to timings only; verified against an independent Python run, 579 values identical
✓The AMI scenario and rolesRead on the corpus's own overview and scenario pages: four roles, four meetings in a day, PM runs the meetings
✓Google re:Work, Duhigg 2016, Woolley et al. 2010, Bates and Gupta 2017, Credé and Howardson 2017, Riedl et al. 2021Each read at source (abstract, page or archived article); no effect size from Woolley 2010 is quoted because the article body was not read
◐The round robin cap and "let the loudest summarise"Simulated and modelled by rules printed on the widget; only their direction and rough size are claimed

Every fact on this page, and its verification tier, is recorded in the course's source map.

Session 4 cheat sheet · pin this

Three readingsShare per person, Gini of the shares (0 to 0.75 for four), top speaker's share.
The process role holds the floorPM 37.6% on average, top in 30 of 40, all 10 kick-offs.
Turns are not airtimePM took 29.7% of turns but 37.6% of the time: fewer, longer.
A cap moves the numberSimulated: mean Gini 0.198 to 0.095 at a 30% cap.
Do not let the loudest summariseModelled: Gini up in 40 of 40, and the record is in one voice.
Equal airtime is contestedWoolley 2010 found it; Bates and Gupta 2017 did not; Google never said it.