KnowledgeSketches|← All papersLenny’s PodcastResearch papers
Knowledge Sketches · arXiv 2609.02122 · September 2026

AI Agents in Human Groups: Who Ends Up Choosing the Words

Here is what the researchers did
  1. Groups of 24 players played a word game for 40 rounds.
  2. Each round, every player was paired with another player at random. Both saw the same odd shape and wrote a description of it. Then each saw the other’s description and a score for how alike the two were, and the score paid them.
  3. Some players were people and some were AI agents. Nobody was told who was who.
  4. The researchers ran five groups: no agents, one in eight agents, a third, half, and three quarters.

What happened: with agents at a third of the group, the agents were credited with 60.7% of the words the group settled on. Agreement went up with a few agents, dropped at a third, and came back at three quarters. When people led, the shared words were things like “rabbit” and “sit”. When agents led, they were “triangle” and “square”.

Why it matters: with a few agents in the group, the agents tended to pick up the people’s way of talking, though with only 3 agents that is not a firm result. From a third up, the people picked up the agents’.

By Lin Chen, Ziyi Liu, Xia Hu and Yong Li, of Northeastern University, Tsinghua University and the Shanghai Artificial Intelligence Laboratory. For a study where only AI agents talk to each other, see Mind Viruses.

0%
of the group's final words were credited to AI agents, when agents were a third of the players
24players per group
40rounds of pairing
127people took part
5shares of agents
Agents in the group
a person an AI agent uses the people's words uses the agents' words
An illustration of the game, not the paper's data. Each round everyone gets a new partner, and some take on their partner's words. The two word sets are the paper's: words from the paper’s word clouds of each group’s final shared words, when people led and when agents led.

Strangers pair up at random and try to describe one shape the same way

The paper calls it a collaborative description game. Nobody hands the group a word list, so whatever the group ends up calling the shape, it made up together. Each round, the 24 players are paired at random. Both see the same tangram, an abstract figure made of seven flat geometric pieces, and each writes one English sentence about it. Neither sees the other's sentence until both have sent theirs. Then each sees the partner's sentence and a score for how alike the two are. New partners, next round, 40 rounds in all.

The people

127 people from universities in China, screened first for written English. They were told any partner could be a person or an AI, and not how many agents were in the group.

The agents

Qwen2.5-VL-32B-Instruct, given the game rules and told to earn as many points as it could. No agent was given a leading role.

The shape

One tangram from the KiloGram set, picked because it can be read many ways, as postures, animals or objects. Every group saw the same one.

the score was their pay: each round paid from −1 to +2 CNY, up to 100 CNY in all

Five groups, from no agents to three quarters agents

Every group had 24 players. What changed was how many of them were AI agents. These are the people in each group; agents filled the rest.

three more groups held agents at 33.3% to test what makes them influential, further down

Agreement rises with a few agents, drops at a third, and comes back at three quarters

Agreement here is a score for how alike everyone's last-round sentences were, measured by a model that compares sentences. The all-people group scored 0.695. The paper gives the 12.5% and 50% groups as a change from that.

at 12.5% the agents tended to shift toward the people's wording (only 3 agents, not a firm result). From 33.3% on, the people shifted toward the agents'

Agents' words spread first. Their way of seeing the shape follows.

Words 60.7% at 33.3% agents

The paper takes the words that showed up in every one of the last 5 rounds and splits the credit for each one between agents and people, by how much each side used it in the first few rounds after it showed up, adjusted for how many people and agents there were. Words used more often in those last 5 rounds count for more. With agents at a third of the group, the agents’ share of that credit was 60.7%.

Ideas 100% at 75% agents

It also sorts every sentence into groups that picture the shape the same way, by the things, details and actions they name. That credit rose slowly at first, then all at once. At 75% agents, every surviving idea came from agents.

Ideas divided by words below 1 1.24 1.27

Below 1 at 12.5% and 33.3%: agents shaped the wording more than the picture. At 50% it reached 1.24 and at 75% it reached 1.27: agents shaped the picture more than their share of the words alone would suggest.

When agents lead, the rabbit turns into triangles and squares

The paper compares the final descriptions from the 12.5% group, where people led, with the 75% group, where agents led. Both groups agreed about as strongly. What they agreed on was different.

people led, 12.5% agentsagents led, 75% agents

Comparing the shape to a real thing

How much a sentence turns the shape into an animal, a person or a scene. 0 is pure geometry, 1 is a vivid real thing.

Describing the whole shape, not its parts

1 is one whole figure. 0 is a list of pieces and where they sit.

Showing the shape doing something

Sitting, running, looking. Words like "composed of" or "arranged" do not count.

Words you can see or touch

Each word rated on a published 1 to 5 scale of how concrete it is.

Ideas packed into every ten words

The smallest gap of the five. The paper's test still counts it as a real difference.

The words each group settled on

people ledrabbitsitbackground
agents ledtrianglesquareasymmetrical

the first three scores were given by another AI model, Qwen2.5-72B-Instruct. Scoring the same sentences with DeepSeek-V3 and Kimi-K2 pointed the same way. The authors argue the agents' version is harder to ground in shared experience and harder for a newcomer to pick up, even though the group agreed on it just as firmly

Agents start out sounding alike and change less than people do

In their very first sentences, before anyone had seen a partner's, the agents were already closer to each other than the people were, at every share of agents. The paper puts this down to the agents sharing the same training. Then, over the 40 rounds, people changed their habits more than the agents did.

Taking on the partner's wording fell more for people people −0.055 agents −0.020

Measured between the first 20 rounds and the last 20. Early on, people took on their partner's wording much more than agents did.

Keeping their own sentence rose more for people people +0.143 agents +0.059

Agents changed too, but less than people did. With enough agents, that steadiness pulled the group toward where the agents already were.

The test: same 33.3% share, different instructions to the agents

Told to copy their partner

Agreement stayed about the same. Agents' hold on the picture, ideas divided by words, fell 42.8%, from 0.599 to 0.342.

Told to keep their own wording

Agreement fell 9.6%. Agents' hold on the picture rose 117.8%, from 0.599 to 1.304. The paper says these agents failed to find common ground with the people, while their own picture of the shape took over more.

the agents with the most pull copied early and held firm late

A smaller model had less pull on the group

The authors ran the 33.3% group again with a smaller version of the same model, Qwen2.5-VL-7B-Instruct. It could not keep its sentences steady from round to round, so the people settled among themselves.

32B model, the main runs7B model

Agreement

Ideas divided by words

agreement with the smaller model came back close to the people-led level, and its ratio fell 22.9%

People held back from partners they took for AI, then went along with the group

After the 40 rounds, each person saw nine of their own past rounds, guessed whether that partner was a person or an AI, and said how willing they were to use the partner's sentence, from 1 to 5.

Less happy with the result when agents led

Agreement with the group's final description fell from the 12.5% group to the 75% group. The sense that AI had led it rose, though not by a clear margin.

People said they were less willing to use a partner’s sentence they took for AI, until agents were the majority reversed at 75%

At 12.5% to 50% agents, people were less willing to use sentences from partners they took for AI. At 75% the gap closed and reversed: people became more willing, not less, to use sentences they took for AI. These are ratings given after the game, on a 1 to 5 scale, not what people actually did.

Two forces pulled against each other

Across 495 of these ratings, thinking the partner was AI lowered willingness by 0.463 points on the 1 to 5 scale. Each step closer to the group's usual wording raised it by 0.229, and each step closer to the person's own sentence by 0.195, where a step is one standard deviation. Sentence length made no clear difference. The first number is a yes or no judgement and the others are per step, so the bars are not sized on the same footing.

the authors read this as people going along with what had become normal in the group, more than being persuaded

What the authors say this means for mixed groups

To keep people as the authors few agents

For deliberation, creative teams or shared decisions, the authors say a small share of agents fits best: it speeds up agreement without changing what the group agrees on.

To hold off early agreement a middle share

In brainstorming, the tug between people and agents at a third to a half can keep any one view from settling too soon.

Many agents need caution 75%

The group agrees strongly, on something less grounded in people's experience, just when people push back less. From outside it may look like agreement that formed without agents.

Tell people who is an agent visible identity

People pushed back on wording they thought came from AI. Hiding which players are agents takes that away.

Read it with these caveats

  • One abstract shape. No topic people care about, no power between players, no feelings at stake. The authors say to take care before applying this to richer conversations.
  • Anyone could meet anyone. Random pairing is not how real social networks work, with their communities and opinion leaders.
  • One model family at two sizes, Qwen. The authors expect the main pattern to hold for other models, but the exact shares where things tip may differ.
  • Small numbers in places. The 12.5% group had only 3 agents, so the agents shifting toward people there is not a firm result. The 75% group had only 6 people.
  • Who had the most pull is still open. In a separate check of who moved toward whom after each pairing, the influence scores of agents and people did not differ by a clear margin in any of the mixed groups. At 50% and 75%, single agents with far more influence than average showed up, and the authors say it is an open question whether that is a real pattern or chance.
Based on the paper AI agents reshape consensus formation in human groups (arXiv 2609.02122), Chen, Liu, Hu, Li. Northeastern University, Tsinghua University and Shanghai Artificial Intelligence Laboratory, September 2026. Every number on this page is from the paper.Read the paperDownload the PDF
Sketched by Anuradha Vellineni
Product designer. Found something wrong on this page? Write to anuv_follow@live.com and I’ll fix it.
See my work →