People Managing People published a piece this week. It covers two head-to-head AI coaching studies with results that directly contradict each other. In 2022, a trial found that chatbots helped clients hit goals as effectively as human coaches. By 2026, a second study flipped: the AI coach didn't outperform the control group on any primary outcome, while human coaches moved every needle.
The gap is a map. The 2022 study gave the AI a structured goal-attainment protocol with clear frameworks and consistent nudging, a machine's sweet spot. The 2026 study sat the bot in the coach's chair with senior leaders, asking open-ended development questions that depend on co-regulation, the mutual, real-time adjustment between two people. The AI never generated it, and the numbers showed what was missing.
The piece quotes Kuber Sharma, a senior director at UiPath, on the signal that actually matters: whether people initiate interactions on their own. A tool only used when assigned isn't coaching anyone.
Where AI earns its place: rehearsal for a hard conversation, structured reflection, commitment reinforcement between sessions. These tasks extend coaching reach to frontline managers who'd never get it otherwise. Anant Sood, co-founder of Worxogo, found this directly when his team saw that in judgment-heavy work like fraud investigation, most managers skipped the tool entirely and fed the signal upward to human leaders. That decision mattered because it recognized the limits.
One important finding: success was strongly predicted by the coachee's starting self-efficacy and hope. Employees who most need development support are the ones least served by an unsupervised bot. Deciding who gets a human coach is a leadership call.
What it means for us as people leaders:
AI can handle structure, but co-regulation needs a human. When coaching depends on mutual adjustment, the bot falls short. We need to protect those roles for people.
Voluntary engagement is the only metric that counts. If people only use the AI when assigned, it is not coaching. Pay attention to who seeks it out on their own.
Read the full piece