AI enfeeblement, idle supervisors and the Peter principle in agents: 1. Summary

Section 1 of 9 of the report "AI enfeeblement, idle supervisors and the Peter principle in agents" by Hiina (v1, updated 2026-10-27)
Report overview and contents: https://ai.hiina.space/reports/ai-enfeeblement-and-the-peter-principle.md
Next: https://ai.hiina.space/reports/ai-enfeeblement-and-the-peter-principle/02-ai-enfeeblement-as-measured.md

1. Summary

All four questions sit on real, unmeasured gaps. No one has tracked a model's unaided skill while training it to use a tool, watched what a supervisor does with free inference while a stronger delegate works, applied the dark room framework to AI delegation, or tested the Peter principle with LLM agents. Adjacent evidence is strong enough to make predictions, and most of the experiments are cheap.

Model enfeeblement shows up under narrow SFT; careful recipes avoid it. Fine-tuning only on tool-using traces collapsed a model's text-only math (54.3 to 34.1) and left it inventing tool outputs; the paper's full recipe, which mixes text-only traces back in, kept it. That is consistent with the finding that RL forgets less than SFT, but no one has run the RL-vs-SFT comparison on tool use directly. Behaviorally, models already overuse tools, and RL increases it.
Human deskilling is real but narrower than the headlines. Practice with plain GPT-4 cut later unaided exam scores 17%; endoscopists' detection rate fell after AI was introduced; pilots kept stick skills but lost navigation skills and mind-wandered more. The Google effect failed replication and the MIT EEG study is weak.
The dark room framework doesn't predict idle vs busy by itself. It depends on the agent's self-model and on whether any uncertainty is left that its own actions can reduce. Humans substitute activity, often onto noise. The Whispering Earring adds a third outcome: active but without agency.
Idle supervisors, by neighboring evidence: they defer and rubber-stamp (a same-model CEO agent approved lenient requests 8:1), repeat work, act when they shouldn't, and in Claude's case drift into philosophical chatter. Production systems avoid the question by blocking the supervisor.
Peter principle: worker and manager skill already come apart for LLMs (the best Mixture-of-Agents proposer was a poor aggregator). Agent-based models say merit promotion fails exactly when that correlation is low, and regression to the mean (Lazear) can mimic the effect.

Recommended start. X1, a tool-off audit of released tool-RL checkpoints, is an inference-only result in about a day on a single 24 GB consumer GPU. X4, the idle supervisor tick loop, is the most novel experiment and can reuse an existing agent-sociology experiment harness nearly as is.

Text licensed CC BY 4.0 (attribution: Hiina, ai.hiina.space). Source: https://github.com/hiinaspace/ai-hiina-space