Abstract
The rapid progress of AI has intensified the long-standing pursuit of automation: replacing human participation with algorithms wherever possible. Implicit in this pursuit is the assumption that humans remain in the loop only because current AI systems are not yet sufficiently capable. This paper challenges that assumption. Rather than asking how far automation can extend, we ask where its conceptual limits lie and argue that human participation may persist even with highly capable AI systems for three distinct reasons:
- Technical or Complementarity Grounds: Humans contribute capabilities or perspectives unavailable to AI.
- Normative or Developmental Grounds: Participation itself is valuable for human agency or learning.
- Emergence Grounds: In some activities, the target is not fully specified in advance but emerges through interaction. In these cases, human participation is not merely a means of improving execution but is constitutive of the target being produced.
Thus, human-AI co-construction, understood as the joint production of outcomes by humans and AI systems, is not simply a temporary response to imperfect AI, but a persistent feature of activities whose objectives emerge through participation. This perspective has important implications for the limits of automation and for the design, evaluation, and ethics of future AI systems.
Blogger's Review: This paper offers profound insights into the significance of human involvement amid the automation surge, emphasizing the collaborative relationship between humans and AI. Future AI system designs must consider this symbiotic model to enhance both technological effectiveness and human engagement.