NeFut Logo NeFut
Admin Login

[CS.AI] Self-evolving Agentic Customer Support System at LinkedIn

Published at: 2026-08-12 22:00 Last updated: 2026-08-13 01:53
#AI #LLM #Artificial Intelligence

The self-evolving agentic support system at LinkedIn integrates retrieval-augmented generation with evolutionary auto-prompting and a modular, production-aligned evaluation framework to enable safe, continuous improvement without retraining foundation models. The system treats prompts, retrieval, and evaluation as a closed-loop, versioned workflow with operational guardrails. Offline simulations and ablations show clear quality gains over vanilla RAG and baseline agents, including reduced hallucinations and improved response completeness. In a two-week user-randomized A/B test on LinkedIn's production support traffic, the integrated self-evolved workflow increased QA self-serve by 9.0 percentage points, cancellation self-serve by 4.8 points, and routing accuracy by 30.6 points. These results demonstrate a practical path to scalable, self-evolving AI agents in real-world enterprise settings. Blogger's Review: LinkedIn's self-evolving intelligent customer support system pioneers a new direction for enterprise intelligent support, showcasing the vast potential and prospects of AI technology in practical applications.

Original Source: https://arxiv.org/abs/2608.10224

[h] Back to Home