跳到主要导航 跳到搜索 跳到主要内容

Bugs in Modern LLM Agent Frameworks: An Empirical Study

  • Xinxue Zhu
  • , Jiacong Wu
  • , Xiaoyu Zhang
  • , Tianlin Li
  • , Yanzhou Mu
  • , Juan Zhai
  • , Chao Shen
  • , Chunrong Fang
  • , Yang Liu
  • Nantong University
  • Nanjing University
  • Nanyang Technological University
  • Beihang University
  • University of Massachusetts

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

LLM agents have been widely adopted in real-world applications, relying on agent frameworks for lifecycle execution and multiagent coordination. As these systems scale, understanding bugs in the underlying agent frameworks becomes critical. However, existing work mainly focuses on agent-level failures, overlooking framework-level bugs. To address this gap, we conduct an empirical study of 998 issue reports from CrewAI and LangGraph, and construct a taxonomy of 15 root causes and seven observable symptoms across five agent lifecycle stages: 'Agent Initialization', 'Perception', 'Self-Action', 'Mutual Interaction' and 'Evolution'. Our findings show that agent framework bugs mainly arise from 'API Misuse', 'API Incompatibility', and 'Documentation Desync', largely concentrated in the 'Self-Action' stage. Symptoms typically appear as 'Functional Error', 'Crash', and 'Build Failure', reflecting disruptions to task progression and control flow.

源语言英语
主期刊名FSE Companion 2026 - Proceedings of the 34th ACM International Conference on the Foundations of Software Engineering
编辑Shin Hwei Tan, Foutse Khomh
出版商Association for Computing Machinery, Inc
1588-1592
页数5
ISBN(电子版)9798400726361
DOI
出版状态已出版 - 17 7月 2026
活动ACM International Conference on the Foundations of Software Engineering, FSE 2026 - Montreal, 加拿大
期限: 5 7月 20269 7月 2026

丛书

姓名FSE Companion 2026 - Proceedings of the 34th ACM International Conference on the Foundations of Software Engineering

会议

会议ACM International Conference on the Foundations of Software Engineering, FSE 2026
国家/地区加拿大
Montreal
时期5/07/269/07/26

学术指纹

探究 'Bugs in Modern LLM Agent Frameworks: An Empirical Study' 的科研主题。它们共同构成独一无二的学术指纹。

引用此