Knowledge-Empowered, Collaborative, and Co-Evolving AI Models: The Post-LLM Roadmap
Engineering, vol. 44, pp. 87–100
Abstract
Large language models (LLMs) have significantly advanced artificial intelligence (AI) by excelling in tasks such as understanding, generation, and reasoning across multiple modalities. Despite these achievements, LLMs have inherent limitations including outdated information, hallucinations, inefficiency, lack of interpretability, and challenges in domain-specific accuracy. To address these issues, this survey explores three promising directions in the post-LLM era: knowledge empowerment, model collaboration, and model co-evolution. First, we examine methods of integrating external knowledge into LLMs to enhance factual accuracy, reasoning capabilities, and interpretability, including incorporating knowledge into training objectives, instruction tuning, retrieval-augmented inference, and knowledge prompting. Second, we discuss model collaboration strategies that leverage the complementary strengths of LLMs and smaller models to improve efficiency and domain-specific performance through techniques such as model merging, functional model collaboration, and knowledge injection. Third, we delve into model co-evolution, in which multiple models collaboratively evolve by sharing knowledge, parameters, and learning strategies to adapt to dynamic environments and tasks, thereby enhancing their adaptability and continual learning. We illustrate how the integration of these techniques advances AI capabilities in science, engineering, and society—particularly in hypothesis development, problem formulation, problem-solving, and interpretability across various domains. We conclude by outlining future pathways for further advancement and applications.
Authors 17
-
Fei Wu corresponding
Shanghai Jiao Tong University · Zhejiang University
Affiliation as printed
College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China
Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
-
Affiliation as printed
Leiden Institute of Advanced Computer Science, Leiden University, Leiden 2333 CC, Netherlands
-
Affiliation as printed
College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China
-
Affiliation as printed
College of Electrical Engineering, Zhejiang University, Hangzhou 310027, China
-
Affiliation as printed
School of Engineering, Westlake University, Hangzhou 310024, China
-
Affiliation as printed
College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China
-
Hong Kong University of Science and Technology
Affiliation as printed
Department of Computer Science and Engineering, Hong Kong University of Science and Technology, Hong Kong 999077, China
-
Affiliation as printed
Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
-
Affiliation as printed
College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China
-
Fan Wu corresponding
Shanghai Jiao Tong University · Zhejiang University
Affiliation as printed
College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China
Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
-
Affiliation as printed
Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
-
Hong Kong Polytechnic University
Affiliation as printed
Department of Computing, The Hong Kong Polytechnic University, Hong Kong 999077, China
-
Affiliation as printed
College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China
-
Affiliation as printed
College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China
-
Affiliation as printed
College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China
-
Affiliation as printed
College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China
-
Yunhe Pan corresponding
Affiliation as printed
College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China
Cited by 40 stored of 41
No patents citing this paper on Lens.org (checked 2026-10-11).