AI-SOVEREIGN
Home / AI Research / CurvDelta: Low-Curvature Delta Modeling For Surgical Learning and Unlearning
CUAI Research

CurvDelta: Low-Curvature Delta Modeling For Surgical Learning and Unlearning

· Zeguan Xiao, Zhuocheng Liang, Yun Chen, Yong Wang, Guanhua Chen, Pinyan Lu

A central challenge in adapting large language models (LLMs) is capability preservation: an adaptation can achieve its target while degrading general capabilities. We introduce CurvDelta, a scalable framework that incorporates the preservation constraint into the parameterization of the model update. By analyzing the local geometry of the preservation constraint around the pre-adaptation model, CurvDelta constructs a low-curvature space in which parameter updates leave the preservation loss nearly invariant. We make its construction practical for LLMs through Kronecker-factored approximate curvature (K-FAC) and a factorized projection. We also introduce CurvLoRA, a low-rank variant within…

Upvotes26
Comments2
Published17 Nov 2026