GRAM: Group-wise Rank-Aware Model Merging via Subspace Alignment

Merging different models into a single model is highly desirable for multi-task deployment, particularly in regulated domains like healthcare. In such settings, models are often locally fine-tuned due to strict data privacy policies, necessitating that aggregation operates exclusively on the fine-tuned weights. Existing methods apply a uniform merge across all tasks, ignoring the geometric…

Publisher's summary from arXiv cs.AI. Read the full article on arXiv cs.AI · More from arXiv cs.AI