What are you looking for?

2 results for “pruning”

AI·Structured pruning method for sparsely-activated MoE models removes bad experts to address full expert bank memory bottleneck while preserving inference efficiency.

arXiv cs.CL·arxiv.org·23h ago·1.5Researchmoe pruning llm

Structured Pruning of Large Language Models via Power Transformation and Sign-Preserving Score Aggregation with Adaptive Feature Retention

AI·The paper proposes structured pruning for LLMs using power transformation and sign-preserving score aggregation with adaptive feature retention to address distribution mismatch issues.

arXiv cs.CL·arxiv.org·23h ago·1.4Researchpruning llm structured