XFP: Quality-Targeted Adaptive Codebook Quantization with Sparse Outlier Separation for LLM Inference
Source published ·Modelwire updated
Original coverage: arXiv cs.LG ↗·How Modelwire adds context
The development
XFP introduces a fundamentally different approach to LLM weight quantization by inverting the typical workflow: instead of engineers choosing bit-widths and calibration strategies upfront, the system accepts quality targets per layer and automatically determines codebook size, outlier budgets, and compression ratios. By separating sparse high-magnitude weights as fp16 residuals and packing the remainder into learned per-group codebooks, XFP eliminates manual tuning and Hessian computation while achieving competitive decode throughput on 122B-parameter models. This shift toward specification-driven quantization could reshape how practitioners approach inference optimization, particularly for mixture-of-experts architectures where layer heterogeneity demands adaptive strategies.
Modelwire’s AI-generated summary of coverage from arXiv cs.LG.
Modelwire analysis
ExplainerOur AI-generated reading of the wider context and the next developments to watch.
The genuinely underappreciated detail here is that XFP sidesteps Hessian computation entirely, which is the expensive calibration step that makes methods like GPTQ slow to apply at scale. That omission is doing a lot of work in the paper's efficiency claims and deserves more scrutiny than the throughput numbers alone.
The related coverage this week is largely disconnected from XFP's concerns. The trajectory-forecasting paper on NBA movement and the trust-region optimizer for distributed training both touch neural network methodology, but neither addresses inference-time compression or the specific pressures of deploying hundred-billion-parameter models. XFP belongs to a separate and active thread in the field: making large models cheap enough to serve without retraining, a problem that has grown more acute as mixture-of-experts architectures like the Qwen3.5-122B-A10B referenced here become more common. The heterogeneity of MoE layers is precisely what makes fixed-bit quantization brittle, and that is the practical gap XFP is targeting.
Watch whether independent reproducers can match the reported throughput on non-Qwen MoE architectures within the next few months. If the quality-target specification holds across architectures with different sparsity profiles, the Hessian-free claim becomes much more credible.
This interpretation is generated from the summary above and available source metadata. Our methodology · Report an error
MentionsXFP · Qwen3.5-122B-A10B · Lloyd · MoE
How this coverage is produced
Modelwire uses AI to generate summaries and context from source headlines, snippets, and selected archive coverage. Automated checks do not verify every claim, and items are not routinely reviewed by a person before publication. Zacaria Solis operates the site. Read the linked source for the full evidence and report errors through our corrections process.
Modelwire summarizes, we don’t republish. The full content lives on arxiv.org. If you’re a publisher and want a different summarization policy for your work, see our takedown page.