Data Attribution in Large Language Models via Bidirectional Gradient Optimization
Researchers have developed a method to trace which training data most influenced specific LLM outputs, addressing a critical gap in model transparency and accountability. By applying bidirectional gradient optimization to generated text, the approach measures how training samples would shift if the model had encountered the output during training. This work matters for governance and liability: as LLMs face scrutiny over data provenance and copyright claims, the ability to attribute outputs to specific training examples becomes essential for auditing, debugging model behavior, and defending against infringement allegations. The technique scales across granularity levels, supporting both factual and stylistic attribution.62
