TeleTune learns agent skills from unlabeled user logs without replay
Source published ·Modelwire updated
Original coverage: arXiv cs.CL ↗·How Modelwire adds context
The development
TeleTune addresses a critical bottleneck in agent development: extracting reusable procedural knowledge from unstructured user logs without goal annotations or replay capability. The framework tackles three hard problems endemic to learning from telemetry data, enabling agents to build skill libraries from real-world software interaction patterns at scale. This matters because computer-use agents remain data-hungry and goal-specification remains expensive. Solving offline learning from messy logs could accelerate agent training pipelines and reduce reliance on synthetic or hand-labeled datasets, shifting how teams approach agent capability development.
Modelwire’s AI-generated summary of coverage from arXiv cs.CL.
Modelwire analysis
ExplainerOur AI-generated reading of the wider context and the next developments to watch.
TeleTune's core novelty is handling three specific failure modes when extracting skills from raw telemetry: sparse annotations, no replay access, and procedural knowledge buried in unstructured interaction sequences. The framework doesn't require success/failure labels or the ability to re-run trajectories, which is what makes it applicable to production logs where those signals are often missing or expensive to obtain.
This directly extends the conversation started in 'Mining Agent Skills from Production Traces' (October 5), which tested six combinations of training evidence and found that unlabeled mixed traces can preserve downstream performance when ground truth is unavailable. TeleTune appears to operationalize that finding by providing a concrete method to extract reusable skills from exactly that scenario. The related work on the Agent Error Dataset (September 30) also shares the same premise: production systems generate rich behavioral data that current training pipelines discard. TeleTune and AutoSynthData (October 2) represent complementary approaches to the same economic problem: reducing reliance on hand-labeled or synthetic data by mining what's already there.
If TeleTune's skill libraries transfer to downstream tasks with >80% of the performance of skills trained on goal-annotated data, that validates the core claim. Watch whether the arXiv paper includes cross-domain transfer experiments (skills learned from one software domain applied to a different one) within the next two weeks, as that would signal whether the extracted procedures are genuinely reusable or domain-specific artifacts.
This interpretation is generated from the summary above and the archive coverage cited below. Our methodology · Report an error
Coverage behind this analysis
These archive entries ground the connection in our analysis. They are ordered by source publication date, with links to our coverage and the original sources.
·arXiv cs.CL
Extracting agent skills from unlabeled production traces improves scalability
Researchers are investigating how to extract reusable agent skills from production execution traces without manual curation, a shift that could accelerate autonomous system development at scale. The work examines a critical practical constraint: production environments often lack reliable success/failure labels. By testing six combinations of training evidence (successful runs only, labeled outcomes, unlabeled mixed traces)…
MentionsTeleTune
How this coverage is produced
Modelwire uses AI to generate summaries and context from source headlines, snippets, and selected archive coverage. Automated checks do not verify every claim, and items are not routinely reviewed by a person before publication. Zacaria Solis operates the site. Read the linked source for the full evidence and report errors through our corrections process.
Modelwire summarizes, we don’t republish. arXiv cs.CL originally reported this story as “TeleTune: Evolving Agent Skills From Offline Telemetry”. The full content lives on arxiv.org. If you’re a publisher and want a different summarization policy for your work, see our takedown page.