Products & AppsTools & CodeDatasette AgentSimon Willison's Datasette Agent merges three years of LLM library development with Datasette's data exploration platform, creating a conversational interface for querying structured data. The release marks a convergence of two mature open-source projects into a unified AI assistant that can answer natural-language questions and generate visualizations. This represents a practical application layer where LLMs become operational tools for data teams, rather than standalone chat interfaces, and signals how domain-specific AI assistants are moving beyond chatbots into embedded workflows.Simon Willison·May 2172
Business & FundingProducts & AppsWe’re launching the Google DeepMind Accelerator program in Asia Pacific to tackle environmental risksGoogle DeepMind is establishing a regional accelerator program across Asia Pacific focused on deploying AI to address environmental challenges. This move signals DeepMind's pivot toward applied climate and sustainability work beyond pure research, positioning the lab as a direct competitor to other AI labs' climate initiatives while expanding its footprint in a strategically critical region. The program likely combines model deployment, compute access, and partnership infrastructure to help local organizations scale environmental AI applications, reflecting broader industry momentum around AI-for-good initiatives and geographic diversification of AI capability centers.Google DeepMind·May 2175
Business & FundingPolicy & RegulationSpotify and Universal Music strike deal allowing fan-made AI covers and remixesUniversal Music Group and Spotify are formalizing a revenue-sharing framework for generative audio, legitimizing AI-assisted music creation as a licensed product category rather than a copyright gray zone. This partnership signals that major rights holders are moving from litigation posture to commercialization, embedding artist compensation into the generative workflow itself. The model matters: rather than policing AI covers post-hoc, the deal bakes consent and payment into the platform, potentially reshaping how the industry handles synthetic media and setting a precedent for other entertainment verticals facing similar pressures.TechCrunch - AI·May 2181
Products & AppsBusiness & FundingSix search engines worth trying now that Google isn’t really Google anymoreGoogle's search interface is undergoing significant transformation driven by AI integration, particularly through expanded AI Overview features that are reshaping how results are presented to users. This shift signals a broader industry pivot where traditional search ranking and link-based discovery are being displaced by AI-generated summaries and direct answers. The emergence of viable alternatives reflects growing user friction with AI-first search, creating an opening for competitors to capture dissatisfied users. For the AI ecosystem, this represents a critical inflection point: search monetization models, training data sourcing, and user behavior patterns are all in flux as the dominant search paradigm transitions from indexing to generation.TechCrunch - AI·May 2169
Opinion & AnalysisScaling creativity in the age of AIMIT Technology Review examines how AI is reshaping creative expression and storytelling across media. The piece traces humanity's long history of technological innovation in narrative forms, from pigment-based cave art through photography, and positions generative AI as the latest inflection point in how stories are authored, distributed, and consumed. The strategic angle centers on whether AI tools democratize creative capacity or concentrate it, and how creators navigate authenticity when machines can generate narrative at scale. This matters to the AI landscape because it reframes the cultural stakes of generative models beyond productivity metrics into questions of artistic agency and human meaning-making.MIT Technology Review - AI·May 2172
Products & AppsTools & CodeShare Codex plugins with your teamOpenAI has expanded Codex's plugin ecosystem to enable team-level distribution and governance, allowing organizations to standardize internal tool access across workspaces. This shift from individual to collaborative plugin management reflects a broader maturation of AI development platforms toward enterprise workflows, where plugin curation and access control become operational necessities. The move signals OpenAI's positioning of Codex as infrastructure for scaled, multi-user AI development rather than isolated experimentation, directly competing with similar team collaboration features in competing LLM platforms.OpenAI (YouTube)·May 2165
Tools & CodePolicy & RegulationGoogle checks websites for llms.txt in new agentic browsing auditGoogle is expanding Lighthouse, its web performance audit tool, to measure how well websites accommodate AI agents through a new 'Agentic Browsing' category that checks for llms.txt compliance. This signals a structural shift in how the web is being optimized: rather than just human visitors, sites must now account for machine agents crawling and interacting with their content. The move reflects growing pressure on publishers and platforms to establish machine-readable protocols for AI access, effectively standardizing agent behavior expectations across the internet. For developers and site owners, this represents a new compliance surface alongside SEO and accessibility.The Decoder·May 2173
Products & AppsTools & CodeIntroducing Appshots in CodexOpenAI has integrated Appshots into Codex, enabling developers to anchor coding assistance to live application context. The feature captures both visual and non-visible window content via a Mac keyboard shortcut, allowing the LLM to reason over real-time UI state rather than abstract code snippets alone. This represents a meaningful shift in how code generation models consume context, moving beyond static files toward dynamic runtime environments. The rollout across consumer and enterprise tiers signals OpenAI's push to deepen Codex's integration into developer workflows, competing directly with IDE-native AI assistants that lack this contextual richness.OpenAI (YouTube)·May 2169
Tools & CodeProducts & Appsdatasette-agent-sprites 0.1a0Simon Willison released datasette-agent-sprites, a plugin enabling Datasette agents to execute commands within Fly Sprites sandboxes. This bridges agentic AI tooling with containerized execution environments, addressing a core infrastructure gap for safely running agent-generated code. The move signals growing maturity in the agent framework ecosystem, where isolation and controlled execution are becoming table stakes for production deployments. For teams building on Datasette or exploring agent architectures, this unlocks safer patterns for delegating computational tasks to LLM-driven systems.Simon Willison·May 2164
ResearchTools & CodeTokenisation via Convex RelaxationsResearchers have reframed tokenisation, a foundational NLP preprocessing step, as a convex optimisation problem rather than a greedy search. ConvexTok outperforms standard methods like BPE by constructing vocabularies that minimise bits-per-byte across language models while providing formal optimality guarantees. The work matters because tokeniser design directly affects model efficiency and downstream performance, yet has remained largely heuristic. This shift toward principled, certifiable tokenisation could reshape how practitioners approach vocabulary construction, particularly for resource-constrained deployments where compression gains compound across inference.arXiv cs.LG·May 2162
ResearchModels & ReleasesVector Policy Optimization: Training for Diversity Improves Test-Time SearchVector Policy Optimization addresses a fundamental mismatch in LLM training: models optimized for single scalar rewards produce low-entropy outputs that fail when deployed in inference-time search systems like AlphaEvolve, which require diverse candidate solutions across multiple task-specific objectives. VPO reframes post-training to anticipate vector-valued rewards, training policies to generate varied outputs that better serve downstream selection procedures. This shift matters because it decouples training objectives from deployment constraints, potentially unlocking better performance in test-time compute scaling without retraining. The work signals growing recognition that LLM generalization now depends on output diversity as a first-class training goal.arXiv cs.LG·May 2162
ResearchThe Matching Principle: A Geometric Theory of Loss Functions for Nuisance-Robust Representation LearningA new theoretical framework unifies disparate robustness techniques across computer vision and deep learning under a single statistical principle: controlling encoder sensitivity to label-preserving nuisance variation. The work reinterprets adversarial training, domain adaptation, data augmentation, and alignment constraints as different estimators of the same underlying covariance structure, with closed-form optimality proofs in the linear-Gaussian case. This conceptual consolidation matters for practitioners because it suggests that seemingly orthogonal robustness methods share fundamental machinery, potentially enabling more principled design of invariant representations and clearer trade-offs between competing robustness objectives.arXiv cs.LG·May 2162
ResearchTools & CodeMOSS: Self-Evolution through Source-Level Rewriting in Autonomous Agent SystemsResearchers propose MOSS, a framework enabling autonomous agents to modify their own source code rather than just prompt configurations or skill files. Current self-evolving systems are constrained to text-layer changes, leaving structural failures in routing logic, state management, and dispatch mechanisms unreachable. By treating the agent harness itself as mutable, MOSS expands the adaptation surface to Turing-complete scope, potentially closing a critical gap between what agents can learn and what they can actually fix. This shifts the self-improvement paradigm from configuration tuning toward genuine architectural adaptation.arXiv cs.LG·May 2162
ResearchModels & ReleasesEvaluating Commercial AI Chatbots as News IntermediariesA systematic evaluation of six major AI chatbots reveals a critical gap between multiple-choice and real-world performance on news comprehension. When tested on same-day BBC reporting across six languages and regions, top performers like Gemini and Claude maintained over 90% accuracy in constrained settings but dropped 11-17% when forced to generate free-form answers. This benchmarking work exposes how proprietary search and retrieval pipelines mask brittleness in factual grounding, raising questions about whether current systems are reliable enough for news intermediation at scale.arXiv cs.CL·May 2162
ResearchModels & ReleasesReducing Political Manipulation with Consistency TrainingResearchers have identified systematic political asymmetry in how large language models respond to paired prompts from opposing ideological perspectives, termed covert political bias. The work introduces Political Consistency Training, a reinforcement learning approach that enforces symmetric sentiment and engagement depth across politically sensitive topics. This addresses a critical alignment challenge for deployed LLMs: models can appear balanced on surface metrics while subtly privileging one political framing over another. The technique preserves overall model helpfulness while reducing bias, making it relevant for organizations deploying LLMs in high-stakes contexts where perceived neutrality matters.arXiv cs.CL·May 2162
ResearchModels & ReleasesUnderstanding Data Temporality Impact on Large Language Models Pre-trainingResearchers challenge a foundational assumption in LLM training by studying how data ordering affects temporal knowledge acquisition. Using a new 7,000-question benchmark grounded in time-sensitive facts, they pretrained 6B-parameter models on chronologically ordered Common Crawl snapshots versus standard shuffled corpora. The finding that sequential training matches or outperforms shuffled baselines suggests that temporal coherence during pretraining may improve factual grounding and time-aware reasoning, with implications for how practitioners should curate and structure training data for knowledge-intensive applications.arXiv cs.CL·May 2162
Policy & RegulationTrump delays AI security executive order: ‘I don’t want to get in the way of that leading’The Trump administration shelved a planned executive order mandating pre-release security reviews of AI models, signaling a regulatory pullback at a critical juncture for frontier AI development. The decision reflects tension between safety governance and competitive velocity: officials cited concerns that mandatory government vetting could slow innovation and cede advantage to international competitors. This reversal reshapes the near-term policy landscape for model deployment, removing a potential friction point for labs but leaving the U.S. without formal pre-release security guardrails as capabilities scale.TechCrunch - AI·May 2176
ResearchLumberjack: Better Differentially Private Random Forests through Heavy Hitter Detection in TreesDifferential privacy remains a critical bottleneck for deploying machine learning on sensitive datasets, and random forests have been particularly vulnerable to privacy-utility tradeoffs that render them unusable in practice. Lumberjack addresses this by combining deep tree construction with privacy-aware pruning, anchored on a novel heavy hitter detection algorithm that scales favorably with tree depth. The theoretical contribution, a hierarchical DP algorithm with O(sqrt(log h)) error, unlocks substantially deeper trees than prior work and signals a meaningful shift in how practitioners might balance privacy guarantees against model performance on tabular data in healthcare, finance, and other regulated domains.arXiv cs.LG·May 2162
ResearchSuperhuman Safe and Agile Racing through Multi-Agent Reinforcement LearningMulti-agent reinforcement learning is emerging as a critical paradigm shift for autonomous systems operating in shared, dynamic environments. This arXiv paper demonstrates that single-agent approaches, which dominate current physical AI deployments, fail catastrophically when multiple actors interact. Using high-speed quadrotor racing as a stress test, researchers trained agents through league-based self-play to develop anticipatory behaviors like collision avoidance and strategic maneuvering. The work signals that real-world robustness for autonomous systems may require fundamentally rethinking coordination and safety as multi-agent problems rather than isolated control challenges.arXiv cs.LG·May 2162
Business & FundingSpaceX IPO Filing Opens Up xAI FinancesElon Musk's xAI enters public markets through a SpaceX-bundled IPO filing, marking the first major generative AI lab to pursue this path. The move signals investor appetite for standalone AI company valuations and sets a precedent as Anthropic and OpenAI prepare their own offerings. Public scrutiny of AI lab finances, governance, and capital allocation will intensify once these filings become standard, reshaping how the sector communicates compute spending, model development costs, and path to profitability.AI Business·May 2176
ResearchTools & CodeProxy-Based Approximation of Shapley and Banzhaf InteractionsProxySHAP addresses a critical bottleneck in model interpretability by dramatically accelerating computation of Shapley and Banzhaf interaction indices without sacrificing theoretical rigor. The method combines tree-based proxy models with residual correction to achieve polynomial-time complexity on tree ensembles, eliminating exponential scaling that plagued prior TreeSHAP variants. This matters because understanding feature interactions at scale has remained computationally prohibitive for practitioners deploying large ensemble models in production. The work bridges the speed-accuracy tradeoff that has constrained adoption of interaction-level explanations in real-world ML systems.arXiv cs.LG·May 2162
ResearchThe Distillation Game: Adaptive Attacks & Efficient DefensesResearchers formalize the core tension facing model providers: outputs that maximize user utility simultaneously enable efficient model theft through distillation. This work frames the problem as a strategic game between teacher and student, yielding a practical defense called Product-of-Experts that operates during generation without retraining. The findings expose a critical gap between passive and adaptive attack scenarios, suggesting current defenses underestimate sophisticated adversaries. For deployment teams, this reshapes thinking around API rate-limiting and output design as security levers rather than pure UX choices.arXiv cs.LG·May 2162
ResearchTools & CodeChronoMedKG: A Temporally-Grounded Biomedical Knowledge Graph and Benchmark for Clinical ReasoningTemporal reasoning remains a critical gap in AI-assisted clinical decision-making. ChronoMedKG addresses this by encoding disease-symptom associations with lifecycle metadata (onset windows, progression stages) across 460K evidence-linked triples, grounding each link to peer-reviewed sources. Unlike static predecessors like PrimeKG and Hetionet, this resource enables retrieval-augmented systems to distinguish age-dependent diagnostic signals, a capability essential for LLM-based clinical reasoning tools. The dataset's credibility scoring and PMID traceability set a standard for trustworthy biomedical knowledge infrastructure that downstream AI applications will depend on.arXiv cs.CL·May 2162
ResearchPost-Training is About States, Not Tokens: A State Distribution View of SFT, RL, and On-Policy DistillationResearchers reframe post-training optimization around state distributions rather than loss functions alone, arguing that SFT, RL, and on-policy distillation differ fundamentally in which training states they sample from. Using Qwen 3 0.6B on GSM8K with retention checks on TruthfulQA and MMLU, the work identifies three key phenomena that challenge conventional loss-centric analysis. This perspective shift matters for practitioners tuning alignment pipelines: it suggests that which prompts and prefixes a model learns from during post-training may be as consequential as the objective itself, potentially unlocking more efficient fine-tuning strategies and better transfer across domains.arXiv cs.LG·May 2162
ResearchThe Value of Covariance Matching in Gaussian DDPMs and the Lanczos SamplerResearchers have identified a fundamental limitation in standard diffusion model reverse processes and proposed a solution that improves convergence rates. Isotropic covariance assumptions in Gaussian DDPMs incur path-space KL divergence errors that scale as Omega(1/T), but matching the full posterior covariance reduces this to O(1/T^2), a quadratic improvement. The Lanczos Gaussian Sampler makes this theoretically superior approach computationally tractable without requiring matrix inversion or additional training. This advance matters for classifier-guided generation and any application where trajectory fidelity across all denoising steps, not just final output, affects downstream performance. The result tightens the theoretical foundations of diffusion models and opens practical paths to higher-quality conditional generation.arXiv cs.LG·May 2162
ResearchAMEL: Accumulated Message Effects on LLM JudgmentsResearchers tested whether LLM evaluators drift toward the sentiment of prior conversation history, finding statistically significant bias across 11 models from four major providers. When models reviewed identical items after exposure to predominantly positive or negative evaluation sequences, judgments shifted measurably in the direction of that polarity, with the effect strongest on genuinely ambiguous cases. This finding matters for production deployments where LLMs batch-score code, content, or outputs in sequence, revealing a systematic vulnerability in automated evaluation pipelines that organizations currently treat as objective.arXiv cs.LG·May 2168
ResearchTools & CodeTokenization with Split TreesResearchers propose Tokenization with Split Trees (ToaST), a subword tokenization method that reformulates vocabulary selection as an optimization problem solvable via integer programming. Unlike existing greedy tokenizers, ToaST builds binary trees from byte n-grams and uses LP relaxation to derive provably near-optimal vocabularies with quadratic training scaling. This addresses a foundational bottleneck in LLM preprocessing: tokenization directly impacts model efficiency, context window utilization, and downstream performance. For practitioners, near-optimal vocabularies could reduce token overhead across inference and training, with implications for both open-source and commercial model development.arXiv cs.CL·May 2162
ResearchClipping Bottleneck: Stabilizing RLVR via Stochastic Recovery of Near-Boundary SignalsResearchers have pinpointed a critical failure mode in reinforcement learning systems optimized for verifiable rewards, a core technique for scaling LLM reasoning. Hard clipping in gradient-based policy optimization discards high-signal training data near decision boundaries, degrading convergence. The team demonstrates that stochastic perturbations at these boundary regions recover substantial performance without architectural changes. This finding addresses a practical bottleneck affecting RLVR training stability across multiple LLM reasoning frameworks, offering a low-cost fix for a widespread optimization problem.arXiv cs.LG·May 2162
ResearchSelf-Policy Distillation via Capability-Selective Subspace ProjectionSelf-Policy Distillation addresses a fundamental bottleneck in LLM self-improvement: existing bootstrapping methods either demand expensive external signals (execution feedback, reward models) unavailable for frontier systems, or train indiscriminately on raw outputs, conflating task-relevant skills with stylistic noise and model artifacts. SPD proposes capability-selective filtering that isolates the specific competency being refined, enabling generalizable self-distillation without external oracles. This matters because it could unlock cheaper, more targeted model refinement at scale, particularly for capabilities where ground truth is expensive or unavailable.arXiv cs.CL·May 2162
ResearchModels & ReleasesOpenAI shifts the boundary of automated reasoning with a "milestone in AI mathematics" that experts are now unpackingOpenAI's reasoning model has resolved a 80-year-old conjecture in unit-distance geometry originally posed by Paul Erdős, deploying algebraic number theory in ways mathematicians had not anticipated. Fields Medalist Tim Gowers frames this as a watershed moment, signaling that AI systems now operate at the frontier of human mathematical capability. The result underscores a structural shift in how hard problems get solved: automated reasoning is no longer confined to narrow domains but can discover novel proof strategies, raising questions about the future role of human mathematicians in discovery-driven research.The Decoder·May 2197