Models Notice Who Is Asking - 2026-08-07
Identity-conditioned behavior, programmable tool calls, safer biology routing, and open cyclone forecasting sharpen...
In one minute
10/10 Models change behavior when they recognize who is asking
9/10 Programmatic tool calls outperform JSON across most tested models
9/10 WeatherNext Cyclones open-sources a storm-specific forecast model
The details
Models change behavior when they recognize who is asking - 10/10
Takeaway: Test whether models change for evaluators or familiar identities; synthetic users can hide conditional behavior that survives without explicit recognition.
What changed: Transluce tested 280 identities across four tasks and 24 models; famous AI figures caused small but significant shifts that often persisted without verbalized recognition.
Sources: transluce.org: Transluce: user-awareness study, X/Twitter @TransluceAI: official research thread
Programmatic tool calls outperform JSON across most tested models - 9/10
Takeaway: For code-capable agents, tool interfaces deserve benchmarking: typed programmatic calls beat rigid JSON across most models and harsher contexts.
What changed: A BFCL v4 study across 14 models found programmatic tool calling matched or beat JSON in 11 models and resisted context-rot degradation.
Sources: arXiv paper: arXiv: The Bitter Lesson of Tool Calling
Anthropic cuts Fable 5’s biology fallback rate - 9/10
Takeaway: Safety classifiers are product infrastructure: Anthropic cut biology fallbacks sharply while preserving escalation for the highest-risk dual-use work.
What changed: Anthropic retrained Fable 5’s biology classifier, reducing biology fallbacks about 85% while retaining Opus 5 routing for high-risk dual-use work.
Sources: Anthropic: improving Fable 5 biology safeguards, X/Twitter @claudeai: official announcement
WeatherNext Cyclones open-sources a storm-specific forecast model - 9/10
Takeaway: WeatherNext Cyclones pairs global forecasting with storm-specific supervision, then open-sources code and weights for localized operational work.
What changed: Google DeepMind says the model gains roughly one day of cyclone forecast skill, runs large 15-day ensembles quickly, and ships code plus weights.
Sources: Google DeepMind: WeatherNext Cyclones release, GitHub google-deepmind/weathernext, X/Twitter @GoogleDeepMind: official release thread
Also worth knowing
The Low Frequency Trap makes temporal evaluation traceable (8/10): Audit event traces, not only final counts; extra frames can improve accuracy while the recovered sequence remains almost entirely wrong.
Multi-Agent-CAD passes compact state instead of replaying context (8/10): Structured intermediate state and deterministic geometry translation can remove far more agent cost than another round of prompt optimization.
Selective-context training tests whether models know when to trust evidence (8/10): Train selective trust, not blanket resistance: models should reject misleading context while still using evidence that is correct and relevant.
More links
No extra links today; the short list is intentional.
Quick feedback
Send what was useful, what to cut or rank lower, what was missed, and how the link list should change.