OpenAI Upgrades GPT-6 Prompt Caching with Breakpoints, Diagnostics
OpenAI disclosed improvements to prompt caching for GPT-6, introducing higher cache hit rates, explicit breakpoints, new diagnostics, and additional controls designed to reduce latency and costs . The update expands developer tooling around…
CoreWeave Adds IAM, Remote Key Encryption for Enterprise AI
CoreWeave announced CoreWeave IAM and Remote Key Encryption, two capabilities designed to let enterprises federate existing identity and key management infrastructure into CoreWeave's cloud platform without rebuilding security systems . The…
Snowflake Adds AI Agent Observability to Observe Platform
Snowflake disclosed that its Observe platform will gain Agent Observability capabilities, entering private preview soon . The feature derives latency, error, token usage, and estimated cost signals from agent traces, enabling teams to monit…
Shopify Cuts AI Serving Costs 96% With Continual Learning Loop
Shopify built a continual learning loop using PyTorch and vLLM that compresses production failures into fine-tuned model weights daily, reducing estimated annual serving costs from $27 million on a frontier model to approximately $1 million…
ALL BRIEFS
RANKED · 7 THIS DAYArize Phoenix Evals Adds AI SDK Evaluation Model Support
Arize AI released phoenix-evals version 2.6.0, enabling classification evaluators to accept AI SDK evaluation models, including TypeSafe AI's Jev . When an evaluation model is passed, classification routes through experimental_evaluate as a…
Meta's Muse AI agent faces second security crisis as permissions disputes and Amazon block compound zero-day fallout
Meta's MUSE AI agent is contending with a widening set of security and trust problems: a separate vulnerability that could have exposed users' cloud-hosted virtual machines, a disputed claim that the agent read a journalist's private messag…
AWS open-sources Strands Harness, claims 45% cost edge over Claude Code and Codex
AWS released Strands Harness on September 21, a general-purpose, open-source AI agent that the company says matched rival coding agents on benchmarks while consuming significantly fewer tokens . Strands Harness builds on the Strands Agents…