Meta disclosed that its Catching Just-in-Time Tests (JiTTests) system, which uses large language models to generate software tests on the fly, is now deployed in production infrastructure1. In the first half of 2026, the system caught 74 serious privacy bugs at the diff stage before they reached production and lowered overall privacy SEV occurrence by 20%. Of the 589 engineers who engaged with the tool, representing 64% of Meta's outreach, 60% of flagged issues were reported as true positives. The accompanying paper, "Just-in-Time Catching Test Generation at Meta," details the deployment.
Meta Deploys LLM Bug-Detection System Across Codebase
Meta's Catching JiTTests, an LLM-based testing system, caught 74 serious privacy bugs and reduced privacy SEVs by 20% in the first half of 2026.
1Catching Bugs Before They Land: JiTTesting’s Human-on-the-Loop Approach at Full Scaleengineering.fb.comHigh10·29 16:00Z
Was this useful?
The day’s vector, in your inbox.
Vector Wire Daily: one dispatch each publishing day.