AI agents are fundamentally changing the landscape of software security by collapsing the cost of finding and exploiting patches. These agents can meticulously review every commit, identifying security-related changes, meaning that the obviousness of a fix no longer provides protection. Models can analyze simple commits, even those not explicitly labeled as security fixes, and then trivially generate methods to exploit older software versions.
Theo pointed out that frontier AI labs are often willing to generate demo exploits when asked, for example, to create a demonstration of how to exploit a recently merged security fix for a class. Open-weight models are almost certainly capable of complying with such requests. This development means that the primary remaining factors in exploit success are how quickly patches are deployed and the extent of access the exploit grants to attackers.
The severity of an exploit is now paramount, as exemplified by the FBI tweeting about the PHP exploit. This particular vulnerability, classified as a CVE, could allow malicious cyber actors to remotely execute code in PHP Core, potentially compromising sensitive data and networks. The FBI urged organizations to immediately update affected PHP installations or, if not feasible, take systems offline until mitigation is complete. They also recommended inventorying PHP installations, prioritizing internet-facing systems, and monitoring web servers for suspicious activity, such as PHP processes unexpectedly launching command shells.