OpenAI has taken a more aggressive approach to red teaming than its AI competitors, demonstrating its security teams' advanced capabilities in two areas: multi-step reinforcement and external red ...

Red teaming is a powerful way to uncover critical security gaps by simulating real-world adversary behaviors. However, in practice, traditional red team engagements are hard to scale. Usually relying ...

In case you missed it, OpenAI yesterday debuted a powerful new feature for ChatGPT and with it, a host of new security risks and ramifications. Called the "ChatGPT agent," this new feature is an ...

Nearly every organization today works with digital data—including sensitive personal data—and with hackers’ tactics becoming more numerous and complex, ensuring your cybersecurity defenses are as ...

Microsoft says it needs to strengthen trust in AI, which cannot be achieved without a full understanding of the changes AI generates. In Microsoft’s AI Red Team, alongside cybersecurity experts, ...

As generative AI transforms business, security experts are adapting hacking techniques to discover vulnerabilities in intelligent systems — from prompt injection to privilege escalation. AI systems ...

A tool for red-team operations called EDRSilencer has been observed in malicious incidents attempting to identify security tools and mute their alerts to management consoles. Researchers at ...

The group responsible for red teaming of over 100 generative AI products at Microsoft has concluded that the work of building safe and secure AI systems will never be complete. In a paper published ...