Safety
Jailbreak
A prompt crafted to get a model to ignore its safety rules and produce content it would normally refuse.
Providers continually train models to resist jailbreaks. For applications, layered guardrails matter more than relying on the model alone.
Frequently asked questions
What does Jailbreak mean?
A prompt crafted to get a model to ignore its safety rules and produce content it would normally refuse. Providers continually train models to resist jailbreaks. For applications, layered guardrails matter more than relying on the model alone.