AI security

Prompt injection

Crafted input changes model behaviour, because a language model makes no architectural distinction between instructions and data.

There is no reliable prevention, which makes it an architecture problem rather than a filtering one. The defence that survives contact with an attacker is bounding what a compromised model is permitted to do.

Explained in depth

Learn it in context

Related concepts