Prompt-Guard-86M · azureml-meta v1 ↗
- source model id
- azureml-meta/Prompt-Guard-86M@1
- hosting
- foundry-managed-compute
- platforms
- Microsoft Foundry
- license
- custom
- architecture
- input_modalities
- output_modalities
- capabilities
# Model Information LLM-powered applications are susceptible to prompt attacks, which are prompts intentionally designed to subvert the developer’s intended behavior of the LLM. Categories of prompt …
azureFoundry/azureml-meta/Prompt-Guard-86M@1
LLM-powered applications are susceptible to prompt attacks, which are prompts intentionally designed to subvert the developer’s intended behavior of the LLM. Categories of prompt attacks include prompt injection and jailbreaking:
Prompt Injections are inputs that exploit the concatenation of untrusted data from third parties and users into the context window of a model to get a model to execute unintended instructions.
Jailbreaks are malicious instructions designed to override the safety and security features built into a model.
Prompt Guard is a classifier model trained on a large corpus of attacks, capable of detecting both explicitly malicious prompts as well as data that contains injected inputs. The model is useful as a starting point for identifying and guardrailing against the most risky realistic inputs to LLM-powered applications; for optimal results we recommend developers fine-tune the model on their application-specific data and use cases.
1–1 / 1
1–1 / 1
31 / 100
1–4 / 4
Microsoft Foundry · Model page ↗
1–2 / 2
These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.