{"revision":"c10276e953456835cdbb1f3a60d58ae1980be353","document":{"id":41709,"path":"platform-security/now-assist-guardian.md","title":"AI Guardian","bundle":null,"doc_type":null,"release":"australia","body":"\n# AI Guardian\n\nAI Guardian is built on the ServiceNow Small Language Model \\(SLM\\) and monitors generative AI interactions to detect offensive content, prompt injection attacks, and sensitive topics.\n\n## AI Guardian Overview\n\nGenerative AI is an emerging technology. Human interactions are unpredictable, and outputs generated by large language model \\(LLM\\) are probabilistic, which means that they're based on probabilities. Running the same input twice may generate two different outputs. Managing this risk is an important consideration when implementing generative AI on your instance. AI Guardian evaluates requests sent to LLMs and their responses in real-time to reduce that risk.\n\n## Guardrails\n\nAI Guardian provides three guardrails. Each guardrail has a different scope of applicability:\n\n|Guardrail|What it detects|Scope|\n|---------|---------------|-----|\n|Offensiveness detection|Offensive or harmful content in AI inputs and outputs.|Specific Now Assist skills and workflows.|\n|Prompt injection detection|Attempts to override LLM instructions or expose restricted information.|All generative AI applications and features. You can configure prompt injection detection at the instance level or for individual skills.|\n|Sensitive topic filters|Subjects not suited for AI responses, such as workplace safety or employee compensation.|Virtual Agent conversational skills only \\(available for HR Service Delivery and Customer Service Management\\).|\n\n**Note:** The scope of each guardrail differs. Prompt injection detection applies to all generative AI applications and features. Offensiveness detection applies only to supported Now Assist skills and workflows. Sensitive topic filters apply only to Virtual Agent conversations and require HR Service Delivery.\n\n-   **Offensive content**\n\n    Due to the probabilistic nature of generative AI, it's possible for an LLM to generate offensive content. If there's offensive content in the input of the request, offensive content can also occur in the response. Examples of offensive content include language that is toxic, defamatory, or fraudulent.\n\n    When offensive content is detected, AI Guardian logs the event by default. You can also configure it to block the content. This guardrail applies to specific Now Assist skills and workflows.\n\n-   **Prompt injection**\n\n    Prompt injection is a type of security attack where someone tries to override the normal instructions of an LLM to access restricted information or cause unintended behaviors. AI Guardian detects prompt injection attempts by using an LLM trained on various types of prompt injection techniques, such as role playing, paraphrasing, repetition, instructions to ignore other instructions, and persuasion.\n\n    **Note:** Due to the probabilistic nature of the model and evolving attack techniques, AI Guardian may not identify every prompt injection attempt in some cases.\n\n    Prompt injection protection applies to all generative AI applications and features on your instance. You can configure it at the instance level or for individual skills. When a skill has its own setting, Now Assist Guardian automatically applies the more protective of the two settings, the skill-level setting or the instance-level setting.\n\n-   **Filtered subjects**\n\n    Certain subjects, such as workplace safety employee compensation, or personal well-being may not be best suited for generative AI responses. You can activate filters that detect these kinds of subjects in Virtual Agent conversations and redirect users to the Sensitivity Detection: Fallback Virtual Agent topic instead of generating an AI response.\n\n    **Note:** Sensitive topic filters apply only to Virtual Agent conversational skills. These filters are available only with HR Service Delivery and Customer Service Management.\n\n\n## Logging and blocking\n\nAI Guardian detects and logs events for offensive content and prompt injection attempts by default. You can access logs from **Now Assist Admin** &gt; **Settings** &gt; **Now Assist Guardian**. Log data includes information about the request, the conversation that contains the offensive content, and any user feedback.\n\nIn addition to logging, you can configure AI Guardian to block offensive content or prompt injection attempts. When blocking is enabled and content is detected, you see a standard error message instead of the generated response. The standard error message displays that the request couldn’t be completed, and you don't see what the AI generated. Before enabling blocking, review logs for a period of time to understand how frequently these issues occur in your environment.\n\n## Redirection for sensitive filtered topics\n\nAfter a filter detects a sensitive topic, AI Guardian redirects you to the Sensitivity Detection: Fallback topic in Virtual Agent. This topic can redirect you to a live agent or help you create an HR case.\n\nYou can override the redirection by selecting **Proceed, not sensitive**. It returns you to their original topic without initiating the fallback flow.\n\n**Note:** After you continue with the fallback topic, for example, by starting the flow to create an HR case, Virtual Agent does not continue detecting sensitive topics in that conversation.\n\n## AI Guardian at runtime\n\nAll skills that use AI Guardian remove personally identifiable information \\(PII\\) before the request reaches the LLM. You can configure what type of data is anonymized. For more information see, [Configuring Now Assist for Data Privacy](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/platform-security/data-privacy-classic/configure-now-assist-data-privacy.md).\n\nFor conversational skills, semantic search processes requests to determine whether a filter has been detected. If so, the user is redirected to a Virtual Agent topic that asks if they want to make an HR case or speak to a live agent.\n\n\\[Omitted image \"now-assist-guardian-filter-guardrail.png\"\\] Alt text: Infographic showing AI Guardian at runtime with sensitivity filter guardrail\n\nFor catalog item generation and agent skills, such as summarization and resolution note generation, offensiveness and prompt injection guardrails run on inputs and outputs of requests. If either is detected, AI Guardian logs the request. If you’ve chosen to block this content, then a standard error message appears, and the user doesn’t see the result of the request.\n\n\\[Omitted image \"now-assist-guardian-offensiveness-security-guardrails.png\"\\] Alt text: Infographic showing AI Guardian at runtime with offensiveness and security guardrails\n\n## Safety categories captured in AI Guardian logs\n\n<table><thead><tr><th>\n\nCategory\n\n</th><th>\n\nID\n\n</th><th>\n\nDescription\n\n</th></tr></thead><tbody><tr><td>\n\nViolent Crimes\n\n</td><td>\n\nS1\n\n</td><td>\n\nShould not: Enable, encourage, or endorse unlawful violence toward people or animals, including murder, assault, torture, kidnapping, and animal abuse.\n\n Can: Explain criminal justice systems, lawful reporting procedures, or home emergency preparedness.\n\n</td></tr><tr><td>\n\nNon-Violent Crimes\n\n</td><td>\n\nS2\n\n</td><td>\n\nShould not: Enable, encourage, or endorse non-violent crimes, including cybercrime, hacking, fraud, theft, drug trafficking, and money laundering.\n\n Can: Explain cybersecurity defense techniques, how systems work, or technical concepts like HTTP vs HTTPS.\n\n</td></tr><tr><td>\n\nSex-Related Crimes\n\n</td><td>\n\nS3\n\n</td><td>\n\nShould not: Enable, encourage, or endorse sex-related crimes, including sexual assault, rape, sexual coercion, sexual harassment, sex trafficking, and prostitution-related offenses.\n\n Can: Provide information about victim support services, domestic violence shelters, or lawful reporting procedures.\n\n</td></tr><tr><td>\n\nChild Sexual Exploitation\n\n</td><td>\n\nS4\n\n</td><td>\n\nShould not: Enable, encourage, or endorse child sexual abuse, including grooming, solicitation of explicit material, and child sexual abuse material.\n\n Can: Provide online safety education for parents or discuss unrelated academic topics.\n\n</td></tr><tr><td>\n\nSpecialized Advice\n\n</td><td>\n\nS5\n\n</td><td>\n\nShould not: Provide personalized medical diagnosis, case-specific legal strategy, individualized financial advice, or falsely assert that dangerous activities are safe without professional oversight.\n\n Can: Discuss general medical information, symptoms, or treatment programs.\n\n</td></tr><tr><td>\n\nPrivacy\n\n</td><td>\n\nS6\n\n</td><td>\n\nShould not: Contain sensitive personal information, including account credentials, government identifiers, financial details, location data, or medical records.\n\n Can: Discuss privacy policies and regulations, technical setup, or unrelated general tasks.\n\n</td></tr><tr><td>\n\nIntellectual Property\n\n</td><td>\n\nS7\n\n</td><td>\n\nShould not: Reproduce copyrighted works, lyrics, scripts, pirated software, or leak proprietary materials.\n\n Can: Discuss intellectual property law, write original content, or discuss research methodology.\n\n</td></tr><tr><td>\n\nIndiscriminate Weapons\n\n</td><td>\n\nS8\n\n</td><td>\n\nShould not: Enable, encourage, or endorse creation of chemical, biological, radiological, nuclear, or high-yield explosive weapons.\n\n Can: Discuss nonproliferation treaties, firearm safety, or CPR procedures.\n\n</td></tr><tr><td>\n\nHate\n\n</td><td>\n\nS9\n\n</td><td>\n\nShould not: Demean or dehumanize people based on race, ethnicity, religion, disability, sexual orientation, or gender identity.\n\n Can: Discuss history of hate speech laws, free speech principles, or cultural topics.\n\n</td></tr><tr><td>\n\nSuicide &amp; Self-Harm\n\n</td><td>\n\nS10\n\n</td><td>\n\nShould not: Enable, encourage, or endorse suicide, self-injury, eating disorders, or harm to others.\n\n Can: Provide warning sign information, medical treatment approaches, or unrelated scientific topics.\n\n</td></tr><tr><td>\n\nSexual Content\n\n</td><td>\n\nS11\n\n</td><td>\n\nShould not: Display sexually explicit material or content inappropriate for minors, including pornography, erotic chat, and sexual activity.\n\n Can: Create or discuss general unrelated content.\n\n</td></tr><tr><td>\n\nJailbreak Prompts / Prompt Injection\n\n</td><td>\n\nS12\n\n</td><td>\n\nShould not: Attempt to override safety instructions through direct commands, jailbreaks, or extraction attempts.\n\n Can: Discuss AI ethics, content moderation systems, or scientific principles.\n\n</td></tr></tbody>\n</table>## Skills that support offensive detection\n\n<table id=\"table_yz3_mqd_dbc\"><thead><tr><th class=\"filter\">\n\nWorkflow\n\n</th><th>\n\nApplication\n\n</th><th>\n\nSupported skills\n\n</th></tr></thead><tbody><tr><td>\n\nTechnology\n\n</td><td>\n\n[ServiceNow Otto for Configuration Management Database \\(CMDB\\)](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/servicenow-platform/now-assist-landing-cmdb.md)\n\n</td><td>\n\n-   [Configuration item \\(CI\\) summarization](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/servicenow-platform/na-cmdb-agent-ci-summarizer.md)\n-   [Manage duplicate CIs](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/servicenow-platform/now-assist-cmdb-mng-dupe-cis-skill.md)\n-   [Service Graph Connector diagnosis](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/servicenow-platform/now-assist-sgc-diagnose.md)\n\n</td></tr><tr><td>\n\nTechnology\n\n</td><td>\n\n\n\n</td><td>\n\n-   [Alert analysis](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/it-operations-management/alert-summarization-now-assist.md)\n-   [Alert investigation](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/it-operations-management/nai-analyze-past-incidents.md)\n\n</td></tr><tr><td>\n\nTechnology\n\n</td><td>\n\n[ServiceNow Otto for IT Service Management \\(ITSM\\)](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/it-service-management/now-assist-itsm.md)\n\n</td><td>\n\n-   [Change request risk explanation](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/it-service-management/change-risk-exp-now-assist.md)\n-   [Change request summarization](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/it-service-management/summarize-change-now-assist.md)\n-   [Chat reply recommendation](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/it-service-management/now-assist-itsm-chat-recommendation.md)\n-   [Chat summarization](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/it-service-management/generate-chat-summary-interaction-now-assist-itsm.md)\n-   [Incident assist](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/it-service-management/now-assist-itsm-incident-assist.md)\n-   [Incident summarization](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/it-service-management/summarize-incident-now-assist.md)\n-   [KB generation](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/it-service-management/Now-Assist-generate-article-SOW-itsm.md)\n-   [Resolution notes generation](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/it-service-management/resolve-incident-now-assist.md)\n-   [Sidebar discussion summarization](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/it-service-management/now-assist-itsm-sidebar-discussion.md)\n\n</td></tr><tr><td>\n\nTechnology\n\n</td><td>\n\n[ServiceNow Otto for Security Incident Response \\(SIR\\)](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/security-management/now-assist-security-incident-landing.md)\n\n</td><td>\n\n-   [Post-incident analysis](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/security-management/generate-pia-report-now-assist-security-incident.md)\n-   [Resolution notes generation](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/security-management/generate-closure-notes-si-now-assist-sec-incident.md)\n-   [Security incident recommended actions](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/security-management/generate-recommended-actions-now-assist-for-security.md)\n-   [Security incident summarization](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/security-management/summarize-security-incident-now-assist-sec-incident.md)\n\n</td></tr><tr><td>\n\nTechnology\n\n</td><td>\n\n[ServiceNow Otto for Strategic Portfolio Management](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/it-business-management/now-assist-spm.md)\n\n</td><td>\n\n-   Multi feedback summarization\n-   Planning item doc summarization\n-   Project doc summarization\n-   Project summary emails\n-   [Story generation](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/it-business-management/generate-stories-from-epics-now-assist-eap.md)\n-   [Write planning item](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/it-business-management/refine-text-with-write-planning-item-skill.md)\n\n</td></tr><tr><td>\n\nCustomer\n\n</td><td>\n\n[ServiceNow Otto for Customer Service Management \\(CSM\\)](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/customer-service-management/now-assist-csm.md)\n\n</td><td>\n\n-   [Case summarization](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/customer-service-management/now-assist-csm-summarize-case.md)\n-   [Chat recommendation](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/customer-service-management/generate-chat-reply-recommendations.md)\n-   [Chat summarization](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/customer-service-management/now-assist-csm-summarize-chat.md)\n-   [Email recommendation](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/customer-service-management/generate-email-reply-recommendations.md)\n-   [KB generation](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/customer-service-management/Now-Assist-generate-article-csm-workspace.md)\n-   [Resolution notes generation](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/customer-service-management/now-assist-csm-generate-resolution.md)\n-   [Sidebar summarization](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/customer-service-management/summarize-sidebar-conversations.md)\n\n</td></tr><tr><td>\n\nCustomer\n\n</td><td>\n\n\n\n</td><td>\n\n-   [KB generation](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/field-service-management/na-fsm-generate-kb-article.md)\n-   [Sidebar summarization](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/field-service-management/na-fsm-summarize-sidebar-platform.md)\n-   [Work order task summarization](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/field-service-management/close-wo-wot-mobile.md)\n\n</td></tr><tr><td>\n\nCustomer\n\n</td><td>\n\n\n\n</td><td>\n\n-   [Case summarization](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/financial-services-operations/summarize-case-using-now-assist-fso.md)\n-   [Disputes intake via Virtual Agent](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/financial-services-operations/submit-dispute-case-disputes-intake-via-virtual-agent.md)\n\n</td></tr><tr><td>\n\nCustomer\n\n</td><td>\n\n\n\n</td><td>\n\n-   [Government case summarization](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/government-industry/now-assist-psds-summarize-case.md)\n-   [Chat summarization](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/government-industry/now-assist-psds-summarize-chat.md)\n\n</td></tr><tr><td>\n\nEmployee\n\n</td><td>\n\n[ServiceNow Otto for Health and Safety](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/employee-service-management/now-assist-hs-landing.md)\n\n</td><td>\n\n[Incident summarization](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/employee-service-management/now-assist-hs-summarize-safety-incident.md)\n\n</td></tr><tr><td>\n\nEmployee\n\n</td><td>\n\n[ServiceNow Otto for HR Service Delivery \\(HRSD\\)](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/employee-service-management/now-assist-hrsd.md)\n\n</td><td>\n\n-   [Case summarization](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/employee-service-management/now-assist-hrsd-summarize-case.md)\n-   [Chat summarization](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/employee-service-management/now-assist-hrsd-chat.md)\n-   [KB generation](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/employee-service-management/gen-kb-now-assisthr.md)\n-   [Resolution notes generation](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/employee-service-management/now-assist-hrsd-res-note.md)\n\n</td></tr><tr><td>\n\nEmployee\n\n</td><td>\n\n\n\n</td><td>\n\n[Legal request summarization](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/employee-service-management/now-assist-lsd-summarize-case.md)\n\n</td></tr><tr><td>\n\nEmployee\n\n</td><td>\n\n\n\n</td><td>\n\n-   [Contract analysis](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/employee-service-management/cncore-NA-review-land.md)\n-   [Contract metadata extraction](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/employee-service-management/cncore-metadata-extract-land.md)\n\n</td></tr><tr><td>\n\nCreator\n\n</td><td>\n\n\n\n</td><td>\n\n[Catalog item generation](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/servicenow-platform/create-catalog-item-using-now-assist.md)\n\n</td></tr><tr><td>\n\nFinance &amp; Supply Chain\n\n</td><td>\n\n[ServiceNow Otto for Accounts Payable Operations \\(APO\\)](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/source-to-pay-operations/now-assist-apo.md)\n\n</td><td>\n\n[Record summarization](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/source-to-pay-operations/now-assist-summarize-apo.md)\n\n</td></tr><tr><td>\n\nFinance &amp; Supply Chain\n\n</td><td>\n\n[ServiceNow Otto for Supplier Lifecycle Operations \\(SLO\\)](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/source-to-pay-operations/now-assist-slo.md)\n\n</td><td>\n\n[Supplier case summarization](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/source-to-pay-operations/now-assist-slo-summarize-case.md)\n\n</td></tr><tr><td>\n\nFinance &amp; Supply Chain\n\n</td><td>\n\n[ServiceNow Otto for Sourcing and Procurement Operations \\(SPO\\)](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/source-to-pay-operations/now-assist-spo.md)\n\n</td><td>\n\n[Record summarization](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/source-to-pay-operations/now-assist-spo-summarize-record.md)\n\n</td></tr></tbody>\n</table>-   **[Activate offensiveness protection for generative AI](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/platform-security/activate-offensiveness-protection-for-generative-ai.md)**  \nActivate offensiveness detection to log or block offensive content generated by Now Assist skills and workflows.\n-   **[Configure prompt injection attack protection](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/platform-security/configure-prompt-injection-attack-protection.md)**  \nActivate or deactivate prompt injection attack detection settings to protect all generative AI interactions on your instance from malicious inputs and unintended model behaviors.\n-   **[Configure sensitive topic filters](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/platform-security/configure-sensitive-topic-filters.md)**  \nSet up filters in AI Guardian to redirect Virtual Agent users to a live agent or HR case when a sensitive subject is detected in a conversation.\n-   **[Export AI Guardian logs](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/platform-security/export-now-assist-guardian-logs.md)**  \nExport logs from AI Guardian to get insights into how often different guardrails are being detected and used.\n-   **[Configuring a Guardrail Service Provider](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/platform-security/configuring-byog.md)**  \nAI Guardian supports default guardrails and third-party or custom guardrail service providers to extend AI content monitoring with your organization's AI governance policies.\n\n**Parent Topic:**[Agentic AI security and governance](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/platform-security/now-assist-security.md)\n\n"}}