{"revision":"c10276e953456835cdbb1f3a60d58ae1980be353","document":{"id":38254,"path":"platform-administration/ai-search/external-content-ais.md","title":"Indexing and searching external content in AI Search","bundle":null,"doc_type":null,"release":"australia","body":"\n# Indexing and searching external content in AI Search\n\nWith a subscription for the External Content for AI Search plugin, you can enable AI Search users to search content and metadata from documents in external repositories and remote tables.\n\nThe External Content for AI Search plugin enables you to index documents located outside of your ServiceNow AI Platform® instance, such as those stored in SharePoint collections, Confluence sites, and [remote tables](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/servicenow-platform/remote-tables.md). Indexing these documents makes their content and metadata searchable in AI Search.\n\nAI Search displays search results for indexed external documents just as it does for indexed ServiceNow AI Platform records. Users don't need to perform any special searches to match content and metadata from external documents.\n\nIndexing doesn't duplicate external documents as records in your ServiceNow AI Platform instance. When a user selects an external document search result, they are directed to the source document in its original location.\n\n## External content indexing tools\n\nThe following diagram illustrates how AI Search provides indexing and search for external document content and metadata:\n\n\\[Omitted image \"ai-search-external-content-diagram.png\"\\] Alt text: Diagram showing AI Search indexing and search options for external documents.\n\nAs shown in the architecture diagram, you can index content and metadata from external documents using any or all of the following tools:\n\n<table id=\"table_cyt_kyw_ksb\"><thead><tr><th>\n\nExternal content indexing tool\n\n</th><th>\n\nDescription\n\n</th></tr></thead><tbody><tr><td>\n\nSearch connector applications\n\n</td><td>\n\nSearch connector applications available in the ServiceNow Store provide simple tools for indexing content and metadata from documents in supported external sources. They handle some of the configuration work, such as creation of external content schema tables, for you. Each search connector application supports a specific external document source \\(or set of sources\\). For example, the [SharePoint Online Search Connector](https://store.servicenow.com/sn_appstore_store.do#!/store/application/32e3b8addb2a5450e7048d7e13961908/) only supports documents in SharePoint collections, while the [Raytion Connector Hub for AI Search](https://store.servicenow.com/sn_appstore_store.do#!/store/application/f7a8af54db9ee01035d0c6cd13961901/) supports multiple document sources. If no search connector application is available for your external document source, you must use the Integration Hub AI Search spoke or the External Content REST API to index content and metadata for documents from that source.\n\n Search connector applications provide the most straightforward way to index document content and metadata from supported external sources.\n\n</td></tr><tr><td>\n\nIntegration Hub AI Search spoke\n\n</td><td>\n\nThe Integration Hub AI Search spoke provides Workflow Studio actions that you can use to ingest external documents for indexing:-   **Ingest Document**: Define property name-value pairs for an external document and submit the document to AI Search for indexing.\n-   **Ingest Document Using Download URL**: Specify an external document's URL and have AI Search download it for indexing.\n\n You can specify security principal access permissions for documents ingested using these actions. To learn more about access permissions and security for external document content, see [External content security for AI Search](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/platform-administration/ai-search/external-content-security-ais.md).\n\n For the full list of Workflow Studio actions provided by the AI Search spoke, see [AI Search spoke](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/integrate-applications/ai-search-spoke.md).\n\n The Integration Hub AI Search spoke combines flexible configuration and handling with the simple drag-and-drop Workflow Studio interface.\n\n</td></tr><tr><td>\n\nExternal Content REST API\n\n</td><td>\n\nThe External Content REST API provides endpoints that you can use to index content and metadata from external documents:-   Send external document text content and metadata to AI Search for indexing using the ingestDocuments API endpoint.\n-   Upload external document binary content to AI Search using the storeContent API endpoint. You can associate the stored binary content with a document fed using the ingestDocuments endpoint.\n\n **Note:** To access the External Content REST API endpoints, you need either the ais\\_external\\_content role or the admin role.\n\n You can specify security principal access permissions for documents ingested using the ingestDocuments endpoint. To learn more about access permissions and security for external document content, see [External content security for AI Search](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/platform-administration/ai-search/external-content-security-ais.md).\n\n For full descriptions of the External Content REST API endpoints, see [External Content Ingestion REST API](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/api-reference/external-content-ingestion-api.md).\n\n The External Content REST API is the most complex tool for indexing content and metadata from your external documents, but it offers the most flexibility.\n\n</td></tr></tbody>\n</table>## External content search prerequisites\n\nBefore you can index external document content and metadata for search in AI Search, you must satisfy the following requirements. Except as noted in the table, these requirements apply regardless of which external content indexing tools you use.\n\n<table id=\"table_eyp_xsw_ksb\"><thead><tr><th>\n\nRequirement\n\n</th><th>\n\nDescription\n\n</th></tr></thead><tbody><tr><td>\n\nHave an active subscription for the External Content for AI Search plugin \\(com.glide.ais.external\\_content\\)\n\n</td><td>\n\nThe External Content for AI Search plugin provides functionality for indexing content from external data sources. For instructions on purchasing a subscription for the plugin and activating it, see [Request the External Content for AI Search plugin](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/platform-administration/ai-search/activate-ext-content-ais-plugin.md).\n\n</td></tr><tr><td>\n\nDefine an external content schema table for the external document source\n\n</td><td>\n\nAn external content schema table doesn't store external document content in the database. Instead, its columns serve as a map of AI Search index fields to populate when you index content from external data sources. For instructions on creating a new external content schema table, see [Create an external content schema table](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/platform-administration/ai-search/create-ext-content-schema-ais.md).\n\n When documents from multiple external data sources share the same set of fields and have unique document identifiers, you can use a single external content schema table for all of them. To avoid data loss, the external data sources must satisfy these conditions:\n\n-   All documents in the external data sources must include the same fields, matching the columns defined in the content schema table.\n-   Every document in the external data sources must have a unique identifier so that documents don't overwrite one another in the AI Search index.\n\n If the external data sources can't satisfy these conditions, create a separate external content schema table for each data source.\n\n **Note:** Search connector applications from the ServiceNow Store automatically create external content schema tables as needed. You only need to create your own external content schema tables when indexing external documents using the Integration Hub AI Search spoke or the External Content REST API.\n\n</td></tr><tr><td>\n\nCreate an indexed source with your external content schema table specified as the table to index\n\n</td><td>\n\nThe indexed source sends external documents' content and metadata to the AI Search index. For instructions on creating an indexed source, see [Create an indexed source](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/platform-administration/ai-search/create-indexed-source-ais.md).\n\n</td></tr><tr><td>\n\nCreate one or more search sources for the indexed source\n\n</td><td>\n\nEach search source specifies a subset of external documents from the indexed source whose content you want to make searchable in AI Search. For instructions on creating search sources, see [Create a search source for AI Search](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/platform-administration/ai-search/create-search-source-ais.md).\n\n</td></tr></tbody>\n</table>-   **[Request the External Content for AI Search plugin](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/platform-administration/ai-search/activate-ext-content-ais-plugin.md)**  \nRequest activation of the External Content for AI Search plugin \\(com.glide.ais.external\\_content\\) to enable indexing of searchable content and metadata from records in external data sources.\n-   **[Create an external content schema table](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/platform-administration/ai-search/create-ext-content-schema-ais.md)**  \nDefine a schema table with columns corresponding to fields on records from an external data source. AI Search uses the schema when indexing content from the external data source.\n-   **[External content security for AI Search](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/platform-administration/ai-search/external-content-security-ais.md)**  \nAI Search preserves user and group security access permissions specified for documents indexed from external sources. You can control access to external content search results by mapping these externally defined users and groups to ServiceNow AI Platform® users.\n-   **[Components installed with External Content for AI Search](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/platform-administration/ai-search/installed-with-ext-content-ais.md)**  \nWhen you activate the External Content for AI Search plugin \\(com.glide.ais.external\\_content\\), the system creates a new virtual table.\n\n**Parent Topic:**[Configuring AI Search](https://raw.githubusercontent.com/ServiceNow/ServiceNowDocs/australia/markdown/australia/platform-administration/ai-search/configuring-ais.md)\n\n"}}