Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you may not be able to execute some actions.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Exclude pages from Indexing

S

Saurabh Jain last edited by Arshi
Question

What is the best way to exclude multiple pages from search when they are not in the same folder structure?

Environment Production

Reported product version M'21

Resolved in version M'21

Module Content Sources

Answer

The best way to exclude the docs while crawling would be to add all the URLs to the "Should not crawl" section. Below are the steps:
1. Navigate to Content Sources in Admin Panel
2. Edit website type Content Source from which you want to exclude the docs.
3. Navigate to Rule tab and click "By Filter"
4. Add pages in "should not crawl" section. This will prevent these pages from being indexed and shown in search result pages.
Note: These URLs will also be excluded by auto crawlers that are running after a given frequency. Also, this feature is only available for website type content source.
Reply Quote 1
1 Reply Last reply

Environment	Production
Reported product version	M'21
Resolved in version	M'21
Module	Content Sources

0
Replies

53
Views

Suggested Topics

S

Not able to index all documents of a Content Source
Created • Last Reply Last reply • Saurabh Jain

Search Clients search clients searchclients crawling

0

0
Votes

0
Replies

32
Views

S

Problem Statement Why are some of the documents not indexed by SU crawlers? Environment Production Reported product version C'20 Resolved in version C'20 Module Search Client Causes Too large document size for crawlers to crawl. Solutions Truncate the document size and set it for a recrawl. In case recrawl is failing even after truncating the document size, reach out to support@searchunify.com to verify if the crawlers are working fine.
S

Content Source crawling status and crawling logs
Created • Last Reply Last reply • Saurabh Jain

Content Sources content sources crawling

0

0
Votes

0
Replies

122
Views

S

Problem Statement: How to find the number of documents crawled in a content source? How to find the crawling logs for the last crawling of a content source? How to manually start/stop crawling of a content source? How to setup Email notification Alert for Crawling Completion status of a content source? Environment Production Reported product version Mamba'20 Resolved in version Mamba'20 Module Alerts and Content Source Resolution Number of documents indexed in a content source, is shown up next to the name of the Content source (shown in the image) Crawling logs for the last crawl of a content source tab are accessible, on click of logs icon (shown in the image) Click on the Refresh icon to manually start and stop the crawling of a content source (shown in the image) Content source Indexing notifications are configurable from the Admin Panel. To set it up please follow these steps: a. Login into SearchUnify Admin Panel b. Navigate to "Alerts" section from the navigation list on the left c. Click on "Content Source Subscription" tab d. Click "Add Subscription Email", select the content source and enter the email ID to set the crawling alerts
Content Sources Authentication — Cheat Sheet
Created • Last Reply Last reply • sugrokker

Content Sources content sources cheatsheet authentication

0

1
Votes

0
Replies

104
Views

A quick cheat sheet to help you prepare beforehand if you are planning to index multiple content sources. No Auth No content source privileges are needed, apart from the content source's URL. Select it to crawl public content. Basic Auth Indexes the data available to the user whose username and password are entered. Admins can either enter the credentials on the screen or in the pop-up window which appears when you click Connect. OAuth and Others High security authentication for some content sources, such as Khoros (Lithium) communities, Higher Logic communities, and ServiceNow. Usually requires an API token or the client ID and client password of an app. In this chart, you can map content sources with available authentication methods. Content Source No Auth Basic Auth OAuth or Others API Yes Yes No Azure DevOps No No Yes; Personal Access Token (PAT) Box No Yes No Confluence No Yes Yes; OAuth Docebo No No Yes; client ID and client secret Dropbox No Yes No GitHub No No Yes Google Drive No Yes No Helpscout No No Yes; API keys Higher Logic No No Yes; Username, password, and HLIAM key Jira Yes Yes Yes; OAuth Jira On-Premises No No Yes Jive No No Yes; client ID and client secret Lithium Yes No Yes; (1) Community User details and HTAccess; (2) API User details and HTAccess; (3) OAuth Litmos No No Yes; API key MadCap Flare No No Yes Marketo No No Yes; client ID and secret Microsoft Dynamics No No Yes; client ID, tenant ID, and client secret Mindtouch No Yes No Moodle No No Yes Saba No Yes No Salesforce No Yes No ServiceNow No Yes Yes; OAuth SharePoint No Yes No SkillJar No No Yes; API key Slack No Yes No SOLR Yes No No StackOverflow Yes No Yes; OAuth Vimeo No Yes No Website Yes Yes Yes; Form YouTube No Yes No Zendesk Yes Yes Yes; OAuth Zoomin Yes No No
M

How to hide specific results from the crawled content without deleting?
Created • Last Reply Last reply • madhuri.tripathi

Search Clients search clients searchclients crawling

0

0
Votes

0
Replies

221
Views

M

Environment Production Reported product version Mamba'20 Resolved in version Mamba'20 Module Search Client Answer To hide specific document (in this case a Knowledge Article) from the crawled content sources, follow the steps below: Login to SearchUnify Admin panel. Navigate to search client and click Edit. Navigate to Content source tab > Select the content source and click on Create formula. Drag the ID field and enter the ID of an Article which you want to exclude from the search result in the Value Field. Enable parity and click Save. Please refer to this article for more details.
S

Content Source Crawling issues
Created • Last Reply Last reply • Saurabh Jain

Content Sources content sources crawling

0

1
Votes

0
Replies

194
Views

S

Problem Statement What are the possible causes of Crawl failure for a new Content Source? Environment Production Reported product version C'20 Resolved in version C'20 Module Content Source Causes Invalid credentials Incorrect content source name Incorrect client URL Incorrect crawling Start Date Overlap of crawling operations with patch deployment Mismatch between the article fields and fields configured in the admin panel. Expiration of password used to authenticate a content source Solution Ensure that the login credentials of the content source are the same as the ones used to connect the content source in the SU admin panel. Check if the content source name contains any non-ASCII characters. Only ASCII characters should be used to set the content source name. Only baseURL should be used while configuring content source in the SU admin panel. The crawling start date should not be current or future date but should be in the past, from when you would like crawling to start. If crawl fails in between, check with your CSM if there was any patch deployment happening while crawling was in progress. If you have updated the article structure for one of your content sources by deleting a field, make sure to update the SearchUnify admin panel object fields for a given content source. Content source Authentication - Check if the password of a user used for authentication of content source has been expired due to which content has not been auto-crawled as per frequency set on SU Admin panel. For more information on how to configure a new content source please visit: https://docs.searchunify.com/Content/Content-Sources/Content-Source.htm
How to Rename a Content Type?
Created • Last Reply Last reply • sugrokker

Content Sources content sources content type object rename change label

0

0
Votes

0
Replies

109
Views

Content Types are the objects used for storing data. Some platforms contain only one object while in others there is virtually no upper limit. YouTube has one content type, video. Dropbox supports two content types, paper and file. But in Salesforce, admins can create dozens of custom objects. Object names are defined by the platform in question but SearchUnify allows admins to change their labels. For instance, you can YouTube video as movie and Dropbox paper as doc. Change Content Type Label To change the label of a content type Go to Content Sources from the main navigation. Open any content source for editing. Open the Rules tab. In the Label column, find your content type, click the edit icon, and enter the new label. Save your settings. The content type will be renamed.
M

Remove Archived Article from Search Results
Created • Last Reply Last reply • madhuri.tripathi

Content Sources contentsource delete articles total documents

0

1
Votes

0
Replies

205
Views

M

Problem Statement When will an archived article stop reflecting in the search results? Environment Production Reported product version Mamba'20 Resolved in version Mamba'20 Module Content Crawling frequency Cause The jobs running in the backend for deleting the Archived/Draft articles are different from the ones used for crawling content sources. Solution Archived articles are deleted from the content indexes as per the frequency set in the backend job. Currently, these jobs automatically delete archived articles only from Salesforce content source. Another option for admins is to manually delete an article from the index: Log in to the admin panel Go to Content source Under the Documents column, click on the number of documents reflecting for a particular content source. Search for the desired article and delete it.

Exclude pages from Indexing

Question

Answer

Suggested Topics

Not able to index all documents of a Content Source
Created • Last Reply Last reply • Saurabh Jain

Search Clients search clients searchclients crawling

Content Source crawling status and crawling logs
Created • Last Reply Last reply • Saurabh Jain

Content Sources content sources crawling

Content Sources Authentication — Cheat Sheet
Created • Last Reply Last reply • sugrokker

Content Sources content sources cheatsheet authentication

How to hide specific results from the crawled content without deleting?
Created • Last Reply Last reply • madhuri.tripathi

Search Clients search clients searchclients crawling

Content Source Crawling issues
Created • Last Reply Last reply • Saurabh Jain

Content Sources content sources crawling

How to Rename a Content Type?
Created • Last Reply Last reply • sugrokker

Content Sources content sources content type object rename change label

Remove Archived Article from Search Results
Created • Last Reply Last reply • madhuri.tripathi

Content Sources contentsource delete articles total documents

Exclude pages from Indexing Ask a Question Submit Idea

Question

Answer

Suggested Topics

Not able to index all documents of a Content Source Created • Last Reply Last reply • Saurabh Jain Search Clients search clients searchclients crawling

Content Source crawling status and crawling logs Created • Last Reply Last reply • Saurabh Jain Content Sources content sources crawling

Content Sources Authentication — Cheat Sheet Created • Last Reply Last reply • sugrokker Content Sources content sources cheatsheet authentication

How to hide specific results from the crawled content without deleting? Created • Last Reply Last reply • madhuri.tripathi Search Clients search clients searchclients crawling

Content Source Crawling issues Created • Last Reply Last reply • Saurabh Jain Content Sources content sources crawling

How to Rename a Content Type? Created • Last Reply Last reply • sugrokker Content Sources content sources content type object rename change label

Remove Archived Article from Search Results Created • Last Reply Last reply • madhuri.tripathi Content Sources contentsource delete articles total documents

Exclude pages from Indexing

Not able to index all documents of a Content Source
Created • Last Reply Last reply • Saurabh Jain

Search Clients search clients searchclients crawling

Content Source crawling status and crawling logs
Created • Last Reply Last reply • Saurabh Jain

Content Sources content sources crawling

Content Sources Authentication — Cheat Sheet
Created • Last Reply Last reply • sugrokker

Content Sources content sources cheatsheet authentication

How to hide specific results from the crawled content without deleting?
Created • Last Reply Last reply • madhuri.tripathi

Search Clients search clients searchclients crawling

Content Source Crawling issues
Created • Last Reply Last reply • Saurabh Jain

Content Sources content sources crawling

How to Rename a Content Type?
Created • Last Reply Last reply • sugrokker

Content Sources content sources content type object rename change label

Remove Archived Article from Search Results
Created • Last Reply Last reply • madhuri.tripathi

Content Sources contentsource delete articles total documents