Issues with TOC (Table of Content) indexing

[Saurabh Jain]

Problem Statement:

1. Why is the TOC page not indexed?
2. How to ignore the text appearing in TOC?
3. How to ignore the text appearing in TOC but include the same text appearing in other parts of the page?

Environment	Production
Reported product version	C'20
Resolved in version	C'20
Module	Search Client

Solution:

1. If the TOC page exists in the list of disallowed pages, crawlers will not index those pages. Please check the list of pages that are disallowed for indexing.
2. To skip the keyword altogether, add keywords in stopwords - https://docs.searchunify.com/Content/NLP-Manager/Manage-Stopwords.htm?
3. Reach out to the support team who can help crawl only the description part of the body tag. This will skip the TOC keyword but search the rest of the body.