Question
What are some of the reasons for crawlers not able to crawl updated sitemap?
| Environment | Production |
|---|---|
| Reported product version | C'20 |
| Resolved in version | C'20 |
| Module | Search Client |
Answer
Please make sure the below things are followed to correctly upload and crawl an updated Sitemap.
a) Make sure the structure of the sitemap is correct.
b) Check if all the links mentioned in the sitemap are working. If there are any corrupt links available in the sitemap, sitemap crawling will be stuck.
c)Make sure the URL domain present in the sitemap should be present in the "Indexing filters for URL" and "Should crawl" option under Rules " By filters.
(screenshot - https://prnt.sc/1r23f3c)
d) We suggest using "Form" authentication for gated sitemap crawling
- After uploading the sitemap, to enable the connect/save button, make sure the Client URL includes the domain location as shown below.
Comments
0 comments
Please sign in to leave a comment.