Pages In Web Crawl

What does this report contain?

All linked pages discovered during the web crawl.

How can this report be used?

Pages which are discovered in the web crawl are all linked from the starting URLs, and should be crawled by search engines. The list can be reviewed to identify unimportant URLs which can be excluded from the web crawl by being unlinked or removed.

Categories:

Web Crawl, Source Gap

API Report Code:

all_web_crawl_urls