Non-Html Urls (Uncrawled)

What does this report contain?

All URLs included in the crawl which are not HTML pages, based on recognised file extensions, and the content-type returned in the header.

How can this report be used?

These URLs can be reviewed to see if they are adding value, or can be excluded from being crawled by adding disallow restrictions in the robots.txt file.

Categories:

Uncrawled Urls, Indexation

API Report Code:

other_uncrawled_%28invalid%29