Google Search Console Integration
You can use Google Search Console as a crawl source for any project in DeepCrawl. The crawler will pull all of the impression, click, and position data per URL from Search Analytics, and we'll crawl any URLs which were discovered in GSC but not in any other source.
All native GSC filters are available: Filter the data and URLs we pull by Search Type (Web, Image, or Video); Country of the Google Property; include and exclude certain keywords and phrases; or specify a minimum number of clicks that a URL should get before it.
We use this data to build the following reports:
Identifying and quickly fixing issues with search landing pages is critical to maintaining traffic. These reports provide information of the issues which are likely to have a significant negative effect on your search rankings.
- Broken Pages with Traffic
- Disallowed URLs with Traffic
- Redirecting Pages with Traffic
- Mobile/AMP Pages with Desktop Search Clicks
- Desktop Pages with Mobile Search Clicks
Config and Information Reports
- Indexable Pages without Search Impressions
- Indexable pages with Search Impressions
- Non-indexable Pages with Search Impressions
- Mobile/AMP Pages with Search Impressions
- Orphaned Search Console Pages
- Pages in Search Console
- Pages Not in Search Console
Traffic vs. Clicks vs. Impressions
There are three core pieces of terminology in the naming of these reports:
Traffic: These reports will include pages which received any Analytics Visits, or Google Search Console Clicks
Clicks: Pages which received Google Search Console Clicks
Impressions: Pages which received Google Search Console Impressions
How can you use the Google Search Console integration?
The more sources that you add to a crawl, the richer its data, and the more issues we can alter you about. In addition to making use of the above reports, this feature can be used to:
Catch problems with pages which get traffic
Create a dedicated Search Console crawl which runs every day or week and only crawls the landing pages from the last month. This crawl will monitor pages which get traffic and let you know as soon as some start 404ing, get disallowed by your robots.txt, or become non-indexable (set up a task to receive email alerts). This will allow you to find and fix any problems before search engines find the issue and your rankings are lost.
Monitor image health on pages which receive Image Search Traffic (coming soon)
Many websites get a significant portion of their organic traffic from image search, and this often drives incremental revenue. To protect this traffic, it is important to ensure that the images on these pages do not become broken.
To monitor the images on pages which drive image search traffic:
- Create a Search Console crawl which uses Image Search as its source
- Turn on image crawling and “Always crawl these resources” in the “File Restrictions” area of the advanced settings
Note: The "Always crawl resources" option for list crawls is currently in development and will be released soon.
Monitor the pages which receive non-brand traffic
Normally, SEOs focus on non-brand keywords and traffic as this is what drives incremental leads and sales. These keywords are typically more competitive, so are much harder to rank for than keywords which include your brand name. Hence, it is important to identify the pages ranking for these terms and protect them by fixing any issues before search engines recrawl these pages.
- Create a Search Console project with a repeating schedule to run a crawl every day or every week.
- In the Search Console setup, add your brand name as an “Exclude Query” – this will mean that we only pull landing pages and metrics from searches which did not have your brand name
As well as your main brand name, you may want to consider excluding sub brands and product brands which you own. i.e. Apple may exclude both “Apple” and “iPhone” so that they can focus on maintaining their “smartphone” rankings.
Within our Search Console settings, we allow you to apply any filter which is available in the Search Console interface.
- Country: This option will restrict the URLs and data to searches made by users in this country
- Search Type: Restrict URLs and data to searches made in this search type. Web – regular Google search. Image – searches on Image search. Video – searches on Video search.
- Include/Exclude Queries: Restrict URLs and data to those which have (include) or do not have (exclude) these queries. You can have multiple Include and Exclude queries, however we will only get data for searches which matched all queries.
- Date range: the date range from which we will pull data.
- Minimum Clicks: we’ll only get URLs which had at least this many clicks during the period.
- Device Filtering: We already segment all data by each device (Desktop, Tablet, Mobile), so we do not offer a filter for device.