Site indexing via a Yandex Metrica tag
The Yandex robot learns about the site's pages from different sources. One of them is the Yandex Metrica tracking tag. You can tell Yandex to index pages that have the tag.
To speed up crawling, link the Yandex Metrica tag to the site you verified in Yandex Webmaster, and turn on the site indexing with the tag data.
Who can request and confirm the linking
|
Where the request is sent from |
Who sends the request |
Who confirms the request |
|
Yandex Webmaster |
A user with site management rights. |
User Metrics with the rights to edit the counter or with Executive access. |
|
Yandex Metrica |
A user with tag editing rights or with representative access. |
A Yandex Webmaster user with site management rights. |
When the robot finishes crawling the site, pages can be included in search results if they are not prohibited from indexing. To give the robot a better idea of the pages, use the Sitemap file.
Step 1. In Yandex Webmaster, send a request for linking
You can link several domains to one tag or several tags to a site. For example, you can link the same tag to the primary domain and to a subdomain. To do this, add both sites in Yandex Webmaster and verify your site management rights.
- Choose the site to link to the tag.
- Go to Settings → Yandex Metrica tags.
- Click the Add tag button.
- Specify the ID of the tag to link to the site. Note that the site must be specified in the tag settings in Yandex Metrica.
Once you send the linking confirmation request, the owner of the Yandex Metrica tag receives an email notification.
Step 2. In Yandex Metrica, confirm the request
Note
If you are both the owner of the site and the counter, the request is confirmed automatically — the counter is linked to the site. Go to the next step.
Once the linking request is sent, the site domain is searched for matches. The protocol and the "www" prefix are ignored in the check. If there are matches found, confirm the request:
- Go to the Setting page (the Tag tab).
- Click the Confirm button.
You can track the status of linking the tag to the site:
-
In Yandex Metrica. Go to Settings and open the Tag tab.
-
In Yandex Webmaster. Go to Settings → Yandex Metrica tags.
Status
Description
Note
“Waiting for confirmation”
The linking request is sent. Domains are checked for matches. After that, the request awaits confirmation from the Yandex Metrica user.
The Yandex Metrica user should confirm the request.
“Linked”
The Yandex Metrica user confirmed the linking request.
The Yandex robot will start crawling the site pages.
“Not confirmed”
The Yandex Metrica or Yandex Webmaster user canceled the linking.
You can re-send a request for linking the tag and the site.
“Confirmation error”
The tag isn't linked to the site. Possible reasons:
- The site hasn't been added to Yandex Webmaster.
- The site management rights haven't been verified in Yandex Webmaster.
- The tag ID was specified incorrectly on the Settings → Yandex Metrica tags page in Yandex Webmaster.
Check for possible reasons and request confirmation again.
Step 3. In Yandex Webmaster, will turn on the site indexing
- Go to Indexing → Tags crawl.
- Next to the Yandex Metrica tag you linked to the site, turn on the crawl.
The robot will be able to crawl pages where the tag is installed. This option applies to all versions of the site: over the HTTP or HTTPS protocol, and with or without the "www" prefix.
During the crawl the robot searches the site for the pages that can be included in search. In some cases, indexing may stop so that you can check the pages. The robot can find many pages. Yandex Webmaster shows only examples. These examples help you understand which groups of pages should be included and which ones shouldn't.
Depending on settings, you will receive a notification that the checking list is ready:
- On the Notifications and Site diagnostics pages in Yandex Webmaster.
- Sent to the email address you entered in your notification settings.
To check the examples, go to Indexing → Tags crawl and click Examples of pages next to the tag you linked to the site.
If you think the list includes:
-
Take a careful look at the list — it may include the following types of pages:
Page type
What should we do
Action pages. For example, adding an item to the basket or comparing items.
Shopping cart with a product.
Personal information. For example, the customers' delivery addresses and phone numbers.
Restrict access to data by authenticating users on the site
Duplicate page. For example, a URL with additional parameters (
https://example.com/page?id=1).Specify which page is preferred for including in search results
-
Wait for the service to update the list. You'll receive an email about this to the address you provided in your notification settings.
-
Check the sample pages again.
-
Enable indexing.
- Check whether your site pages are ready to be shown in search results. Make sure that the page content is complete and the pages use the correct title element and the description meta tag.
- Enable indexing.
Additionally, we recommend adding pages that can participate in the search to the Sitemap file to speed up their appearance in search results.
To check which pages appeared in the search results, go to Pages in search.
When the option is off, the robot stops receiving information about new site pages from Yandex Metrica. However, it might index pages if it finds out about them from other sources. We recommend that you disallow indexing for non-public content. To find out if pages you don’t want to be indexed are included in search, go to Pages in search.
Also, disabling crawling doesn't remove pages from the search results. See the Deleting a site section.
Questions and answers
Should I enable crawling by Yandex Metrica tags?
Crawling based on Yandex Metrica tags speeds up website indexing. By using this method you send a signal to the robot to visit your website.
When you enable crawling by Yandex Metrica tags, Yander Webmaster offers examples of pages that you should hide from indexing (for example, private pages). See our recommendations and block unnecessary pages from indexing.
How do I exclude unnecessary pages from the search?
Even if you don't enable crawling by Yandex Metrica tags, there is still a chance that such pages may appear in the search. That's why we recommend that you disallow them from indexing and turn on crawling.
Contact support
If you have a question about how the tool works, choose the appropriate one:
See the recommendations in the Why is it taking so long for pages to appear in search results? section.
Pages are sent for reindexing, but do not appear in the search
Use the recommendations on how to remove site pages or individual sections from search results. Search results are updated within two weeks.
Pages were not excluded from the search after two weeks
You can also go to
A site page that duplicates the content of another page on the same site but has a different URL.