Indexing
Tell us what your question is about so we can direct you to the right specialist:
Example: url:https://example.com/page/.
Example: https://example.com/page/.
This means that the page is already indexed: it was added to the robot's database. If you don't find a page by a specific query or it shows up in a low position, try finding out on your own the reason for the change in the site's ranking.
Or refine the question:
Check out the reasons for changes in ranking, and check the site for security and violations. If Yandex.Webmaster finds a threat or violation, follow the recommendations provided in the service.
Changes in the site's search ranking are acceptable in most cases. It may be due to constant adjustments of algorithms and the dynamics of the search results.
Contact the support service if the ranking change is accompanied by all listed conditions:
- The site was a leader for a long time.
- The site ranking dropped by more than 30 points (with smaller changes, check if your site meets the recommendations set out in this section).
- Site traffic decreased.
- The page may be a duplicate. For information about how to check and fix this, see Duplicate pages. Also, the page may not be included in the search or disappear from it for other reasons.
- If the site changed its URL but the page is displayed in the search at the old URL, make sure you moved the site correctly.
A special algorithm determines if the page will be displayed in the search results or not. For example, for the page to be displayed, its content must match the search query. For more information, see Stage 4. Generating search results.
If you don't find new site pages in the search, go to the How do I add a site to search? section. If the pages were previously in the search, but are missing now, check out the reasons for excluding pages.
If you notice a decrease in website traffic, check out what traffic sources this issue is associated with. You can do this using the Sources, summary report in Yandex.Metrica.
The traffic obtained from search results may decrease for various reasons, for example:
- Previously popular pages have disappeared from the search. To track the search state for the pages that are important to you, set up monitoring.
- Security violations or issues detected on the website.
If the traffic doesn't change within two weeks of fixing the issues described above, contact customer support.
If another resource has content identical to yours, this isn't enough to exclude the site from the search results.
To protect your copyright, you can file a complaint directly with the administrator of the site that you believe has content identical to yours, or use other legal means to protect your rights.
If you can't come to an agreement with the site administration, try writing to the site's hosting provider.
This means that the site or some of the pages haven't been indexed by the Yandex robot yet. To learn more about how the robot crawls sites, see How does the Yandex search work?.
Refine your question:
As a rule, sites added to Yandex.Webmaster appear in search results within two weeks. If this doesn't happen, check if the site indexing isn't prohibited in the robots.txt file or with meta tags.
The site may also be unavailable due to a server error. You can check the site availability with the Server response check tool.
If the site URL changed, the robot might not have enough time to track it. Check if the mirrors are configured correctly.
Send pages to be visited by the robot using the Reindex pages tool. The pages will appear in the search within two weeks.
Check out recommendations that help you add pages in the search.
For more information about why pages may disappear from search and recommendations on how to fix this, see the Why are pages excluded from the search? section.
If the problem wasn't solved, specify the reason:
Pages with different content can be considered duplicates if they responded to the robot with an error message (for example, in case of a stub page on the site). Check how the pages respond now. If pages return different content, send them for re-indexing — this way they can get back in the search results faster.
To prevent pages from being excluded from the search if the site is temporarily unavailable, configure the 503 HTTP response code.
Excluding pages from the search results is not an error on the part of a site or the indexing robot: it excludes pages that users won't be able to find using search queries. Therefore, their exclusion shouldn't affect the visibility of indexed pages on the site. To learn more, see Low-value or low-demand pages.
Contact support if:
- Pages were ranked high in the search results before they were excluded.
- The site's position after the exclusion of pages decreased dramatically.
- The number of click-throughs from the search engine reduced significantly after the pages were excluded.
To speed up how quickly changes in site pages appear in the search results, see How do I reindex a site?.
If you still have questions or have any difficulties, specify the topic:
Make sure that:
- The pages can be accessed by the robot (use the Server response check tool).
The information about pages is present in the Sitemap file.
- The Disallow and noindex prohibiting directives and the noindex HTML element in the robots.txt file prevent only technical and duplicate pages from indexing.
If you followed the instructions when deleting the site pages and more than two weeks passed after the last crawl by the Yandex robot, fill out the form below:
If you use a redirect, the robot will gradually track redirects and the old pages will disappear from the search results as it crawls the site. For the robot to learn about the changes faster, send the pages for reindexing.
If the page URLs change because you changed the site's domain name, the search data update may take more than a month. Check if the mirrors are configured correctly.
See recommendations in the How do I exclude pages from the search? section.
Tell us what your question is about so we can direct you to the right specialist:
If you followed the instructions when deleting the site pages and more than two weeks passed after the last crawl by the Yandex robot, fill out the form below:
If you used a redirect, submit pages for reindexing.
For information about the file format and requirements, see Using the Sitemap file.
See recommendations for reducing the load on the site.
