How can I add a site to search?
Site pages appear in search results after the Yandex robots visit the site. For the robots to crawl and load pages:
- Step 1. Make site pages visible to the robot
-
There are several ways to inform the Yandex robot about changes on the site:
Method Automation Recommendations The Sitemap file Generate and update the file. This will allow you to send information about all site URLs. The robot can process the file contents the next time it crawls the site. Crawling pages with a Yandex.Metrica tag Install the Yandex.Metrica tag on your site and link it to the site in Yandex.Webmaster. This way you can inform us about popular pages. Page reindexing — On the page in Yandex.Webmaster, you can signal the robot to visit certain pages of the site. You can use this method to report changes on the most important or new pages.The IndexNow protocol Helps automatically report updated, new, and deleted pages. Requires API skills. Method Automation Recommendations The Sitemap file Generate and update the file. This will allow you to send information about all site URLs. The robot can process the file contents the next time it crawls the site. Crawling pages with a Yandex.Metrica tag Install the Yandex.Metrica tag on your site and link it to the site in Yandex.Webmaster. This way you can inform us about popular pages. Page reindexing — On the page in Yandex.Webmaster, you can signal the robot to visit certain pages of the site. You can use this method to report changes on the most important or new pages.The IndexNow protocol Helps automatically report updated, new, and deleted pages. Requires API skills. Tip. Maintain the site quality. The more useful pages are found and uploaded to the database by the robot, the more likely they will be displayed in the search results. For more information, see the Signs of a low-quality site section. - Step 2. Hide non-public content
-
Page type What should I do? Action pages. For example, adding an item to the basket or comparing items. Prohibit page indexing Shopping cart with a product. Personal information. For example, the customer's delivery address and phone number. Restrict access to data by authenticating users on the site Duplicate page. For example, a URL with additional parameters (https://example.com/page?id=1). Specify which page is preferred for including in search results Page type What should I do? Action pages. For example, adding an item to the basket or comparing items. Prohibit page indexing Shopping cart with a product. Personal information. For example, the customer's delivery address and phone number. Restrict access to data by authenticating users on the site Duplicate page. For example, a URL with additional parameters (https://example.com/page?id=1). Specify which page is preferred for including in search results
After the robot crawls the site, the pages can appear in the search within two weeks.
In addition, robots can learn about the site by opening links from other resources. This may take time and doesn't guarantee that the robot crawls all pages you would like to show in the search results.
Learn more about how Yandex search works
To track the site indexing and ranking in the search results, add the site to Yandex.Webmaster. In Yandex.Webmaster, you can also view how the site is displayed in search results and what improvements you can make — open the View in search results page.
Why is it taking so long for pages to appear in search results?
Make sure that:
- The pages can be accessed by the robot (use the Server response check tool).
- The information about pages is present in the Sitemap file.
- There are available links to the pages from previously indexed site pages.
- The Disallow and noindexprohibiting directives, as well as the noindex HTML element prevent only technical and duplicate pages from indexing.
Use the Check URL Status tool to check what the Yandex robot knows about the page. To inform the robot about new or updated pages, send them for reindexing.