How can I add a site to search?

Yandex robots regularly crawl site pages and load them into their database. When crawling, the robot checks the following:
Robots continually monitor the appearance of new links, content updates on previously downloaded pages, and page availability. Monitoring continues as long as:
  • The link is placed on your site or on a third-party resource.
  • The link is not prohibited for indexing in the robots.txt file.

To inform Yandex about a new site and track its indexing and ranking in the search results, add the site to Yandex.Webmaster.

  1. Which pages are already indexed?
  2. Which site pages are included in the search?
  3. Why is it taking so long for pages to appear in search results?
  4. Changes to the site's position in search results
  5. Questions and answers

Which pages are already indexed?

There are several ways to check this:

  • Using the url query operator. In the Yandex search box, enter the url: query operator, site address and *. For example: url:www.example.com*.
  • In Yandex.Webmaster, on the Indexing → Crawl statistics page. For details, see the Crawl statistics section.

Changes to the site's position in search results

Search results are not static and can change constantly. This can happen for several reasons:

Search algorithms changed
Ranking algorithms are constantly being updated in order to improve search quality. You can read about the most significant changes in the blog for webmasters and Platon Shchukin's blog.
The search database was updated
Site characteristics are continually being recalculated based on the latest data about the pages as well as their popularity among users. The weight of ranking factors and the page that is relevant to the query may change. Site pages may get bumped out of the search index. As a result, positions in search results can also change.
There were changes on other sites included in search results for the queries you are interested in
Your site's position in search results might change if other resources increase their relevance for the same queries (as owners of other sites also make changes). If top positions in search are taken by suspicious sites, use this form to report it.
The site URL or the protocol changed
After a URL change, the site's position in search results may be lower until several search database updates have been completed (the old site pages disappear from the search index, so the ranking for matching queries may be lower for some time). If your site has a 301 redirect set up, check out the rules for processing it.
Pages that were previously in search results are no longer shown
To check if a page is included in search, use the Check URL status tool or enter a search query with the [url] operator(example).
There are other changes on your site
Any change to the site can affect its position in search results. For example, changing the site structure, URL or the content (or layout) of the page that matched certain queries.
Site pages are considered to be of poor quality
You can check this in Yandex.Webmaster on the Diagnostics → Site diagnostics page. To improve the site, follow the recommendations:

The algorithm checks pages with every search database update, so some of them may be excluded from the search. If a page doesn't show up in search results for a long time, it means that it doesn't provide good answers to user queries at the moment.

Questions and answers

The page description in the snippet differs from the content in the Description
The page description in the search results is based on the text that is the most relevant to the search query. This can be either the content of the Descripton meta tag or the text placed on the page.
Search results show links to internal site frames
In this case, before loading the page in the browser console, check if the parent frame with navigation is open. If it is closed, open it.
My server doesn't provide last-modified

Your site will still be indexed even if your server doesn't provide last-modified document dates. However, you should keep in mind the following:

  • The date won't be displayed in the search results next to your site pages.

  • Most users won't see your site if they sort the search results by date.

  • The robot won't know if a site page has been updated since it was last indexed. Modified pages will therefore be indexed less often, given that the number of pages the robot gets from a site each time is limited.

How does encoding affect indexing?
The type of encoding used on the site doesn't affect the site indexing. Also, if your server does not pass the encoding in the header, the Yandex robot will detect the encoding itself.
Can I manage reindexing frequency with the Revisit-After directive?
No. The Yandex robot ignores it.
Does Yandex index a site on a foreign domain?
Yes. Sites containing pages in Russian, Ukrainian, and Belarusian ​​are indexed automatically. Sites in English, German, and French are indexed if they might be interesting for users.
The site is added to Yandex using a service for automatic registration in search engines. Why is my site not indexed?
According to the , pages added through an automatic system aren't included in the search base. To notify Yandex about a new site, add it to the section.
Is the content of the frame and frameset elements indexed?
Yes, the Yandex robot indexes the content loaded in the "frame" and "frameset" elements and finds the source document.
How does a large number of URL parameters and the URL length affect indexing?

A large number of parameters and nested directories in the URL, or overly long URLs, may interfere with the site indexing.

The URL can be up to 1024 characters.

How do I switch the case of a page URL?
Check if the robot database contains page URLs in different cases that are considered duplicates. Go to Indexing → Pages in search (Excluded pages) in Yandex.Webmaster. If this is the case, specify the URL to include in the search for the robot using one of these methods:
Does the robot index GZIP archives?
Yes, the robot indexes archives in GZIP format (GNU ZIP compression).
Does the robot index anchor URLs (#)?

The Yandex robot doesn't index anchor URLs of pages, except for AJAX pages (with the #! character). For example, the http://example.com/page/#title page won't get into the robot database. The robot will index the http://example.com/page/ page (URL before the # character).

How does the robot index paginated pages?
The robot ignores the rel attribute with the prev and next values. So, pagination pages can be indexed and included in search without restrictions.