The Crawl-delay directive
From February 22, 2018, Yandex doesn't take into account the Crawl-delay directive. For more information, read the blog.
To set the rate at which the indexing bots should access your site's pages, use the site crawl rate setting in Yandex Webmaster.
Was the article helpful?
Previous