The Crawl-delay directive
From February 22, 2018, Yandex ignores the Crawl-delay directive. To learn more, read the blog.
To set the speed at which robots downloads the site pages, use the Site crawl rate in Yandex.Webmaster.
From February 22, 2018, Yandex ignores the Crawl-delay directive. To learn more, read the blog.
To set the speed at which robots downloads the site pages, use the Site crawl rate in Yandex.Webmaster.