Pro WordPress Tips

Google Introduces New Crawler to Boost Googlebot's Performance

Google has introduced a new web crawler called GoogleOther to reduce the load on its primary search index crawler, Googlebot.

GoogleOther will handle non-essential tasks like research and development crawls, allowing Googlebot to focus solely on building the search index.

GoogleOther shares the same infrastructure as Googlebot, so its introduction should not significantly impact websites.

Website owners can monitor GoogleOther's crawling activities through server logs, updated robots.txt, and crawl stats in Google Search Console.


Related Stories