Misplaced Pages

Bingbot

Article snapshot taken from Wikipedia with creative commons attribution-sharealike license. Give it a read and then ask your questions in the chat. We can research this topic together.
Web-crawling robot
Bingbot
Original author(s)Microsoft
TypeWeb crawler
WebsiteBingbot FAQ

Bingbot is a web-crawling robot (type of internet bot), deployed by Microsoft October 2010 to supply Bing. It collects documents from the web to build a searchable index for the Bing (search engine). It performs the same as Google's Googlebot.

Behavior

A typical user agent string for Bingbot is "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)". This appears in the web server logs to tell the webmaster who is requesting a file. Each webmaster is able to use the included agent identifier, "bingbot", to disallow or allow access to their site (by default access is allowed). If they don't want to grant access, they can use the Robots Exclusion Standard to block it (relying on the assumed good behaviour of bingbot), or use other server specific means (relying on the web server to do the blocking).

References

  1. "BingBot Crawl Activity Surging?". Retrieved 2016-07-16.
  2. Shenoy, Aravind; Prabhu, Anirudh (2016-07-26). Introducing SEO: Your quick-start guide to effective SEO practices. Apress. ISBN 978-1-4842-1854-9.
  3. Team, IntroBooks. Microsoft Bing's Algorithm Explained. IntroBooks.
  4. Siegler, M. G. (2009-07-17). "Ignore That Scary MSNbot, It's Just The Friendly BingBot - Unless It Attacks!". TechCrunch. Retrieved 2023-10-22.

External links

Web crawlers
Internet bots designed for Web crawling and Web indexing
Active
Discontinued
Types


Stub icon

This Web-software-related article is a stub. You can help Misplaced Pages by expanding it.

Categories: