How to scrape Bing search results (2024)

On February 7, 2023, Microsoft launched an all-new, AI-powered Bing search engine and Edge browser, currently available in preview at Bing.com. The goal, according to Microsoft, is “to deliver better search, more complete answers, a new chat experience, and the ability to generate content.”

At the same time, Google is preparing its own interactive chatbot, Bard (currently available only to a select group of beta testers). With these two leaders of the SERPs realm taking search engine results into a brave new world, it’s likely that Google and Bing SERPs will continue to be of immense importance in the future. AI-generated answers will continue to display online sources with web content relevant to the questions being asked. If citations and page suggestions in chat results drive traffic, then the quality and comprehensiveness of a web page’s content will become more, rather than less, vital.

All of this means that scraping Bing search results and extracting data from Google SERPs will remain efficient methods of collecting information for monitoring website performance, academic research, data analysis, and more.

Why scrape Bing search results?

Whatever the future holds, there’s no time like the present to scrape Bing. While Google remains the number one search engine in the world, on average, 1.114 billion people use Bing as their main tool for searching the web. Last year, the number of daily Bing searches reached 900 million. So we’re going to show you how to scrape Bing with a tool explicitly designed for the task. If you want to know how to do the same thing for Google, you can try Google Search Results Scraper. Go to this tutorial to learn how to use it, or follow the video guide below.

Step 1. Go to Bing Search Result Scraper in Apify Store

If you have an account, you’ll be taken directly to the scraper page. If you don’t, you’ll be prompted to sign up for free. You don’t need a credit card and there's no time limit on your free subscription. When you click the Try for free button, you’ll be able to configure the scraper to your liking.

Step 2. Specify search queries or URLs

Choose the queries or URLs you wish to scrape, as in the default example below. You can add as many queries or URLs as you wish with the Add button.

Step 3. Choose optional settings

You can configure the optimal settings to your needs. For example, you can change the maximum results per page or pages per query.

Step 4. Choose proxies

We recommend the default proxy setting, Automatic proxy, but you can also use selected or custom proxies and choose a proxy country.

Step 5. Choose advanced settings

If you’re a developer, you can specify further parameters of the scrape in the advanced options.

Step 6. Run the scraper and export the results

Once you’re happy with your settings, click the Start button at the bottom of the page, and the Bing scraper will start collecting your data. When the status changes from running to succeeded, you can preview and download your dataset in any of the formats provided.

Below is a sample dataset from this run in JSON.

If you haven’t done it already, try Bing Search Result Scraper for yourself while following along with this tutorial.

Frequently asked questions

Does Bing allow scraping?

You can scrape Bing provided you follow its terms of use. However, keep in mind that some kinds of data are protected by international regulations, so be careful scraping personal data, intellectual property, or confidential data.

Is scraping Bing legal?

Since web scraping Bing and other search engines does not require a login, it is legal to scrape Bing search results as the data is publicly available. However, you may still be bound by the Bing terms of use. If you are unsure of the legal implications of your scraping, you can learn more in Is web scraping legal?

Can I use AI to scrape Bing?

AI is currently unable to scrape websites directly, but it can help generate code for scraping Bing if you prompt it with the target elements you want to scrape. Note that the code may not be functional, and website structure and design changes may impact the targeted elements and attributes.

What data can be scraped from Bing?

Scraping Bing can provide you with data such as:

• Organic results
• Related queries
• See results for
• Recommended searches
• People Also Ask
• Wiki results
• News, Image, Video results

Does Bing search have APIs?

There are multiple Bing Search plans available in Bing Search API v7. The free tier provides three transactions per second and 1,000 transactions per month for all markets except Japan. You can find more information about the paid plans on the Bing Search API pricing page.