In this post, I am going to mention a simple script to scrape Google search results in CSV, Excel, JSON. The name of the script or tool is Google2Csv and you can run it on your PC or online in Google Colab. For convenience, here I will use the script in Colab Notebook to show how it works. It takes a search query from you, makes a request to the Google search engine, and retrieves the results. The results that it produces are automatically saved in separate CSV, Excel, and JSON files. You can download that file on your PC and use that anywhere.
There are many Google scrappers you can use but this is one of the simplest. However, it isn’t intended to use for heavy scraping as you will end up getting banned by Google Servers. For personal or small-case use, you can use it. Or, if you know how to work with proxies then you may succeed in circumventing the IP ban. The CSV that it generates has the title and URL in it and it can scrape more than 100 results easily. In my case, I was able to get 150+ results that is equivalent to scraping 15 search results pages which is not bad.
How to Scrape Google Search Results in CSV, Excel, JSON?
The entire script that scrapes Google Search results is saved in this Colab Notebook. Or, you can access the GitHub repository of the same from here. Just open the notebook and then make a copy of it in your account. Next, you just have to customize the search query in this. You just scroll down to the third last cell and define your search query in “googleSearchQuery” variable. You can see this in the following screenshot.
Now, just use the Runtime > Run all menu and then simply wait for it to finish the run. When it finishes, you can a table of sear results generated there. Not only this, at the end of the run, but it also saves corresponding generated CSV, JSON, and Excel files. Click on the file’s icon on the left sidebar to see the generated files. This is as simple as that.
In this way, you can make use of this simple and powerful tool. Just scrape Google search results for any search query and then use the Excel file that it generates wherever you want. With this, you can easily scrape 10-15 search result pages which is a great number for this dead-simple script.
Closing thoughts
If you are looking for a simple Google search results scraper then you are at the right place. Just use the tool I have mentioned here without even setting up on your PC. Just run in Colab, get the search results, and then simply get the generated Excel files. It is good for personal use and if you are a programmer then you can further contribute to this project and maybe add more features.
