How to Do Quora Data Scraping Including Questions, Answers, Authors, etc.

Quora is a new center for most of the questions available on the internet.

With more than 300 Million users, this has tons of data about what people wish to identify.

So, you might want to Extract Data from Quora for uncovering insights about the market, your business, your targeted audience, etc.

Today, we would go about how to extract data from Quora with a web scraper. Then, you will be able to scrape all the available data as the JSON or CSV file.

Web Data Scraper for Quora

For completing the project, we will utilize 3i Data Scraping Scraper, a powerful data scraper, which could work with all websites. Ensure to download 3i Data Scraping Scraper before having started.

Moreover, we would be extracting questions as well as data from the Smart Phone News community from Quora.

Extracting Data from Quora

The time has come to begin setting the web scraping project.

1. Just install as well as open 3i Data Scraping Scraper. Then click on the “new project” as well as enter URL for a page you would be extracting. In that case, we would be extracting Quora’s Smart Phones News community. After submitting the URL, it will render within the app.

2. The select command would be made by default, start by clicking on initial question about the page to choose it. This will get highlighted in color green to specify that this has been chosen. Rest of the questions on a page would get highlighted in color yellow. On left-hand sidebar, just rename the selection with “question”.

3. Then, just click on second question given on a page to choose all. Now, they would all get highlighted in color green.

4. Now, we can scrape additional data from the page. Let’s begin with total answers for every post. Utilize the PLUS (+) symbol next to “question” selection as well as opt the command ‘Relative Select’.

5. Utilizing the command ‘Relative Select’, just click on first question given in the list as well as on total answers under that. One arrow will come to show an association you’re making. Just rename the new selection with “answers”.

6. Grow the “answers” selection by clicking on an icon next to that.

7. Then, delete URL scraping under the “answers” selection as it is the data we’ve scraped already.

8. The project will look like this now:

Now, we will scrape more data using Quora.

Scraping Extra Data

Now, let’s tell 3i Data Scraping and click on every question given on a page as well as scrape extra data.

1. Just start with clicking on PLUS (+) symbol next to the “question” selection as well as select “click” command.

2. The pop-up would come asking if it is the next-page button. Just click on option no as well as name the new template for “question_page” as well as click on color green and “Create New Template” key.

3. A page for the first question given on this page will render within the app as well as a ‘Select’ command will get made by default.

4. Utilize the ‘Select’ command for scraping any extra data you’d need from the page. Here, we will scrape name of the best answer’s author. We would do that just by clicking on that. Just rename the selection with the word “author”.

5. To scrape additional data, just click on PLUS (+) symbol next to the “author” selection as well as opt for ‘Select’ command. After that, utilize this command for clicking on extra data to scrape. We would also scrape the given date at which the best answer got posted.

Deal with Infinite Scrolling

3i Data Scraping is scraping the data we’ve chosen from the initial few questions on a question’s page. The page utilizes infinite scrolling to load extra questions. Therefore, we would set up 3i Data Scraping for loading and scraping more questions.v

1. Initially, utilize the given tabs on right-hand side of a screen and return to the main template. After that, utilize a browser tab and return to main questions’ page.v

2. Then click on PLUS (+) symbol next to the “page” selection and click on the “Advanced” option and choose ‘Extract’ command.v

3. Then rename the selection with listing_value as well as replace $location.href expression using digit 0.

4. Then drag the scrape the command you’ve made to top of a command list, directly above the “question” choose a command.

5. Utilize an icon subsequent to “question” selection and expand all the commands. Float over the “question” selection as well as hold the Shift key for making PLUS (+) signal pop up. Utilize PLUS (+) symbol to choose the scrape command.

6. Just rename the new scrape command for removing and under scrape dropdown, select “Delete an element from page”

7. Utilizing the instructions given in the step 5, just add new extract commands as well as name that “listing_value”. With command settings given below, just replace $location.href expression using digit 1.

8. Just click on PLUS (+) symbol next to “page” selection as well as add the Conditional command. Just edit the expression of the command with “listing_value”.

9. Utilizing PLUS (+) symbol on conditional, just add the ‘Select’ command as well as choose a section on the website having all questions given on the feeds. You could need to utilize Ctrl+2 while hovering over that to choose it. Just rename the selection with “feed”.

10. Increase the new “feed” command as well as remove the scrape command.

11. Then click on PLUS (+) symbol on “feed” commands. Utilize it for adding the Scroll command.

12. Then repeat step 11 for adding the Go-To Template command. One pop-up would appear, accept that with the default settings.

13. Then click on the “Go to Template” command as well as enter a total number of times that you’d love to repeat the procedure in the “Repeat This Template” ground. In Quora, every repeat signifies 20 questions extracted. In that case, we would repeat that 4 additional times.

14. Finally, just click on the three dots given on the left-hand sidebar just after the main_template text as well as untick the “No Duplicates”.

Run Your Scraping

Now, it’s time to run the scraping job and scrape all the given data you’ve chosen.

Begin by clicking on the green color “Get Data” button given on the left-hand sidebar. Now, you could Test, Schedule, as well as Run any data scraping project. Here, we would run that straight away.

3i Data Scraping Scraper will extract the data selected. When your scraping gets completed, you would be able to download that as a JSON or CSV file.

Conclusion

You understand how to extract data from Quora using a web scraper.

We understand projects that become extremely complex. In case, you run in any problems during the project, just contact us and our representative will be delighted to help you! Contact 3i Data Scraping today!