How to find HTML selectors for your web scraper

Created by Kai Sasaki, Modified on Tue, 25 Oct 2022 at 02:48 PM by Kai Sasaki

Why we need to define selectors
When we scrape a website, we need to define one or more selectors to tell the web scraper what information we want to retrieve.

If you know HTML

Knowing the markup language makes things easier. You just have to inspect the website's source code with your browser, and write down the selectors.

Some examples:

// Get the main title

// Get subtitles

// Get subtitles with class .header

// Get subtitles with id #header

If you don't know HTML

In this case, we can use many tools and browser extensions to easily extract the selectors from a website.

For example, if you are using Google Chrome browser, you can install a widget called SelectorGadget

Once installed, just click the element you want to scrape, and the extension will give you the unique HTML selector for the element.

With this tips you should be able to find the selectors you need to create the perfect web scraper.

If you need more help with this, feel free to send us a message.

Was this article helpful?

That’s Great!

Thank you for your feedback

Sorry! We couldn't be helpful

Thank you for your feedback

Let us know how can we improve this article!

Select atleast one of the reasons

Feedback sent

We appreciate your effort and will try to fix the article