Web Scraping with Python

Cursusinhoud

Web Scraping with Python

Web Scraping with Python

1. HTML Files and DevTools

Intro to Web Scraping First Steps HTML File Structure Hierarchy in the HTML String Methods Attributes DevTools

2. Beautiful Soup

Work with the Library Work with Soup Find/Find_all Find All!

3. CSS Selectors/XPaths

Intro to XPath Attributes in XPath Selectors CSS Selectors CSS Selectors in BeautifulSoup XPath vs CSS Selector

4. Tables

Intro to Tables Ways to Scrape Table Simple Solution for Scraping Challenge

Challenge

Let’s check how well we can scrape the data from websites!

You have the following page you need to scrape the data from. Take a look at it and see which information contains. Firstly, we should access the content of the page.

Fill gaps to see the HTML code of your page:

from urllib.request import

url = "https://codefinity-content-media.s3.eu-west-1.amazonaws.com/18a4e428-1a0f-44c2-a8ad-244cd9c7985e/final.html"
page =(url)
html = page.().decode()

Click or drag`n`drop items and fill in the blanks

Let’s continue. We can already get the HTML structure of the page.

To iterate through all the HTML elements, we can use libraries:

Select the correct answer

XPath

CSS Selector

BeautifulSoup

Scrapy

HTML

The next step for working with the data is creating the BeautifulSoup object.

Fill gaps to create the BeautifulSoup object:

soup =(html, ".")

Let's scrap the table!.

To iterate through all the HTML elements, we can use libraries:

Select the correct answer

XPath

CSS Selector

BeautifulSoup

Scrapy

HTML

Was alles duidelijk?

Hoe kunnen we het verbeteren?

Bedankt voor je feedback!

Sectie 4. Hoofdstuk 4

Onze excuses dat er iets mis is gegaan. Wat is er gebeurd?

some-alt