Intro to Web Scraping

Welcome to the course! Today we will start exploring how Web Scrapping works. Web Scraping is a process that can be used to automatically extract information from websites. It is applied to collect information from Web. For example, compare prices on different platforms or collect the data about stocks.

There are a lot of ways in Python to extract the data. Let's take a look on the comparison of the most popular libraries for Web Scraping: Requests, Beautiful Soup, lxml, Selenium.

In this course, we will focus on the first two libraries. However, Selenium and lxml are extremely powerful tools:

• Selenium supports work with JavaScript, a programming language that allows developers to -populate fields and menus dynamically.
• lxml allows the work with both HTML and XML files.