1
00:00:00,890 --> 00:00:06,720
Hi and welcome to this interesting
section! You're going to learn web

2
00:00:06,720 --> 00:00:12,150
scrapping with Python in this section.
In this lecture I wanted to explain

3
00:00:12,150 --> 00:00:16,920
what web scrapping is, so web
scrapping means scrapping the web for

4
00:00:16,920 --> 00:00:23,070
information or in other words extracting
information from web pages. Let's say you

5
00:00:23,070 --> 00:00:28,320
want to extract information about real
estate, maybe want to know the price

6
00:00:28,320 --> 00:00:35,190
trend over time and place and I don't
think there exist some nice Excel files

7
00:00:35,190 --> 00:00:40,110
with well structured data that you can
go ahead and download and do data

8
00:00:40,110 --> 00:00:46,620
analysis of that right away. In reality
such data are spread over HTML web pages

9
00:00:46,620 --> 00:00:53,219
of real estates in the web sites in our
example so you're going to have to

10
00:00:53,219 --> 00:00:57,899
scrap them and put them in a structure,
in a well structured format

11
00:00:57,899 --> 00:01:04,830
such as an Excel, an excel file, CSV,
Pandas dataframes,

12
00:01:04,830 --> 00:01:08,250
or other tabular formats.
And putting that in a well structured

13
00:01:08,250 --> 00:01:15,229
format is referred to as web scrapping
and Python is excellent in that.

14
00:01:15,229 --> 00:01:19,110
Specifically we're going to use a Python
library and named

15
00:01:19,110 --> 00:01:24,720
BeautifulSoup, so in this section I'll
introduce you to BeautifulSoup and

16
00:01:24,720 --> 00:01:29,220
we're going to extract some information
from a simple web page while I show you

17
00:01:29,220 --> 00:01:33,960
our BeautifulSoup works. Then in the
next section, so once we consume the

18
00:01:33,960 --> 00:01:39,030
lectures of this section we'll go ahead
and extract some real estate information

19
00:01:39,030 --> 00:01:46,020
such as property addresses, and property
price, the area, and other features

20
00:01:46,020 --> 00:01:50,820
of properties, and we're going to extract
that information from a big real estate

21
00:01:50,820 --> 00:01:56,610
website, so yeah that's about what web
scrapping is, and yeah,

22
00:01:56,610 --> 00:01:57,000
I'll talk to you in the next lecture.