Conteúdo do Curso
Identifying Fake News
Clean and Convert
We have decided to create a complete chapter on the topic of text cleaning and preprocessing. As you may imagine, complete texts cannot be directly fed into an ML model. For this reason, we will apply specific preprocessing techniques.
The first step will be to remove punctuation from our column to reduce noise in our data. We will do this using regex (regular expression matching operations).
Then we will vectorize our text. Refer to the picture below for more information. Essentially, we will represent words, sentences, or even larger units of text as vectors.
Tarefa
- Remove punctuaction with regex by using the appropriate method to replace the given pattern with an empty string.
- Vectorize the texts of the articles.
Tarefa
- Remove punctuaction with regex by using the appropriate method to replace the given pattern with an empty string.
- Vectorize the texts of the articles.
Tudo estava claro?
We have decided to create a complete chapter on the topic of text cleaning and preprocessing. As you may imagine, complete texts cannot be directly fed into an ML model. For this reason, we will apply specific preprocessing techniques.
The first step will be to remove punctuation from our column to reduce noise in our data. We will do this using regex (regular expression matching operations).
Then we will vectorize our text. Refer to the picture below for more information. Essentially, we will represent words, sentences, or even larger units of text as vectors.
Tarefa
- Remove punctuaction with regex by using the appropriate method to replace the given pattern with an empty string.
- Vectorize the texts of the articles.
