Contenido del Curso
Identifying Fake News
Clean and Convert
We have decided to create a complete chapter on the topic of text cleaning and preprocessing. As you may imagine, complete texts cannot be directly fed into an ML model. For this reason, we will apply specific preprocessing techniques.
The first step will be to remove punctuation from our column to reduce noise in our data. We will do this using regex (regular expression matching operations).
Then we will vectorize our text. Refer to the picture below for more information. Essentially, we will represent words, sentences, or even larger units of text as vectors.
Swipe to show code editor
-
Remove punctuaction with regex by using the appropriate method to replace the given pattern with an empty string.
-
Vectorize the texts of the articles.
Cambia al escritorio para practicar en el mundo realContinúe desde donde se encuentra utilizando una de las siguientes opciones¡Gracias por tus comentarios!
We have decided to create a complete chapter on the topic of text cleaning and preprocessing. As you may imagine, complete texts cannot be directly fed into an ML model. For this reason, we will apply specific preprocessing techniques.
The first step will be to remove punctuation from our column to reduce noise in our data. We will do this using regex (regular expression matching operations).
Then we will vectorize our text. Refer to the picture below for more information. Essentially, we will represent words, sentences, or even larger units of text as vectors.
Swipe to show code editor
-
Remove punctuaction with regex by using the appropriate method to replace the given pattern with an empty string.
-
Vectorize the texts of the articles.
Cambia al escritorio para practicar en el mundo realContinúe desde donde se encuentra utilizando una de las siguientes opciones