Notice: This page requires JavaScript to function properly.
Please enable JavaScript in your browser settings or update your browser.Stem the Tokens | Stemming and Lemmatization
course content

Conteúdo do Curso

Introduction to NLP

1. Text Preprocessing Fundamentals

NLP and Its ApplicationsUnderstanding Text PreprocessingTokenizationTokenize a Sentence Tokenization Using Regular ExpressionsTokenize Using RegexRemoving Stop WordsApplying Text Preprocessing in Practice

2. Stemming and Lemmatization

StemmingStem the TokensLemmatizationPart of Speech TaggingLemmatization with POS Tagging

3. Basic Text Models

Overview of Vector Space ModelsKey Types of Vector Space ModelsBag of WordsCustomizing Bag of WordsCreate a Bag of WordsTF-IDFImplementing TF-IDF

4. Word Embeddings

Word Embeddings BasicsCBoW and Skip-gram Models (Optional)Implementing Word2VecCreate Word Embeddings

Introduction to NLP

Stem the TokensStem the Tokens

Tarefa

Your task is the following:

  1. Import Porter Stemmer.
  2. Convert text to lowercase.
  3. Tokenize the text string.
  4. Load English stop words.
  5. Filter out the stop words using list comprehension.
  6. Create a stemmer object.
  7. Stem the tokens using list comprehension.

Tudo estava claro?

Seção 2. Capítulo 2
toggle bottom row
course content

Conteúdo do Curso

Introduction to NLP

1. Text Preprocessing Fundamentals

NLP and Its ApplicationsUnderstanding Text PreprocessingTokenizationTokenize a Sentence Tokenization Using Regular ExpressionsTokenize Using RegexRemoving Stop WordsApplying Text Preprocessing in Practice

2. Stemming and Lemmatization

StemmingStem the TokensLemmatizationPart of Speech TaggingLemmatization with POS Tagging

3. Basic Text Models

Overview of Vector Space ModelsKey Types of Vector Space ModelsBag of WordsCustomizing Bag of WordsCreate a Bag of WordsTF-IDFImplementing TF-IDF

4. Word Embeddings

Word Embeddings BasicsCBoW and Skip-gram Models (Optional)Implementing Word2VecCreate Word Embeddings

Introduction to NLP

Stem the TokensStem the Tokens

Tarefa

Your task is the following:

  1. Import Porter Stemmer.
  2. Convert text to lowercase.
  3. Tokenize the text string.
  4. Load English stop words.
  5. Filter out the stop words using list comprehension.
  6. Create a stemmer object.
  7. Stem the tokens using list comprehension.

Tudo estava claro?

Seção 2. Capítulo 2
toggle bottom row
some-alt