Notice: This page requires JavaScript to function properly.
Please enable JavaScript in your browser settings or update your browser.Tokenize a Sentence | Text Preprocessing Fundamentals
course content

Зміст курсу

Introduction to NLP

1. Text Preprocessing Fundamentals

NLP and Its ApplicationsUnderstanding Text PreprocessingTokenizationTokenize a Sentence Tokenization Using Regular ExpressionsTokenize Using RegexRemoving Stop WordsApplying Text Preprocessing in Practice

2. Stemming and Lemmatization

StemmingStem the TokensLemmatizationPart of Speech TaggingLemmatization with POS Tagging

3. Basic Text Models

Overview of Vector Space ModelsKey Types of Vector Space ModelsBag of WordsCustomizing Bag of WordsCreate a Bag of WordsTF-IDFImplementing TF-IDF

4. Word Embeddings

Word Embeddings BasicsCBoW and Skip-gram Models (Optional)Implementing Word2VecCreate Word Embeddings

Introduction to NLP

Tokenize a Sentence Tokenize a Sentence

Завдання

Your task is to tokenize the given excerpt from 'The Adventures of the Musgrave Ritual' into sentences and then tokenize the last sentence into words. Use the nltk functions for this purpose and use the negative index to retrieve the last sentence and convert this sentence to lowercase.

Все було зрозуміло?

Секція 1. Розділ 4
toggle bottom row
course content

Зміст курсу

Introduction to NLP

1. Text Preprocessing Fundamentals

NLP and Its ApplicationsUnderstanding Text PreprocessingTokenizationTokenize a Sentence Tokenization Using Regular ExpressionsTokenize Using RegexRemoving Stop WordsApplying Text Preprocessing in Practice

2. Stemming and Lemmatization

StemmingStem the TokensLemmatizationPart of Speech TaggingLemmatization with POS Tagging

3. Basic Text Models

Overview of Vector Space ModelsKey Types of Vector Space ModelsBag of WordsCustomizing Bag of WordsCreate a Bag of WordsTF-IDFImplementing TF-IDF

4. Word Embeddings

Word Embeddings BasicsCBoW and Skip-gram Models (Optional)Implementing Word2VecCreate Word Embeddings

Introduction to NLP

Tokenize a Sentence Tokenize a Sentence

Завдання

Your task is to tokenize the given excerpt from 'The Adventures of the Musgrave Ritual' into sentences and then tokenize the last sentence into words. Use the nltk functions for this purpose and use the negative index to retrieve the last sentence and convert this sentence to lowercase.

Все було зрозуміло?

Секція 1. Розділ 4
toggle bottom row
some-alt