Challenge: Tokenizing a Sentence
Task
Swipe to start coding
Your task is to tokenize the given excerpt from 'The Adventures of the Musgrave Ritual' into sentences and then tokenize the last sentence into words. Use the nltk functions for this purpose and use the negative index to retrieve the last sentence and convert this sentence to lowercase.
Solution
99
1
2
3
4
5
6
7
8
9
10
# Import necessary functions
from nltk.tokenize import sent_tokenize, word_tokenize
import nltk
nltk.download('punkt_tab')
text = 'Sherlock Holmes picked them up one by one, and laid them along the edge of the table. Then he reseated himself in the chair, and looked over with a gleam of satisfaction in his eyes. "These," said he, "are all that I have left to remind me of ‘The Adventure of the Musgrave Ritual’."'
# Tokenize the text into sentences
sentences = sent_tokenize(text)
# Tokenize the last sentence converted to lowercase
tokens = word_tokenize(sentences[-1].lower())
print(tokens)
Everything was clear?
Thanks for your feedback!
Section 1. Chapter 4
99
1
2
3
4
5
6
7
8
9
10
# Import necessary functions
from ___ import ___, ___
import nltk
nltk.download('punkt_tab')
text = 'Sherlock Holmes picked them up one by one, and laid them along the edge of the table. Then he reseated himself in the chair, and looked over with a gleam of satisfaction in his eyes. "These," said he, "are all that I have left to remind me of ‘The Adventure of the Musgrave Ritual’."'
# Tokenize the text into sentences
sentences = ___(___)
# Tokenize the last sentence converted to lowercase
tokens = ___(___)
print(tokens)
Ask AI
Ask anything or try one of the suggested questions to begin our chat
