From the course: Natural Language Processing in Python
Unlock this course with a free trial
Join today to access over 26,400 courses taught by industry experts.
Assignment: Text preprocessing with spaCy - Python Tutorial
From the course: Natural Language Processing in Python
Assignment: Text preprocessing with spaCy
For your next assignment, you have another message from Lexicon. She says, hi again, thanks for the first round of text preprocessing you did earlier with pandas. Could you do a second round of normalization and cleaning on the description column with spaCy to tokenize, lemmatize, and remove stop words from the text? Thank you, Lexi. Your key objectives for this assignment are to do some additional preprocessing techniques. So in addition to the lower casing and special character removal from the previous assignment, you're going to use the clean description column from that assignment as a starting point. And then from there, you're going to use spaCy to tokenize the text, lemmatize the text, and remove stop words.
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
-
-
(Locked)
Section introduction59s
-
(Locked)
NLP pipeline2m 43s
-
(Locked)
Text preprocessing overview2m 35s
-
(Locked)
Assignment: Create a new environment1m 28s
-
(Locked)
Solution: Create a new environment3m 20s
-
(Locked)
Text preprocessing with pandas4m 19s
-
(Locked)
Demo: Text preprocessing setup6m 4s
-
(Locked)
Demo: Text preprocessing with pandas8m 14s
-
(Locked)
Pro tip: Create a function4m 25s
-
(Locked)
Assignment: Text preprocessing with pandas3m 22s
-
(Locked)
Solution: Text preprocessing with pandas8m 12s
-
(Locked)
Text preprocessing with spaCy1m 38s
-
(Locked)
Tokenization2m 5s
-
(Locked)
Lemmatization2m 42s
-
(Locked)
Stop words1m 17s
-
(Locked)
Parts of speech tagging2m 1s
-
(Locked)
Demo: Tokens, lemmas, and stop words8m
-
(Locked)
Pro tip: Use the apply method5m 59s
-
(Locked)
Demo: Parts of speech tagging9m 27s
-
(Locked)
Demo: Create an NLP pipeline6m 15s
-
(Locked)
Assignment: Text preprocessing with spaCy41s
-
(Locked)
Solution: Text preprocessing with spaCy7m 57s
-
(Locked)
Vectorization4m 45s
-
(Locked)
CountVectorizer in Python8m 4s
-
(Locked)
Demo: CountVectorizer5m 48s
-
(Locked)
Demo: CountVectorizer parameters5m 5s
-
(Locked)
Pro tip: Exploratory data analysis2m 13s
-
(Locked)
Assignment: CountVectorizer1m 16s
-
(Locked)
Solution: CountVectorizer7m 36s
-
(Locked)
Term frequency–inverse document frequency (TF-IDF)6m 30s
-
(Locked)
TF-IDF vectorizer in Python5m 8s
-
(Locked)
Demo: TF-IDF vectorizer4m 52s
-
(Locked)
Assignment: TF-IDF vectorizer1m 7s
-
(Locked)
Solution: TF-IDF vectorizer7m 38s
-
(Locked)
Key takeaways4m 13s
-
(Locked)
-
-
-
-
-