From the course: Natural Language Processing in Python

Unlock this course with a free trial

Join today to access over 26,400 courses taught by industry experts.

Traditional vs. modern NLP

Traditional vs. modern NLP

“

A question you might have at this point is when should I use traditional versus modern NLP techniques? Remember, traditional NLP techniques typically involve machine learning and then modern NLP techniques involve deep learning. We'll be talking about deep learning, transformers, and LLMs later on in this course. But in general, if you have the option of one or the other, the main thing that you should keep in mind is start simple. So here's a flowchart you can use to illustrate what I mean by starting simple when deciding between traditional versus modern. The first question you should ask yourself is, what's my NLP goal? If your goal is one of these three tasks here, then you should be thinking to yourself, these are all things that can be done using traditional NLP techniques. And the second question you should ask yourself is, how much data do I have? If you have small to medium data, so under roughly 100,000 rows, Then in that case, you should start simple. Try the traditional…

Contents