From the course: Natural Language Processing in Python

Unlock this course with a free trial

Join today to access over 26,400 courses taught by industry experts.

Pro tip: NN notation and matrices

Pro tip: NN notation and matrices - Python Tutorial

From the course: Natural Language Processing in Python

Start my 1-month free trial Buy for my team

Pro tip: NN notation and matrices

“

This is a pro tip lesson on neural network notation and matrices. What we'll be covering here isn't essential to your neural network understanding, but it's nice to know if you continue to learn about neural networks after this course. Now in the previous lesson when we did the Python demo, we saw an example of how the weights and biases of a neural network can be captured within matrices and vectors. And this is an important piece to remember when we talk about transformers. Because once we get to those more complex architectures, we won't be viewing neural networks as visual nodes anymore, but instead, everything's going to be captured in matrices. So if we go back to our original example, where we had our input layer with two inputs, our hidden layer with two hidden nodes, and an output, sometimes when you're reading papers on neural networks, you'll see this arrow represented by this W with all these numbers next to it. So let's break down what all those numbers mean. The way to…

Contents