From the course: Deep Learning Foundations: Natural Language Processing with TensorFlow

Unlock the full course today

Join today to access over 22,400 courses taught by industry experts or purchase this course individually.

Introduction to word encodings

Introduction to word encodings - TensorFlow Tutorial

From the course: Deep Learning Foundations: Natural Language Processing with TensorFlow

Start my 1-month free trial

Introduction to word encodings

- Now that we are aware of the success of deep learning and understanding natural language. Let's understand the fundamentals of preprocessing textual data. So, computers understand numbers and not textual characters. So, we have to find ways to encode characters. We could take character encodings for each character in a set, for example, the ASCII values. But the question is, will that help us understand the meaning of a word? So for example, consider the word "Arms" as shown here and the ASCII values of each character in the word. So, you might think you could have a word like "Arms" encoded using these values. But the problem with this, of course, is that the semantics of the word are not encoded in the letters. This could be demonstrated using the word "Mars", which has a very different meaning but with exactly the same letters. So, it seems that training a Neural Network with just the letters could be a daunting…

Contents