Chapter 10: Text Feature Engineering
Self-Attention and Contextual Embeddings intermediate
Self-attention lets the same token mean different things in different sentences because its representation is rebuilt from context instead of looked up once from a static table.
Self-attention lets the same token mean different things in different sentences because its representation is rebuilt from context instead of looked up once from a static table.
Register to Read
Sign up for a free account to access all 112 primer topics.
Create Free AccountAlready have an account? Sign in