Can Attention Handle Disagreement?

Channel:
Subscribers:
846
Published on ● Video Link: https://www.youtube.com/watch?v=t2J6o8LJUeM



Duration: 0:00
105 views
0


Language models excel at agreement and elaboration because the attention mechanism focuses on related input. Disagreement requires stepping away from context, which attention doesn’t naturally support. As a result, LLMs tend to amplify rather than oppose what’s already being said.