Visualize transformer attention!
AttentionViz, created by Catherine Yeh and expanded by Yida Chen, helps you explore transformer self-attention by visualizing query and key vectors in a joint embedding.
Paper: arxiv.org/abs/2305.03210
Website: attentionviz.com
Human/AI interaction. Visualization as design, science, art. Professor at Harvard, and part-time at Google's People+AI Research initiative.
Joined July 2008

