I made a video! It introduces superposition in neural networks, and shows how to construct weight matrices for superposition in a simple autoencoder. (1/3)
The hardest part of coding with LLMs is resisting wishful thinking about their capabilities. It's so tempting to just type a simple prompt and sit back to watch; it's also rewarding sometimes, like a slot machine. But it's a pretty ineffective workflow. For now.
