Why does most of hierarchical RL stop at the first layer of hierarchy—i.e. skills? Because until now, it wasn't clear how to learn the state abstractions in a principled way! Our recent NeurIPS paper shows how to start with a set of skills and learn state abstractions. 🧵1/8
