Value Gradient Flow

To install the full dependencies, simply run:

pip install -r requirements.txt

To use D4RL environments, you need to additionally set up MuJoCo 2.1.0.

Paper results can be reproduced by running ./run_scripts/run_vgf_off_d4rl.sh, ./run_scripts/run_vgf_off_ogbench.sh, ./run_scripts/run_vgf_off2on_ogbench.sh.

Wandb runs can be found at here

This codebase is built on top of fql's reference implementations.