CI: test with `--fast`

[certik]

Currently we do not test --fast, and there were some bugs hiding due to that, such as #1668.