Don't filter out the "allowed" group by columns

[umanwizard]

Group by address is working again with this change:

[alwaysmeticulous]

✅ Meticulous spotted zero visual differences across 344 screens tested: view results.

Meticulous simulated ~4 hours of user flows against your PR.

_{Expected differences? Click here. Last updated for commit 8980dff. This comment will update as new commits are pushed.}