Poor performance when users are "Guest" or "Admin" group

Steps to reproduce:

1. Set user as "Guest" or "Admin" for User type in Permissions
2. Use Hosts menu to lookup group of hosts
3. Set user for "Super-admin" for User type in Permissions
4. Look at same Hosts menu as in step 2

On Super-admin mode, you will notice the Hosts load much faster. For large servers I have noticed it takes roughly 5x as long when not Super-admin. I had several users test on several servers and the issue was reproduced on every attempt.