It is possible to delete a user group that has already been assigned to the SAML mapping groups.

Ideally, there should be a message "Cannot delete user group because it's used in place.."