You can remove a group of system administrators from the vCloud Director system by deleting their LDAP group.
When you delete an LDAP group, users who have a vCloud Director account based solely on their membership in that group are stranded and cannot log in. See Delete a System Administrator Who Lost Access to the System.