I dont see why he cant get rid of them. He can kill 1. 2. Is gonna be a problem, and 3 and 4 might kill him if he pisses tek off. Maybe, depends on how impressed youbwere by ego i guess.
SSJGGogeta
3 and 4 easily stomp Ego, and destroy his entire planet