Saruman the White vs. Gandalf the Grey and Radagast the Brown

So here's a magical battle! Saruman is no longer constrained by the Valar, and Radagast is allowed the help of animals! Gandalf can use a sword.

Are Gandalf and Radagast also not restrained?

Radagast has some restraints. Say.... 1/3 of his restraints have been lifted