Taking away the nine tails is one thing, but why Sage mode? That's an ability he on his own possesses, why strip him of it?
Anyway, he'd still be very powerful, considering how a significant portion of his own chakra was constantly used to suppress the nine tails. Even then, he still has Ashura's chakra within him--He would regardless have become one of the most prominent ninja of his day before long.