How can you just leave it at that? Based off power levels, sure, he is much stronger, but he isn't all knowing. He has zero knowledge of the powers these people have. Situationally, he could lose to several people. Trafalgar Law could cut him into pieces if he rushed in. That's his power. Goku loves to rush in and fight hand to hand. Without proper knowledge, that doesn't end well. Itachi can put him in Genjutsu. You have to realize you are in a genjutsu to break it. He wouldn't know that right off the bat. He could be engulfed in amaterasu before he knew it. There are probably more examples than just those but I can't think of them right off hand.
We get it. DBZ universe owns, but without proper knowledge of skills, bad decisions could still lead to them dying to weaker people.