It's certainly not the only plot device obviously. Not that Thor is weak without the hammer. Even without it he still has the strength, durability, and some kind of control over lightning/the weather. He has some decent levels of speed as well, nothing near the level of the high level speedsters, but he's definitely a good deal above bullet timing. So his hammer allows him to fight with beings who would of normally been way out of his weight class.