Don't know exactly how tough Lafey is, but Thor hit him first during the fight and it didn't kill him or hurt him too bad, and then Odin knocked him back pretty good too and it didn't hurt him either. I don't think these were really hard attacks but it appears he is more durable than the other guys.
Loki was Thor's equal pretty much it appeared. I liked how Thor set his hammer on Loki's chest so he couldn't move. That was a nice touch, yay.