It's the only time Thor beat it single-handedly, other times he held his own at best, but not outright beat it. Except with thunderstrike in thor #476 i think.
Also, Odin has outright owned Destroyer several times. He even made it bow forcefully in front of him, and manipulated the life force in it several times which effectively neutralizes it. Even in the loki instance, Odin blocked Loki's mind from trillions of thought-years (whatever that means).
Regarding Hela -- for reference, Kurse (another trans level character) has been owned by Hela in her realm and she even claimed that his power is nothing compared to hers. She has done other impressive things as well.