Well if we were to go on looks, I'd defintely say Malfoy was there after Riddle because he looks about 45-47 not 60 but then he might have a very good plastic suregon! lol or something 😉 But seriously I think he's a fair bit younger because he's such an egotistical person that I don't think he ever would have followed someone else in his own year, he would probably want to be leader but rather as a much younger person he'd be in awe of the by then already great and established villian - he'd admire and totally believe in the cause as a follower.
As for regarding Hagrid as a contemporary I can see what you mean but I think it's more seeing anybody of any age as an inferior except a certain few, it makes it worse that Hagrid is not of noble birth or in a powerful position. I mean Malfoy talks down to everybody no matter who they are as long as they are not on his side. Hence I think Hagrid is probably older and has to be because in COS he was already older then Riddle no?