You think IG wouldn't do worse? He could blast them once and destroy pretty much the entire mountain range they were on. And he wouldn't need to adapt to their powers. He'd just be too powerful for them to hurt.
There's the chance Magneto could control him, but Giant's an alien metal so there's no guarantee he could manipulate him.
In the movies? There's no Vibranium or even Wakanda mentioned in the X-Men Movies because FOX only has the rights to anything mutant related. The only mutant out of Wakanda wasn't in any movies so there's no way to know. But he has manipulated Adamantium. However Adamantium is a metorite metal...or it was in Origins. Don't know if they changed it.
But it wasn't an alien metal created and Processed on Mars. And it couldn't heal itself like IG could.