I dont think Will swam round from there..I think he may have got off after it plunged into the sea and clambered on shore on the N/W end of the island.. this was long after the compass pointed S/W at Jack.
It also shows us that Will was nearby and it didnt point to him it still pointed to the chest and when she got to that it still didnt point at Will it pointed to Jack..