I think it's somehow like that thing Sauron mentioned... they "rests" fly into the endless dark of Saurons shadows, where they kinda rebuild a bit of their strength - perhaps a bit like Tolkien described the death of Saruman: an evil breath flows away, not really existing, but there... I dont think they have to walk to Mordor lol 😄
interesting question.