It was explained in Dark Empire, they said that its just the physical wear and tear that results from controlling the force the way the Sith do, its very draining to the body, and plus, it is often used for death and destruction and being that close to such dark forces so often, eats away at the body's life force.