The first hypothetical that you've raised can be considered a good case for the reinstatement of the vote. However, I would still disagree for two reasons.
First, it is a very small exception, and laws can't be feasibly made based on exceptions. The resources required to implement this would be disproportionate to this "better" outcome. Overspending funds that can be used to help more people supersedes this issue.
Second, the "evil" acts committed don't disappear regardless of the recovery. Becoming a law-abiding, tax-paying citizen is a normal expectation, not a special achievement. It's commendable, but "rewarding" this by returning the vote would undermine the important signal that actions have consequences. And that it would also be unfair for all the "regular" citizens that don't get "rewarded" for paying taxes and don't commit crimes.
So no, the commendable recovery does not supersede the crime. A government isn't supposed to be and can't be "God" capable of such forgiveness or moral judgment. Social cohesion, stability, human nature, etc., are to be balanced.
"Incapable of making sane decisions" isn't complicated to understand. There are many cases of people not being allowed to drive or sign contracts, etc., for reasons under this umbrella term, such as mental health issues, serious crimes, etc.
But regardless, driving, signing contracts, etc., are all examples incomparable with the the right to vote. Because they don't inherently affect millions of people and the future of the nation. You cannot reasonably make the case that voting is on the same moral, serious, and conceptual level as these other examples. It would be like saying that owning a slingshot is the same as owning a tank.
The duality that you posed of "pick one" doesn't follow. There's no reason to establish or require "black and white" solutions or punishments. We can perfectly make case-by-case consequences and compensations accordingly. The law already does this. And in your case, it's not reasonable or moral to assume that just because someone stopped being a horrible human, it now clears them of all consequences. Severe actions deserve and require severe consequences. For the sake of the nation. For the sake of civil society and the will of the people.