I think we should switch the cancellation vote to a simple majority rather than unanimous.
Had a scenario recently where someone dropped out of a 4 player game, so myself and one of the remaining players voted to cancel, not wanting to play a game where the balance was thrown off so much (it was only round one or two, iirc). But the last person refused to cancel the game, in essence holding our Karma hostage. Either we leave and take the Karma hit or we play through a horribly unbalanced, unfun game where one of the players dropped. I ended up just quitting out and taking the hit, which I only regret because this system punishes that act so hard.
An alternative proposal could be to eliminate the Karma penalty after one player drops - giving the other players a free out, if you will.
In either case, I don't see the problem with a majority vote and there are plenty of problems with the unanimous vote.