From Lear, Tolstoy and the Fool by George Orwell (bolded emphasis is mine):
A sort of doubt has always hung around the character of Tolstoy, as round the character of Gandhi. He was not a vulgar hypocrite, as some people declared him to be, and he would probably have imposed even greater sacrifices on himself than he did, if he had not been interfered with at every step by the people surrounding him, especially his wife. But on the other hand it is dangerous to take such men as Tolstoy at their disciples’ valuation. There is always the possibility – the probability, indeed – that they have done no more than exchange one form of egoism for another. Tolstoy renounced wealth, fame and privilege; he abjured violence in all its forms and was ready to suffer for doing so; but it is not easy to believe that he abjured the principle of coercion, or at least the DESIRE to coerce others. There are families in which the father will say to his child, “You’ll get a thick ear if you do that again”, while the mother, her eyes brimming over with tears, will take the child in her arms and murmur lovingly, “Now, darling, IS it kind to Mummy to do that?” And who would maintain that the second method is less tyrannous than the first? The distinction that really matters is not between violence and non-violence, but between having and not having the appetite for power. There are people who are convinced of the wickedness both of armies and of police forces, but who are nevertheless much more intolerant and inquisitorial in outlook than the normal person who believes that it is necessary to use violence in certain circumstances. They will not say to somebody else, “Do this, that and the other or you will go to prison”, but they will, if they can, get inside his brain and dictate his thoughts for him in the minutest particulars. Creeds like pacifism and anarchism, which seem on the surface to imply a complete renunciation of power, rather encourage this habit of mind. For if you have embraced a creed which appears to be free from the ordinary dirtiness of politics – a creed from which you yourself cannot expect to draw any material advantage – surely that proves that you are in the right? And the more you are in the right, the more natural that everyone else should be bullied into thinking likewise.