Oh yes, of course, since they are not naturalised yet. I wonder how many have had their ILRs revoked, and they subsequently removed from the UK. Any stats on that?
I have no figures to hand, but it's rare for someone with ILR to be removed from the country. The general basis of ILR has been that it is possible to make one's home in the UK with that status, and this remains true.
For example, some countries have a general policy that anyone who is a permanent resident but not a citizen is automatically deported (sometimes after serving a prison sentence) if found guilty of a criminal act. That has not been the case in the UK. The recent controversy about non-citizen prisoners who were not deported after serving their sentences was really about the fact that these people had not, apparently, been
considered for deportation; had they been considered for deportation, many of them would nevertheless not have been deported. Some parts of the popular press and media, of course, got worked up and assumed (or appeared to assume) that all non-citizens who serve a prison sentence should be automatically deported - but that has not been the practice in the UK.
The most common way - by far - that people lose their ILR status is by ceasing to live in the UK. Not living in the UK is generally taken as meaning being out of the country for two years, which is a reasonable rule of thumb but actually it is more complicated than that.
